[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:19:15.880115  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:40493
I20260709 12:19:15.881827  2677 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:19:15.882978  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:15.900235  2683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:15.900249  2684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:15.901181  2686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:15.902390  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:17.109460  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.109727  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.110011  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599557109963 us; error 0 us; skew 500 ppm
I20260709 12:19:17.110932  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.116804  2677 webserver.cc:533] Webserver started at http://127.2.157.126:44595/ using document root <none> and password file <none>
I20260709 12:19:17.117805  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.118081  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.118598  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.124929  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "4ebd9e6a7f9746968955df9a305f0f85"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.133798  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:19:17.139971  2692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.141441  2677 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:19:17.141924  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "4ebd9e6a7f9746968955df9a305f0f85"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.142303  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:17.202818  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:17.204636  2677 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:19:17.205221  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:17.286603  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:40493
I20260709 12:19:17.286679  2743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:40493 every 8 connection(s)
I20260709 12:19:17.295603  2744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:17.320848  2744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: Bootstrap starting.
I20260709 12:19:17.327703  2744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:17.329845  2744 log.cc:826] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: Log is configured to *not* fsync() on all Append() calls
I20260709 12:19:17.335404  2744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: No bootstrap required, opened a new log
I20260709 12:19:17.357605  2744 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER }
I20260709 12:19:17.358258  2744 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:17.358541  2744 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ebd9e6a7f9746968955df9a305f0f85, State: Initialized, Role: FOLLOWER
I20260709 12:19:17.359568  2744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER }
I20260709 12:19:17.360112  2744 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:17.360433  2744 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:17.360816  2744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:17.365257  2744 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER }
I20260709 12:19:17.366113  2744 leader_election.cc:304] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ebd9e6a7f9746968955df9a305f0f85; no voters: 
I20260709 12:19:17.368005  2744 leader_election.cc:290] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:17.368341  2747 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:17.371246  2747 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 1 LEADER]: Becoming Leader. State: Replica: 4ebd9e6a7f9746968955df9a305f0f85, State: Running, Role: LEADER
I20260709 12:19:17.372293  2747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER }
I20260709 12:19:17.373443  2744 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:17.385957  2749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ebd9e6a7f9746968955df9a305f0f85. Latest consensus state: current_term: 1 leader_uuid: "4ebd9e6a7f9746968955df9a305f0f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER } }
I20260709 12:19:17.385900  2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ebd9e6a7f9746968955df9a305f0f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ebd9e6a7f9746968955df9a305f0f85" member_type: VOTER } }
I20260709 12:19:17.386750  2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:17.386729  2749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:17.390817  2757 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:17.402657  2757 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:17.405085  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:17.420667  2757 catalog_manager.cc:1383] Generated new cluster ID: 938760ad5f094d57bce6703f7cb1ae79
I20260709 12:19:17.420993  2757 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:17.448153  2757 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:17.449753  2757 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:17.471019  2757 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: Generated new TSK 0
I20260709 12:19:17.472174  2757 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:17.537012  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:17.546857  2766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.548652  2767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.551038  2769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.553100  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:17.554174  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.554461  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.554667  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599557554648 us; error 0 us; skew 500 ppm
I20260709 12:19:17.555516  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.559765  2677 webserver.cc:533] Webserver started at http://127.2.157.65:40139/ using document root <none> and password file <none>
I20260709 12:19:17.560495  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.560750  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.561085  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.562609  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "620b99ab8ada48d4a2b355358d59bf15"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.569723  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.001s
I20260709 12:19:17.575071  2774 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.576046  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:17.576411  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "620b99ab8ada48d4a2b355358d59bf15"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.576800  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:17.604580  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:17.606448  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:17.609329  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:17.614357  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:17.614666  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.614965  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:17.615167  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.713073  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:40637
I20260709 12:19:17.713162  2836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:40637 every 8 connection(s)
I20260709 12:19:17.720468  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:17.730823  2841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.732713  2842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.743116  2677 server_base.cc:1061] running on GCE node
W20260709 12:19:17.743045  2844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.744365  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.744704  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.744972  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599557744949 us; error 0 us; skew 500 ppm
I20260709 12:19:17.745684  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.751107  2677 webserver.cc:533] Webserver started at http://127.2.157.66:46815/ using document root <none> and password file <none>
I20260709 12:19:17.751875  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.752138  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.752476  2837 heartbeater.cc:344] Connected to a master server at 127.2.157.126:40493
I20260709 12:19:17.752496  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.753103  2837 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:17.754277  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "a8121be36ee14ab3960ca416d5b47142"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.754379  2837 heartbeater.cc:507] Master 127.2.157.126:40493 requested a full tablet report, sending...
I20260709 12:19:17.758414  2709 ts_manager.cc:194] Registered new tserver with Master: 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:17.760815  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:19:17.761976  2709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40934
I20260709 12:19:17.766227  2849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.767225  2677 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:17.767590  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "a8121be36ee14ab3960ca416d5b47142"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.767880  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:17.811061  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:17.812536  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:17.814755  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:17.818379  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:17.818579  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.818902  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:17.819075  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.913852  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:46697
I20260709 12:19:17.914098  2911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:46697 every 8 connection(s)
I20260709 12:19:17.922971  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:17.931531  2915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:17.934887  2916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.938798  2912 heartbeater.cc:344] Connected to a master server at 127.2.157.126:40493
I20260709 12:19:17.939491  2912 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:17.940857  2912 heartbeater.cc:507] Master 127.2.157.126:40493 requested a full tablet report, sending...
I20260709 12:19:17.944548  2709 ts_manager.cc:194] Registered new tserver with Master: a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:17.946653  2709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40948
W20260709 12:19:17.953166  2918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:17.954097  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:17.955248  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:17.955566  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:17.955783  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599557955765 us; error 0 us; skew 500 ppm
I20260709 12:19:17.956513  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:17.959592  2677 webserver.cc:533] Webserver started at http://127.2.157.67:45961/ using document root <none> and password file <none>
I20260709 12:19:17.960263  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:17.960526  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:17.960901  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:17.962352  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.968746  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:19:17.973464  2923 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:17.974462  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:19:17.974884  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
format_stamp: "Formatted at 2026-07-09 12:19:17 on dist-test-slave-sx71"
I20260709 12:19:17.975287  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:18.025336  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:18.026803  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:18.028923  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:18.031996  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:18.032207  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.032539  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:18.032730  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:18.144196  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:46737
I20260709 12:19:18.144307  2985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:46737 every 8 connection(s)
I20260709 12:19:18.163967  2986 heartbeater.cc:344] Connected to a master server at 127.2.157.126:40493
I20260709 12:19:18.164381  2986 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:18.165460  2986 heartbeater.cc:507] Master 127.2.157.126:40493 requested a full tablet report, sending...
I20260709 12:19:18.168160  2709 ts_manager.cc:194] Registered new tserver with Master: e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:18.168284  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01826972s
I20260709 12:19:18.170004  2709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40950
I20260709 12:19:18.235028  2709 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40958:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:18.240190  2709 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:18.348402  2951 tablet_service.cc:1511] Processing CreateTablet for tablet 53935279e2fa4b23b607548b55439946 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.348498  2950 tablet_service.cc:1511] Processing CreateTablet for tablet fd0e833ad4cc42749cae4e1025a34e91 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.351338  2951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53935279e2fa4b23b607548b55439946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.355576  2950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0e833ad4cc42749cae4e1025a34e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.354874  2948 tablet_service.cc:1511] Processing CreateTablet for tablet 41c5ec4c77164510a213f6d5511b91b3 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:18.352455  2949 tablet_service.cc:1511] Processing CreateTablet for tablet 798ee51672da4e82bc936c7514431d4e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.357885  2947 tablet_service.cc:1511] Processing CreateTablet for tablet f0d71f1150674c99aa96bd950206f83e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.360167  2949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798ee51672da4e82bc936c7514431d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.363081  2947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d71f1150674c99aa96bd950206f83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.364511  2948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c5ec4c77164510a213f6d5511b91b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.369913  2877 tablet_service.cc:1511] Processing CreateTablet for tablet 53935279e2fa4b23b607548b55439946 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.375542  2877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53935279e2fa4b23b607548b55439946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.390592  2946 tablet_service.cc:1511] Processing CreateTablet for tablet b08137ac3f47435f8726e42673b6bfc7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.389225  2876 tablet_service.cc:1511] Processing CreateTablet for tablet fd0e833ad4cc42749cae4e1025a34e91 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.385316  2875 tablet_service.cc:1511] Processing CreateTablet for tablet 798ee51672da4e82bc936c7514431d4e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.389344  2873 tablet_service.cc:1511] Processing CreateTablet for tablet f0d71f1150674c99aa96bd950206f83e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.395694  2946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08137ac3f47435f8726e42673b6bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.395680  2875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798ee51672da4e82bc936c7514431d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.389233  2872 tablet_service.cc:1511] Processing CreateTablet for tablet b08137ac3f47435f8726e42673b6bfc7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.379416  2874 tablet_service.cc:1511] Processing CreateTablet for tablet 41c5ec4c77164510a213f6d5511b91b3 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 12:19:18.400154  2756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:18.402665  2872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08137ac3f47435f8726e42673b6bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.404657  2871 tablet_service.cc:1511] Processing CreateTablet for tablet e3814a22dec347edbaa470674d932c77 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.408239  2876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0e833ad4cc42749cae4e1025a34e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.415817  2871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3814a22dec347edbaa470674d932c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.421015  2874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c5ec4c77164510a213f6d5511b91b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.427605  2873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d71f1150674c99aa96bd950206f83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.433704  2870 tablet_service.cc:1511] Processing CreateTablet for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.435895  2870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.441363  2945 tablet_service.cc:1511] Processing CreateTablet for tablet e3814a22dec347edbaa470674d932c77 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.447316  2945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3814a22dec347edbaa470674d932c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.459498  2944 tablet_service.cc:1511] Processing CreateTablet for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.461194  2944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.495991  2802 tablet_service.cc:1511] Processing CreateTablet for tablet 53935279e2fa4b23b607548b55439946 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:19:18.508858  2802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53935279e2fa4b23b607548b55439946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.524794  2797 tablet_service.cc:1511] Processing CreateTablet for tablet b08137ac3f47435f8726e42673b6bfc7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:19:18.526176  2795 tablet_service.cc:1511] Processing CreateTablet for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:19:18.513583  2799 tablet_service.cc:1511] Processing CreateTablet for tablet 41c5ec4c77164510a213f6d5511b91b3 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:19:18.524878  2796 tablet_service.cc:1511] Processing CreateTablet for tablet e3814a22dec347edbaa470674d932c77 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:19:18.545651  2801 tablet_service.cc:1511] Processing CreateTablet for tablet fd0e833ad4cc42749cae4e1025a34e91 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:19:18.549041  2795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bd4203df9c4fe4adc4d1c7b1f264e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.551628  2869 tablet_service.cc:1511] Processing CreateTablet for tablet 92bdb0e5528a47b2a173dc9271301ae7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.553295  2797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08137ac3f47435f8726e42673b6bfc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.541893  2800 tablet_service.cc:1511] Processing CreateTablet for tablet 798ee51672da4e82bc936c7514431d4e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:19:18.541831  2794 tablet_service.cc:1511] Processing CreateTablet for tablet 92bdb0e5528a47b2a173dc9271301ae7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.543654  2798 tablet_service.cc:1511] Processing CreateTablet for tablet f0d71f1150674c99aa96bd950206f83e (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:19:18.559428  2869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bdb0e5528a47b2a173dc9271301ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.564159  2946 tablet_service.cc:1511] Processing CreateTablet for tablet 92bdb0e5528a47b2a173dc9271301ae7 (DEFAULT_TABLE table=test-workload [id=a1fa3f13c3944a14882869b728bd1810]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:19:18.566395  2946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bdb0e5528a47b2a173dc9271301ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.568339  2799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c5ec4c77164510a213f6d5511b91b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.575870  3004 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:18.580353  2801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0e833ad4cc42749cae4e1025a34e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.585279  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3814a22dec347edbaa470674d932c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.588562  2794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bdb0e5528a47b2a173dc9271301ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.593977  2800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798ee51672da4e82bc936c7514431d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.601361  2798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d71f1150674c99aa96bd950206f83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:18.654099  3005 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:18.723013  3004 tablet_bootstrap.cc:654] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.728137  3005 tablet_bootstrap.cc:654] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.732931  3006 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:18.751521  3005 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:18.752094  3005 ts_tablet_manager.cc:1403] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.099s	user 0.023s	sys 0.003s
I20260709 12:19:18.753801  3006 tablet_bootstrap.cc:654] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.756515  3005 raft_consensus.cc:359] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.757793  3005 raft_consensus.cc:385] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.758134  3005 raft_consensus.cc:740] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.758937  3005 consensus_queue.cc:260] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.764513  2912 heartbeater.cc:499] Master 127.2.157.126:40493 was elected leader, sending a full tablet report...
I20260709 12:19:18.766112  2837 heartbeater.cc:499] Master 127.2.157.126:40493 was elected leader, sending a full tablet report...
I20260709 12:19:18.768620  3005 ts_tablet_manager.cc:1434] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.008s
I20260709 12:19:18.769717  3005 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:18.781782  3004 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:18.782377  3004 ts_tablet_manager.cc:1403] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.209s	user 0.013s	sys 0.007s
I20260709 12:19:18.783210  3005 tablet_bootstrap.cc:654] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.787806  3006 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:18.788326  3006 ts_tablet_manager.cc:1403] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.000s
I20260709 12:19:18.790664  3004 raft_consensus.cc:359] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.791569  3004 raft_consensus.cc:385] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.791883  3004 raft_consensus.cc:740] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.792680  3004 consensus_queue.cc:260] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.796993  3006 raft_consensus.cc:359] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.797837  3006 raft_consensus.cc:385] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.798209  3006 raft_consensus.cc:740] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.799012  3006 consensus_queue.cc:260] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.802246  3004 ts_tablet_manager.cc:1434] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:19:18.803057  2986 heartbeater.cc:499] Master 127.2.157.126:40493 was elected leader, sending a full tablet report...
I20260709 12:19:18.803347  3004 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:18.810690  3006 ts_tablet_manager.cc:1434] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 12:19:18.816365  3006 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:18.823566  3006 tablet_bootstrap.cc:654] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.823657  3005 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:18.824206  3005 ts_tablet_manager.cc:1403] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.018s
I20260709 12:19:18.824482  3004 tablet_bootstrap.cc:654] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:18.827347  3005 raft_consensus.cc:359] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:18.828131  3005 raft_consensus.cc:385] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.828442  3005 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.829198  3005 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:18.834511  3013 raft_consensus.cc:493] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.835163  3013 raft_consensus.cc:515] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.838430  3013 leader_election.cc:290] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:18.841970  3005 ts_tablet_manager.cc:1434] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:19:18.854127  3012 raft_consensus.cc:493] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.854869  3012 raft_consensus.cc:515] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
W20260709 12:19:18.902937  2987 tablet.cc:2406] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:18.943240  3005 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:18.946108  3012 leader_election.cc:290] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:18.955026  3004 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:18.956607  3004 ts_tablet_manager.cc:1403] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.010s
I20260709 12:19:18.961596  3004 raft_consensus.cc:359] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.962267  3004 raft_consensus.cc:385] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:18.962581  3004 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:18.963371  3004 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.974123  3006 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:18.974700  3006 ts_tablet_manager.cc:1403] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.163s	user 0.039s	sys 0.096s
I20260709 12:19:18.979372  3012 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.979935  3012 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:18.982028  3012 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:18.989353  3004 ts_tablet_manager.cc:1434] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:19:18.990739  3004 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.012864  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
W20260709 12:19:19.016340  2778 leader_election.cc:343] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.022013  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.024202  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
W20260709 12:19:19.027177  2926 leader_election.cc:343] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:19.029404  2926 leader_election.cc:343] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.040957  3005 tablet_bootstrap.cc:654] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.041349  3006 raft_consensus.cc:359] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.042119  3006 raft_consensus.cc:385] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.042666  3009 raft_consensus.cc:493] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.042863  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.043181  3009 raft_consensus.cc:515] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
W20260709 12:19:19.044781  2777 leader_election.cc:343] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.045305  2777 leader_election.cc:304] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15; no voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.046139  3009 leader_election.cc:290] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.046665  3006 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.046731  3013 raft_consensus.cc:2749] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.047706  3006 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.050850  3006 ts_tablet_manager.cc:1434] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.076s	user 0.025s	sys 0.041s
I20260709 12:19:19.052239  3006 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.059754  3006 tablet_bootstrap.cc:654] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.062455  3004 tablet_bootstrap.cc:654] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.071835  3006 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.071823  3005 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.072365  3006 ts_tablet_manager.cc:1403] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.016s
I20260709 12:19:19.072937  3005 ts_tablet_manager.cc:1403] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.130s	user 0.036s	sys 0.029s
I20260709 12:19:19.084197  3006 raft_consensus.cc:359] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.085026  3006 raft_consensus.cc:385] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.082448  3005 raft_consensus.cc:359] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.085777  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.085953  3006 raft_consensus.cc:740] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.086464  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.088097  3006 consensus_queue.cc:260] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.086984  3005 raft_consensus.cc:385] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:19:19.089104  2926 leader_election.cc:343] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.089262  3005 raft_consensus.cc:740] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.090983  3004 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.091552  3005 consensus_queue.cc:260] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.092451  3004 ts_tablet_manager.cc:1403] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.009s
I20260709 12:19:19.089661  2926 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:19.092626  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
W20260709 12:19:19.094302  2926 leader_election.cc:343] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.094760  2926 leader_election.cc:304] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:19.095750  3012 raft_consensus.cc:2749] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.096462  3012 raft_consensus.cc:2749] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.096732  3006 ts_tablet_manager.cc:1434] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.006s
I20260709 12:19:19.098060  3006 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
W20260709 12:19:19.095750  2852 leader_election.cc:343] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.100589  3005 ts_tablet_manager.cc:1434] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:19:19.101537  3005 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.105073  3004 raft_consensus.cc:359] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.105798  3004 raft_consensus.cc:385] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.106072  3004 raft_consensus.cc:740] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.116888  3006 tablet_bootstrap.cc:654] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.114262  3005 tablet_bootstrap.cc:654] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.106745  3004 consensus_queue.cc:260] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.119549  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.121043  3004 ts_tablet_manager.cc:1434] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 12:19:19.121537  2853 leader_election.cc:343] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.122180  3004 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.122356  2853 leader_election.cc:304] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142; no voters: 620b99ab8ada48d4a2b355358d59bf15, e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.127789  3009 raft_consensus.cc:2749] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.139969  3006 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.140219  3005 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.140655  3006 ts_tablet_manager.cc:1403] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.023s
I20260709 12:19:19.140664  3005 ts_tablet_manager.cc:1403] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.003s
I20260709 12:19:19.141258  3013 raft_consensus.cc:493] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.141748  3013 raft_consensus.cc:515] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.143826  3013 leader_election.cc:290] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.144402  3006 raft_consensus.cc:359] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.145020  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.145220  3006 raft_consensus.cc:385] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.145686  3006 raft_consensus.cc:740] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.146726  3004 tablet_bootstrap.cc:654] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.146778  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.146546  3006 consensus_queue.cc:260] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
W20260709 12:19:19.148406  2778 leader_election.cc:343] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.149174  3006 ts_tablet_manager.cc:1434] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:19:19.149530  2777 leader_election.cc:343] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.149989  2777 leader_election.cc:304] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15; no voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.150255  3006 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.150774  3013 raft_consensus.cc:2749] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.152462  3005 raft_consensus.cc:359] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.153375  3005 raft_consensus.cc:385] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.153860  3005 raft_consensus.cc:740] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.154985  3005 consensus_queue.cc:260] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.157871  3005 ts_tablet_manager.cc:1434] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:19:19.157994  3006 tablet_bootstrap.cc:654] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.159215  3005 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.166710  3005 tablet_bootstrap.cc:654] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.177755  3005 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.178293  3005 ts_tablet_manager.cc:1403] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 12:19:19.178632  3004 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.179114  3004 ts_tablet_manager.cc:1403] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.008s
I20260709 12:19:19.181250  3005 raft_consensus.cc:359] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.181834  3005 raft_consensus.cc:385] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.182080  3005 raft_consensus.cc:740] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.182201  3004 raft_consensus.cc:359] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.182699  3005 consensus_queue.cc:260] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.183184  3004 raft_consensus.cc:385] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.184986  3005 ts_tablet_manager.cc:1434] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:19.186079  3006 tablet_bootstrap.cc:492] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.186137  3005 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.186720  3006 ts_tablet_manager.cc:1403] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.003s
I20260709 12:19:19.190225  3006 raft_consensus.cc:359] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.191481  3006 raft_consensus.cc:385] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.191987  3006 raft_consensus.cc:740] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.193045  3006 consensus_queue.cc:260] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.194160  3005 tablet_bootstrap.cc:654] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.196512  3006 ts_tablet_manager.cc:1434] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:19:19.197904  3009 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.183562  3004 raft_consensus.cc:740] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.198614  3009 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.199337  3004 consensus_queue.cc:260] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.201560  3009 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737), 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:19.202348  3006 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.204005  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.205020  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
W20260709 12:19:19.205649  2853 leader_election.cc:343] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.205824  2811 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.208334  2852 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.209255  3009 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.209782  3009 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.210158  3009 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.213152  3005 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.214298  3004 ts_tablet_manager.cc:1434] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:19:19.214429  3005 ts_tablet_manager.cc:1403] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.006s
I20260709 12:19:19.218042  3009 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.220369  3009 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737), 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:19.215507  3004 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.221202  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.222596  3005 raft_consensus.cc:359] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.223328  3005 raft_consensus.cc:385] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.223662  3005 raft_consensus.cc:740] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.224568  3005 consensus_queue.cc:260] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
W20260709 12:19:19.226104  2853 leader_election.cc:343] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.227329  3005 ts_tablet_manager.cc:1434] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:19.221735  3006 tablet_bootstrap.cc:654] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.221449  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.228256  2811 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.228350  3005 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.231321  3027 raft_consensus.cc:493] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.231922  3027 raft_consensus.cc:515] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.234426  3027 leader_election.cc:290] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:19.235838  3004 tablet_bootstrap.cc:654] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.236272  2811 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.235831  3005 tablet_bootstrap.cc:654] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.237735  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.238258  2852 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.238440  2887 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 0.
I20260709 12:19:19.239085  3009 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.240598  2926 leader_election.cc:304] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.236359  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
W20260709 12:19:19.248219  2926 leader_election.cc:343] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.249802  3027 raft_consensus.cc:2804] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.250506  3027 raft_consensus.cc:493] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.251067  3027 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.254508  3006 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.255133  3006 ts_tablet_manager.cc:1403] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.014s
I20260709 12:19:19.258795  3006 raft_consensus.cc:359] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.259739  3006 raft_consensus.cc:385] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.261003  3006 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.262305  3006 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.265820  3005 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.266914  3006 ts_tablet_manager.cc:1434] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:19:19.267968  3009 raft_consensus.cc:697] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.269910  3006 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.268807  3027 raft_consensus.cc:515] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.269954  3009 consensus_queue.cc:237] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.274348  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.268661  3005 ts_tablet_manager.cc:1403] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.003s
W20260709 12:19:19.276643  2926 leader_election.cc:343] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.279109  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:19.279788  2887 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.278791  3005 raft_consensus.cc:359] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.280259  3005 raft_consensus.cc:385] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.280689  3005 raft_consensus.cc:740] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.281546  3005 consensus_queue.cc:260] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.282999  3004 tablet_bootstrap.cc:492] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.284698  3004 ts_tablet_manager.cc:1403] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.011s
I20260709 12:19:19.286470  3005 ts_tablet_manager.cc:1434] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:19:19.287739  3005 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.288424  3004 raft_consensus.cc:359] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.291728  3004 raft_consensus.cc:385] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.292083  3004 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.292981  3004 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.295400  3004 ts_tablet_manager.cc:1434] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:19:19.290429  3006 tablet_bootstrap.cc:654] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.299366  3004 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.306849  3004 tablet_bootstrap.cc:654] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.308584  3027 leader_election.cc:290] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:19.311661  2887 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 1.
I20260709 12:19:19.314002  2926 leader_election.cc:304] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:19.315546  3027 raft_consensus.cc:2804] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.316176  3027 raft_consensus.cc:697] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:19.314420  3005 tablet_bootstrap.cc:654] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.317108  3027 consensus_queue.cc:237] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.318462  3006 tablet_bootstrap.cc:492] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.318977  3006 ts_tablet_manager.cc:1403] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.006s
I20260709 12:19:19.322566  3006 raft_consensus.cc:359] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.323343  3006 raft_consensus.cc:385] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.323678  3006 raft_consensus.cc:740] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.324658  3006 consensus_queue.cc:260] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.327879  3006 ts_tablet_manager.cc:1434] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:19:19.329205  3006 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.330214  3005 tablet_bootstrap.cc:492] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.332172  3005 ts_tablet_manager.cc:1403] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
I20260709 12:19:19.335606  3005 raft_consensus.cc:359] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.336639  3006 tablet_bootstrap.cc:654] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.338238  3004 tablet_bootstrap.cc:492] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.343091  3004 ts_tablet_manager.cc:1403] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.008s
I20260709 12:19:19.342939  2705 catalog_manager.cc:5697] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.346262  3004 raft_consensus.cc:359] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.347937  3004 raft_consensus.cc:385] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.346091  2707 catalog_manager.cc:5697] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 0 to 1, leader changed from <none> to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 1 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.348277  3004 raft_consensus.cc:740] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.347012  3005 raft_consensus.cc:385] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.348831  3005 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.349104  3004 consensus_queue.cc:260] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.350664  3005 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.351750  3004 ts_tablet_manager.cc:1434] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:19.352880  3004 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.353549  3006 tablet_bootstrap.cc:492] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.354084  3006 ts_tablet_manager.cc:1403] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:19:19.356951  3009 raft_consensus.cc:493] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.357342  3005 ts_tablet_manager.cc:1434] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:19:19.357633  3009 raft_consensus.cc:515] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.358774  3005 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: Bootstrap starting.
I20260709 12:19:19.361421  3009 leader_election.cc:290] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.362042  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.362871  2812 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.362866  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.363781  2961 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.364656  2852 leader_election.cc:304] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.365698  3009 raft_consensus.cc:2804] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.366138  3009 raft_consensus.cc:493] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.366514  3009 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.367827  3006 raft_consensus.cc:359] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.368616  3006 raft_consensus.cc:385] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.368942  3006 raft_consensus.cc:740] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.369944  3006 consensus_queue.cc:260] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.371219  3004 tablet_bootstrap.cc:654] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.372643  3006 ts_tablet_manager.cc:1434] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:19:19.373818  3006 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: Bootstrap starting.
I20260709 12:19:19.376910  3005 tablet_bootstrap.cc:654] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.382179  3036 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.383843  3006 tablet_bootstrap.cc:654] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.382814  3036 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.384902  3009 raft_consensus.cc:515] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.393524  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.394083  3009 leader_election.cc:290] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.394276  2812 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.395386  3036 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.395852  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.396574  2852 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.396930  2961 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.398137  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.400705  2812 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.403927  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.408541  2960 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.401337  3036 raft_consensus.cc:2804] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:19.416963  2756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:19.412982  3036 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.417879  3036 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.419592  2812 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.421139  3004 tablet_bootstrap.cc:492] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.420953  2852 leader_election.cc:304] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.421840  3009 raft_consensus.cc:2804] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.422174  3004 ts_tablet_manager.cc:1403] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.020s
I20260709 12:19:19.424829  3005 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: No bootstrap required, opened a new log
I20260709 12:19:19.425815  3005 ts_tablet_manager.cc:1403] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.000s
I20260709 12:19:19.425580  3004 raft_consensus.cc:359] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.427465  3004 raft_consensus.cc:385] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.427852  3004 raft_consensus.cc:740] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.428668  3004 consensus_queue.cc:260] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.429131  3005 raft_consensus.cc:359] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.429816  3009 raft_consensus.cc:697] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.430742  3009 consensus_queue.cc:237] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.431317  3004 ts_tablet_manager.cc:1434] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:19.432338  3004 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.433421  2961 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.435029  3005 raft_consensus.cc:385] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.435403  3005 raft_consensus.cc:740] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.436316  3005 consensus_queue.cc:260] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.438602  3005 ts_tablet_manager.cc:1434] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:19:19.439859  3004 tablet_bootstrap.cc:654] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.441764  3050 raft_consensus.cc:493] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.442065  3036 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.443769  3050 raft_consensus.cc:515] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.448030  3050 leader_election.cc:290] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.449366  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.449756  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.450377  2811 raft_consensus.cc:2468] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
W20260709 12:19:19.453262  2853 leader_election.cc:343] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.456969  3006 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: No bootstrap required, opened a new log
I20260709 12:19:19.457469  3006 ts_tablet_manager.cc:1403] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.002s
I20260709 12:19:19.455134  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.460842  3013 raft_consensus.cc:493] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.460948  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.461653  2852 leader_election.cc:304] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.462625  2961 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.462527  3013 raft_consensus.cc:515] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.464310  3006 raft_consensus.cc:359] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.464982  3006 raft_consensus.cc:385] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.465487  3006 raft_consensus.cc:740] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.459437  3036 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.466055  2812 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.467388  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.469117  2887 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 0.
I20260709 12:19:19.467823  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.470403  2777 leader_election.cc:304] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.470618  2960 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 0.
I20260709 12:19:19.464948  3013 leader_election.cc:290] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.467527  3036 raft_consensus.cc:2804] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.473007  3006 consensus_queue.cc:260] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.475787  3036 raft_consensus.cc:493] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.474982  3013 raft_consensus.cc:2804] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.478101  3013 raft_consensus.cc:493] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.478613  3013 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.480608  3006 ts_tablet_manager.cc:1434] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:19:19.481935  3004 tablet_bootstrap.cc:492] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.482416  3004 ts_tablet_manager.cc:1403] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.000s
I20260709 12:19:19.476305  3036 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.493255  2961 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.493502  2812 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.494478  2853 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.495357  3009 raft_consensus.cc:2804] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.495940  3009 raft_consensus.cc:697] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.496881  3009 consensus_queue.cc:237] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.503638  3050 raft_consensus.cc:493] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.504528  3050 raft_consensus.cc:515] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.507371  3050 leader_election.cc:290] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.499481  3036 raft_consensus.cc:515] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.510046  3050 raft_consensus.cc:493] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.513025  3036 leader_election.cc:290] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.512089  3050 raft_consensus.cc:515] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.512848  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.514142  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.514770  2961 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.515903  3050 leader_election.cc:290] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.516040  2853 leader_election.cc:304] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.516889  3050 raft_consensus.cc:2804] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.517320  3050 raft_consensus.cc:493] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.517711  3050 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.524070  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.524823  2812 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.527225  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.527253  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.528352  2812 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:19.528713  2853 leader_election.cc:343] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.529436  3004 raft_consensus.cc:359] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.530112  3004 raft_consensus.cc:385] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.530395  3004 raft_consensus.cc:740] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.531994  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.531847  3004 consensus_queue.cc:260] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.532590  2811 raft_consensus.cc:2468] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.532696  2960 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.537909  2960 raft_consensus.cc:2468] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.539976  2852 leader_election.cc:304] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.541683  2853 leader_election.cc:304] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.541852  3057 raft_consensus.cc:2804] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.542513  3057 raft_consensus.cc:493] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.542824  3056 raft_consensus.cc:2804] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.543398  3056 raft_consensus.cc:697] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.542580  3013 raft_consensus.cc:515] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.552153  3013 leader_election.cc:290] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.553750  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:19.554391  2887 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.555414  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.556190  2960 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.544349  3056 consensus_queue.cc:237] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.561540  2887 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 1.
I20260709 12:19:19.562796  3009 raft_consensus.cc:493] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.563345  2777 leader_election.cc:304] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.563426  3009 raft_consensus.cc:515] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.544937  3050 raft_consensus.cc:515] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.546528  2812 raft_consensus.cc:2468] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.548753  3004 ts_tablet_manager.cc:1434] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.003s
I20260709 12:19:19.565547  3004 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: Bootstrap starting.
I20260709 12:19:19.565735  3050 leader_election.cc:290] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.565917  3013 raft_consensus.cc:2804] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.566556  3013 raft_consensus.cc:697] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:19.563766  2960 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 1.
I20260709 12:19:19.543133  3057 raft_consensus.cc:3060] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.568104  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.567369  3013 consensus_queue.cc:237] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.568624  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.565735  3009 leader_election.cc:290] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.569844  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.571319  2961 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.570919  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.573727  2812 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.574110  2811 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 0.
I20260709 12:19:19.577906  3004 tablet_bootstrap.cc:654] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:19.573719  2959 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.583387  2853 leader_election.cc:304] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.588570  3009 raft_consensus.cc:2804] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:19.588994  3009 raft_consensus.cc:493] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.589359  3009 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.591012  2812 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.592293  2852 leader_election.cc:304] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.594336  3050 raft_consensus.cc:2804] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.595531  3050 raft_consensus.cc:697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.596355  3050 consensus_queue.cc:237] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.599483  2707 catalog_manager.cc:5697] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.601913  2707 catalog_manager.cc:5697] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.604516  3009 raft_consensus.cc:515] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.623256  2708 catalog_manager.cc:5697] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.626555  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.626852  3009 leader_election.cc:290] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.627213  2812 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.629127  3057 raft_consensus.cc:515] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.629452  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.630193  2961 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.631654  3057 leader_election.cc:290] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.626101  2959 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.632910  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.635288  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:19.635967  2811 raft_consensus.cc:3060] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.637624  2812 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.640309  2961 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.642793  2852 leader_election.cc:304] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
W20260709 12:19:19.643011  2853 leader_election.cc:343] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:19.643898  3057 raft_consensus.cc:2804] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.644392  3057 raft_consensus.cc:697] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.644603  3004 tablet_bootstrap.cc:492] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: No bootstrap required, opened a new log
I20260709 12:19:19.645287  3004 ts_tablet_manager.cc:1403] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.022s
I20260709 12:19:19.645277  3057 consensus_queue.cc:237] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.649317  3004 raft_consensus.cc:359] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.650118  3004 raft_consensus.cc:385] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:19.650421  3004 raft_consensus.cc:740] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Initialized, Role: FOLLOWER
I20260709 12:19:19.651330  3004 consensus_queue.cc:260] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.651612  2707 catalog_manager.cc:5697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.653743  3004 ts_tablet_manager.cc:1434] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:19:19.653791  2707 catalog_manager.cc:5697] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.652220  2811 raft_consensus.cc:2468] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 1.
I20260709 12:19:19.660364  2852 leader_election.cc:304] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.661746  3009 raft_consensus.cc:2804] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:19.662328  3009 raft_consensus.cc:697] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.663245  3009 consensus_queue.cc:237] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.686009  2707 catalog_manager.cc:5697] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.688195  2707 catalog_manager.cc:5697] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.734781  3027 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.735308  3027 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.737258  3027 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:19.738700  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.738629  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.739807  2811 raft_consensus.cc:2393] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1c69b9803be4c71b38b9cc8c8a89b2a in current term 1: Already voted for candidate a8121be36ee14ab3960ca416d5b47142 in this term.
I20260709 12:19:19.741072  2926 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:19.741930  3027 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.746784  3027 raft_consensus.cc:2749] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.770903  3009 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.799808  2811 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.798038  3057 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:19.814852  2887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:46376
I20260709 12:19:19.815620  2887 raft_consensus.cc:606] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:19.828915  3013 raft_consensus.cc:493] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.829443  3013 raft_consensus.cc:515] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.830067  3027 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.833493  3013 leader_election.cc:290] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.834820  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" is_pre_election: true
I20260709 12:19:19.834878  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.836222  2887 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 1.
I20260709 12:19:19.838035  2777 leader_election.cc:304] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.838925  3013 raft_consensus.cc:2804] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:19.839339  3013 raft_consensus.cc:493] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.839774  3013 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.842429  3057 consensus_queue.cc:1048] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.846794  3013 raft_consensus.cc:515] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.849608  2811 raft_consensus.cc:1240] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Rejecting Update request from peer e1c69b9803be4c71b38b9cc8c8a89b2a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:19:19.849852  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:19.850428  2886 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.856598  3027 consensus_queue.cc:1059] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.859822  3056 raft_consensus.cc:993] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:19.860517  3056 raft_consensus.cc:1081] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:19.864035  2960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:45048
I20260709 12:19:19.864146  2811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:35668
I20260709 12:19:19.864670  2960 raft_consensus.cc:606] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:19.864852  2811 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.865429  2811 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.865516  3075 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.874682  3027 raft_consensus.cc:3055] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.875192  3027 raft_consensus.cc:740] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:19.876578  3027 consensus_queue.cc:260] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.878489  2811 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.881963  2811 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.883293  2886 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:19.889870  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:46376
I20260709 12:19:19.890573  2885 raft_consensus.cc:606] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:19.890647  3057 consensus_queue.cc:1048] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.885325  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:19.891247  2777 leader_election.cc:304] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:19.894732  3055 raft_consensus.cc:2804] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:19.883244  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.897231  2961 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.899895  3027 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.891502  3013 leader_election.cc:290] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:19.892861  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:19.892171  2887 raft_consensus.cc:3055] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:19.903059  2887 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:19.904004  2887 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.905478  2887 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.908160  2961 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:19.911860  2778 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:19.912823  3013 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:19.913331  3013 raft_consensus.cc:697] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:19.914156  3013 consensus_queue.cc:237] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:19.916627  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:46376
I20260709 12:19:19.917275  2885 raft_consensus.cc:606] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:19.920327  2960 raft_consensus.cc:2410] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 620b99ab8ada48d4a2b355358d59bf15 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:19:19.924288  2887 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:19.926883  3055 raft_consensus.cc:697] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:19.927891  3055 consensus_queue.cc:237] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.943411  2708 catalog_manager.cc:5697] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 1 to 2, leader changed from e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:19.958125  2708 catalog_manager.cc:5697] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:19.962293  3057 consensus_queue.cc:1048] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:19.964483  3027 raft_consensus.cc:493] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.965022  3027 raft_consensus.cc:515] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.967072  3027 leader_election.cc:290] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:19.969679  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8121be36ee14ab3960ca416d5b47142" is_pre_election: true
I20260709 12:19:19.970155  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d71f1150674c99aa96bd950206f83e" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "620b99ab8ada48d4a2b355358d59bf15" is_pre_election: true
I20260709 12:19:19.970981  2811 raft_consensus.cc:2393] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1c69b9803be4c71b38b9cc8c8a89b2a in current term 1: Already voted for candidate a8121be36ee14ab3960ca416d5b47142 in this term.
I20260709 12:19:19.972384  2926 leader_election.cc:304] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:19.974274  3027 raft_consensus.cc:3060] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:19.978835  3009 raft_consensus.cc:993] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:19.979363  3036 raft_consensus.cc:1081] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:19.981688  2959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:47458
I20260709 12:19:19.982313  2959 raft_consensus.cc:493] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.982802  2959 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:19.984064  3027 raft_consensus.cc:2749] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:19.989594  3056 consensus_queue.cc:1048] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:19.990871  2959 raft_consensus.cc:515] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:19.997361  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:20.000658  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bdb0e5528a47b2a173dc9271301ae7" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:20.001341  2887 raft_consensus.cc:3055] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.001693  2887 raft_consensus.cc:740] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:20.003109  2887 consensus_queue.cc:260] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:20.004247  2887 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.005132  2959 leader_election.cc:290] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 2 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:20.006194  3056 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.012027  2887 raft_consensus.cc:2468] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 2.
I20260709 12:19:20.013315  2926 leader_election.cc:304] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:20.014560  3027 raft_consensus.cc:2804] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.015092  3027 raft_consensus.cc:697] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:20.015949  3027 consensus_queue.cc:237] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:20.019603  3056 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.026113  3056 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.025542  2708 catalog_manager.cc:5697] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 2 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:20.036346  3055 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.042742  3056 raft_consensus.cc:993] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:20.043296  3056 raft_consensus.cc:1081] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:20.049916  2810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:35668
I20260709 12:19:20.050781  2810 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:20.051936  2810 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.057375  3056 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.059676  2810 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:20.063593  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:20.065407  2810 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:20.067639  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:20.068276  2887 raft_consensus.cc:3055] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:20.068608  2887 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:20.069947  2887 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:20.071383  2887 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.085362  3077 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.096686  2887 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:20.102247  2777 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:20.103242  3077 raft_consensus.cc:2804] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:20.103761  3077 raft_consensus.cc:697] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:20.104602  3077 consensus_queue.cc:237] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:20.114243  2707 catalog_manager.cc:5697] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:20.235136  3056 consensus_queue.cc:1048] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.251828  3009 consensus_queue.cc:1048] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.252880  3057 consensus_queue.cc:1048] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.253546  3009 consensus_queue.cc:1048] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.387724  2887 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.387849  2885 raft_consensus.cc:1275] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:20.389711  3077 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.390179  3013 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.405372  2959 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.407341  2961 raft_consensus.cc:1275] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:19:20.407922  2961 pending_rounds.cc:85] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Aborting all ops after (but not including) 0
I20260709 12:19:20.408241  2961 pending_rounds.cc:107] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:19:20.408506  2961 raft_consensus.cc:2889] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:20.411041  3077 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:20.441996  3077 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:20.493229  2887 raft_consensus.cc:1275] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.495151  3027 consensus_queue.cc:1048] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.496163  2959 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.505867  2959 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.507323  3077 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:20.509796  2812 raft_consensus.cc:3060] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:20.516919  2885 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.518724  3077 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:20.530308  2812 raft_consensus.cc:1275] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:20.533267  3094 consensus_queue.cc:1048] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:22.949002  2677 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:19:22.949856  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.974721  2812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
mode: GRACEFUL
new_leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:34838
I20260709 12:19:22.975407  2812 raft_consensus.cc:606] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Received request to transfer leadership to TS e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:22.986701  2887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:22.987330  2887 raft_consensus.cc:606] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:22.988854  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:22.989457  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:23.099354  3013 raft_consensus.cc:993] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: : Instructing follower e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:23.099879  3100 raft_consensus.cc:1081] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Signalling peer e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:23.101629  2959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:47450
I20260709 12:19:23.102187  2959 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.102481  2959 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.107339  2959 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:23.109347  2959 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 3 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:23.110185  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:23.110517  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:23.110864  2887 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.111126  2812 raft_consensus.cc:3055] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:23.111516  2812 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:23.112442  2812 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:23.113847  2812 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:23.118736  2887 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 3.
I20260709 12:19:23.120297  2926 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:23.121239  3094 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:23.121483  2812 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 3.
I20260709 12:19:23.122574  3094 raft_consensus.cc:697] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:23.123504  3094 consensus_queue.cc:237] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:23.131156  2708 catalog_manager.cc:5697] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 2 to 3, leader changed from 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65) to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.420122  3107 raft_consensus.cc:993] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:23.420600  3009 raft_consensus.cc:1081] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:23.422263  2961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:47458
I20260709 12:19:23.422729  2961 raft_consensus.cc:493] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.422984  2961 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.427393  2961 raft_consensus.cc:515] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:23.429255  2961 leader_election.cc:290] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 2 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:23.429976  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:23.430275  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:23.430552  2812 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.430859  2887 raft_consensus.cc:3055] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:23.431224  2887 raft_consensus.cc:740] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:23.432081  2887 consensus_queue.cc:260] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:23.432957  2887 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:23.435513  2812 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 2.
I20260709 12:19:23.436609  2926 leader_election.cc:304] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:23.437404  3094 raft_consensus.cc:2804] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:23.437822  2887 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 2.
I20260709 12:19:23.437824  3094 raft_consensus.cc:697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:23.438864  3094 consensus_queue.cc:237] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:23.448616  2708 catalog_manager.cc:5697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 2 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:23.637012  2887 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:23.638549  3094 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:23.651003  2812 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:23.652506  3101 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:23.969877  2812 raft_consensus.cc:1275] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.971415  3094 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:23.989049  2887 raft_consensus.cc:1275] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:23.991952  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.992654  3094 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:24.001158  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:24.001782  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.002916  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.009397  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:25.009913  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.011329  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.023137  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:26.023656  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.024911  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.031131  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:27.031682  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:28.032735  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:28.038672  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:28.039175  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:29.040246  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.047209  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:29.047745  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.048804  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.054200  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:30.054697  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.055907  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.061813  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:31.062269  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:32.063185  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.067946  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:32.068404  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.100014  2677 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:19:33.105350  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
mode: GRACEFUL
new_leader_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:45048
I20260709 12:19:33.105988  2959 raft_consensus.cc:606] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Received request to transfer leadership to TS a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:33.121953  2812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
mode: GRACEFUL
new_leader_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:52594
I20260709 12:19:33.122404  2812 raft_consensus.cc:606] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Received request to transfer leadership to TS a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:33.128069  2812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
mode: GRACEFUL
new_leader_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:52594
I20260709 12:19:33.128516  2812 raft_consensus.cc:606] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 LEADER]: Received request to transfer leadership to TS a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:33.133939  2812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
mode: GRACEFUL
new_leader_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:52594
I20260709 12:19:33.134594  2812 raft_consensus.cc:606] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Received request to transfer leadership to TS a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:33.147912  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
mode: GRACEFUL
new_leader_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:45048
I20260709 12:19:33.148373  2959 raft_consensus.cc:606] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Received request to transfer leadership to TS a8121be36ee14ab3960ca416d5b47142
I20260709 12:19:33.170507  3118 raft_consensus.cc:993] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: : Instructing follower a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.170953  3118 raft_consensus.cc:1081] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 LEADER]: Signalling peer a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.172784  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:36316
I20260709 12:19:33.173357  2885 raft_consensus.cc:493] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.173743  2885 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.180286  2885 raft_consensus.cc:515] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.182503  2885 leader_election.cc:290] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 2 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:33.183377  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:33.183769  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:33.184239  2959 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.184218  2812 raft_consensus.cc:3055] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:33.184763  2812 raft_consensus.cc:740] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:33.185638  2812 consensus_queue.cc:260] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.186965  2812 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.191308  2959 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 2.
I20260709 12:19:33.193143  2853 leader_election.cc:304] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:33.194212  2812 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 2.
I20260709 12:19:33.194281  3126 raft_consensus.cc:2804] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:33.194813  3126 raft_consensus.cc:697] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:33.195755  3126 consensus_queue.cc:237] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.203236  2707 catalog_manager.cc:5697] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 1 to 2, leader changed from 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65) to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.249707  3129 raft_consensus.cc:993] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: : Instructing follower a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.250188  3118 raft_consensus.cc:1081] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Signalling peer a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.251619  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:36316
I20260709 12:19:33.252068  2885 raft_consensus.cc:493] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.252323  2885 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.256767  2885 raft_consensus.cc:515] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.258500  2885 leader_election.cc:290] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:33.259263  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:33.259666  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0e833ad4cc42749cae4e1025a34e91" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:33.259846  2812 raft_consensus.cc:3055] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.260164  2959 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.260183  2812 raft_consensus.cc:740] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:33.260987  2812 consensus_queue.cc:260] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.261863  2812 raft_consensus.cc:3060] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.264446  2959 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.265426  2853 leader_election.cc:304] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:33.266247  3126 raft_consensus.cc:2804] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.266217  2812 raft_consensus.cc:2468] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.266790  3126 raft_consensus.cc:697] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:33.267732  3126 consensus_queue.cc:237] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.274921  2707 catalog_manager.cc:5697] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 2 to 3, leader changed from 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65) to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.283115  3129 raft_consensus.cc:993] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: : Instructing follower a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.283630  3118 raft_consensus.cc:1081] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Signalling peer a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.284932  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:36316
I20260709 12:19:33.285348  2885 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.285590  2885 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.290372  2885 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.292006  2885 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:33.292936  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:33.293023  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:33.293524  2812 raft_consensus.cc:3055] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.293520  2959 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.293808  2812 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:33.294502  2812 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.295528  2812 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.297838  2959 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.298758  2853 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:33.299499  3126 raft_consensus.cc:2804] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.299921  3126 raft_consensus.cc:697] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:33.300426  2812 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.300731  3126 consensus_queue.cc:237] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.307358  2707 catalog_manager.cc:5697] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 2 to 3, leader changed from 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65) to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.500244  3121 raft_consensus.cc:993] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: : Instructing follower a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.500669  3121 raft_consensus.cc:1081] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Signalling peer a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.502228  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:36324
I20260709 12:19:33.502682  2885 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.502936  2885 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.507404  2885 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:33.510105  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:33.510298  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:33.510499  2885 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 4 election: Requested vote from peers e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737), 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637)
I20260709 12:19:33.510608  2959 raft_consensus.cc:3055] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:33.510905  2812 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.511078  2959 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:33.512004  2959 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:33.513223  2959 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:33.515931  2812 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 4.
I20260709 12:19:33.516911  2852 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:33.517696  3126 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:33.517699  2959 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 4.
I20260709 12:19:33.518386  3126 raft_consensus.cc:697] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:33.519241  3126 consensus_queue.cc:237] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:33.526522  2707 catalog_manager.cc:5697] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 3 to 4, leader changed from e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67) to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 4 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.577790  3137 raft_consensus.cc:993] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: : Instructing follower a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.578400  3121 raft_consensus.cc:1081] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Signalling peer a8121be36ee14ab3960ca416d5b47142 to start an election
I20260709 12:19:33.580061  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
 from {username='slave'} at 127.0.0.1:36324
I20260709 12:19:33.580698  2885 raft_consensus.cc:493] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.581036  2885 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.585845  2885 raft_consensus.cc:515] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.587728  2885 leader_election.cc:290] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:33.588682  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:33.588944  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bd4203df9c4fe4adc4d1c7b1f264e9" candidate_uuid: "a8121be36ee14ab3960ca416d5b47142" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:33.589221  2812 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.589574  2959 raft_consensus.cc:3055] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:33.589876  2959 raft_consensus.cc:740] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:33.590684  2959 consensus_queue.cc:260] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.591626  2959 raft_consensus.cc:3060] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:33.593955  2812 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.595538  2852 leader_election.cc:304] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:33.596352  3126 raft_consensus.cc:2804] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:33.596874  3126 raft_consensus.cc:697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Becoming Leader. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:33.597862  3126 consensus_queue.cc:237] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:33.598374  2959 raft_consensus.cc:2468] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8121be36ee14ab3960ca416d5b47142 in term 3.
I20260709 12:19:33.608038  2707 catalog_manager.cc:5697] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 reported cstate change: term changed from 2 to 3, leader changed from e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67) to a8121be36ee14ab3960ca416d5b47142 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "a8121be36ee14ab3960ca416d5b47142" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.695798  2959 raft_consensus.cc:1275] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:33.697335  3126 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:33.708621  2812 raft_consensus.cc:1275] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:33.710587  3126 consensus_queue.cc:1048] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:33.715390  2810 raft_consensus.cc:1275] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.717077  3123 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:33.732729  2959 raft_consensus.cc:1275] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:33.735100  3147 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:33.773923  2812 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.775496  3147 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:33.785121  2959 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.787043  3147 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:33.980626  2959 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:33.982007  3147 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:33.989650  2810 raft_consensus.cc:1275] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:33.991707  3145 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:33.995486  2810 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:33.997434  3145 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:34.008343  2959 raft_consensus.cc:1275] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Refusing update from remote peer a8121be36ee14ab3960ca416d5b47142: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:34.010022  3145 consensus_queue.cc:1048] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:36.442857  2677 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:19:36.443830  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.451534  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:36.452203  2885 raft_consensus.cc:606] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Received request to transfer leadership to TS e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:36.455864  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:36.456377  2885 raft_consensus.cc:606] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:36.459007  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:36.459589  2885 raft_consensus.cc:606] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 LEADER]: Received request to transfer leadership to TS e1c69b9803be4c71b38b9cc8c8a89b2a
I20260709 12:19:36.462208  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:36.462682  2885 raft_consensus.cc:606] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:36.465083  2885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3814a22dec347edbaa470674d932c77"
dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
mode: GRACEFUL
new_leader_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:46384
I20260709 12:19:36.465658  2885 raft_consensus.cc:606] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Received request to transfer leadership to TS 620b99ab8ada48d4a2b355358d59bf15
I20260709 12:19:36.466861  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:36.467331  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:36.488772  3157 raft_consensus.cc:993] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.489373  3155 raft_consensus.cc:1081] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 LEADER]: Signalling peer 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.491057  2810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53935279e2fa4b23b607548b55439946"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:35668
I20260709 12:19:36.491609  2810 raft_consensus.cc:493] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.491918  2810 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.501610  3157 raft_consensus.cc:993] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:36.502154  3155 raft_consensus.cc:1081] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Signalling peer e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:36.504071  2958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:47458
I20260709 12:19:36.504647  2958 raft_consensus.cc:493] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.505003  2958 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.538385  3155 raft_consensus.cc:993] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.538966  3157 raft_consensus.cc:1081] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.540683  2812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3814a22dec347edbaa470674d932c77"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:35668
I20260709 12:19:36.541189  2812 raft_consensus.cc:493] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.541466  2812 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.572156  2810 raft_consensus.cc:515] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:36.572160  2958 raft_consensus.cc:515] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.577101  2810 leader_election.cc:290] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 5 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:36.579046  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:36.579419  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:36.580286  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c5ec4c77164510a213f6d5511b91b3" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:36.580677  2961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53935279e2fa4b23b607548b55439946" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:36.580935  2885 raft_consensus.cc:3055] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:36.581096  2887 raft_consensus.cc:3055] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:36.581278  2961 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.581279  2885 raft_consensus.cc:740] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:36.581552  2887 raft_consensus.cc:740] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:36.582508  2885 consensus_queue.cc:260] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:36.582657  2887 consensus_queue.cc:260] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.579200  2958 leader_election.cc:290] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 4 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:36.584064  2887 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.580264  2810 raft_consensus.cc:3060] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:36.584712  2885 raft_consensus.cc:3060] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:36.671005  2887 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 4.
I20260709 12:19:36.670717  2812 raft_consensus.cc:515] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.670683  2885 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 5.
I20260709 12:19:36.673725  2777 leader_election.cc:304] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:36.674294  2812 leader_election.cc:290] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:36.670683  2961 raft_consensus.cc:2468] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 5.
I20260709 12:19:36.675976  2958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:36.677443  2926 leader_election.cc:304] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:36.679468  3159 raft_consensus.cc:2804] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:36.679600  3160 raft_consensus.cc:2804] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:36.679684  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3814a22dec347edbaa470674d932c77" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:36.680025  3159 raft_consensus.cc:697] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:36.680346  2887 raft_consensus.cc:3055] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.680728  2887 raft_consensus.cc:740] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:36.681102  3159 consensus_queue.cc:237] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.681982  2887 consensus_queue.cc:260] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.683769  2887 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.685645  3160 raft_consensus.cc:697] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 5 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:36.676772  2958 raft_consensus.cc:3060] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.686781  3160 consensus_queue.cc:237] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } }
I20260709 12:19:36.698946  3155 raft_consensus.cc:993] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: : Instructing follower e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:36.699620  3157 raft_consensus.cc:1081] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 LEADER]: Signalling peer e1c69b9803be4c71b38b9cc8c8a89b2a to start an election
I20260709 12:19:36.701951  2961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e"
dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
 from {username='slave'} at 127.0.0.1:47458
I20260709 12:19:36.702801  2961 raft_consensus.cc:493] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.701877  2705 catalog_manager.cc:5697] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 3 to 4, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 4 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.703222  2961 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.703141  2707 catalog_manager.cc:5697] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 4 to 5, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 5 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.708468  3155 raft_consensus.cc:993] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: : Instructing follower 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.709306  3147 raft_consensus.cc:1081] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Signalling peer 620b99ab8ada48d4a2b355358d59bf15 to start an election
I20260709 12:19:36.711720  2812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7"
dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
 from {username='slave'} at 127.0.0.1:35668
I20260709 12:19:36.712292  2812 raft_consensus.cc:493] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.712680  2812 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.768405  2958 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:36.768405  2887 raft_consensus.cc:2468] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:36.771377  2777 leader_election.cc:304] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:36.772348  3160 raft_consensus.cc:2804] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.768406  2810 raft_consensus.cc:2468] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 4.
I20260709 12:19:36.772863  3160 raft_consensus.cc:697] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:36.774073  3160 consensus_queue.cc:237] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.782442  2705 catalog_manager.cc:5697] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.864229  2961 raft_consensus.cc:515] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.864168  2812 raft_consensus.cc:515] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.866639  2812 leader_election.cc:290] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Requested vote from peers a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697), e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67:46737)
I20260709 12:19:36.868608  2961 leader_election.cc:290] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 3 election: Requested vote from peers 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637), a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697)
I20260709 12:19:36.868866  2887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:36.869808  2887 raft_consensus.cc:3055] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:36.870059  2958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b08137ac3f47435f8726e42673b6bfc7" candidate_uuid: "620b99ab8ada48d4a2b355358d59bf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a"
I20260709 12:19:36.870195  2887 raft_consensus.cc:740] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:36.870702  2958 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.870786  2812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "620b99ab8ada48d4a2b355358d59bf15"
I20260709 12:19:36.871331  2812 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.871281  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798ee51672da4e82bc936c7514431d4e" candidate_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8121be36ee14ab3960ca416d5b47142"
I20260709 12:19:36.871178  2887 consensus_queue.cc:260] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.872040  2885 raft_consensus.cc:3055] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:36.872329  2885 raft_consensus.cc:740] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8121be36ee14ab3960ca416d5b47142, State: Running, Role: LEADER
I20260709 12:19:36.872498  2887 raft_consensus.cc:3060] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:36.873018  2885 consensus_queue.cc:260] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.874013  2885 raft_consensus.cc:3060] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:36.960166  2885 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 3.
I20260709 12:19:36.960508  2887 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:36.960166  2958 raft_consensus.cc:2468] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 620b99ab8ada48d4a2b355358d59bf15 in term 2.
I20260709 12:19:36.960187  2812 raft_consensus.cc:2468] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c69b9803be4c71b38b9cc8c8a89b2a in term 3.
I20260709 12:19:36.962344  2777 leader_election.cc:304] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 620b99ab8ada48d4a2b355358d59bf15, a8121be36ee14ab3960ca416d5b47142; no voters: 
I20260709 12:19:36.962355  2926 leader_election.cc:304] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8121be36ee14ab3960ca416d5b47142, e1c69b9803be4c71b38b9cc8c8a89b2a; no voters: 
I20260709 12:19:36.963605  3160 raft_consensus.cc:2804] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:36.964282  3160 raft_consensus.cc:697] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Becoming Leader. State: Replica: 620b99ab8ada48d4a2b355358d59bf15, State: Running, Role: LEADER
I20260709 12:19:36.964370  3159 raft_consensus.cc:2804] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:36.965571  3159 raft_consensus.cc:697] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Becoming Leader. State: Replica: e1c69b9803be4c71b38b9cc8c8a89b2a, State: Running, Role: LEADER
I20260709 12:19:36.965636  3160 consensus_queue.cc:237] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.966831  3159 consensus_queue.cc:237] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } }
I20260709 12:19:36.975258  2705 catalog_manager.cc:5697] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 reported cstate change: term changed from 1 to 2, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "620b99ab8ada48d4a2b355358d59bf15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.977027  2707 catalog_manager.cc:5697] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a reported cstate change: term changed from 2 to 3, leader changed from a8121be36ee14ab3960ca416d5b47142 (127.2.157.66) to e1c69b9803be4c71b38b9cc8c8a89b2a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:37.169790  2887 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 5 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:37.171183  3160 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:37.180907  2887 raft_consensus.cc:1275] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.182868  2958 raft_consensus.cc:1275] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 5 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:19:37.183517  3161 consensus_queue.cc:1048] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:37.185631  3161 consensus_queue.cc:1048] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:19:37.195570  2740 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 2680
W20260709 12:19:37.197250  2740 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 2743
W20260709 12:19:37.198846  2740 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1000 after lost signal to thread 2836
W20260709 12:19:37.206178  2740 debug-util.cc:398] Leaking SignalData structure 0x7b080017b6a0 after lost signal to thread 2911
W20260709 12:19:37.207242  2740 debug-util.cc:398] Leaking SignalData structure 0x7b080019f2a0 after lost signal to thread 2985
I20260709 12:19:37.210811  2961 raft_consensus.cc:1275] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.215796  3174 consensus_queue.cc:1048] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:37.230966  2812 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:37.232649  3159 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:37.246641  2887 raft_consensus.cc:1275] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:37.248627  3159 consensus_queue.cc:1048] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:37.450857  2887 raft_consensus.cc:1275] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.452340  3174 consensus_queue.cc:1048] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.464234  2961 raft_consensus.cc:1275] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Refusing update from remote peer 620b99ab8ada48d4a2b355358d59bf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:37.466254  3160 consensus_queue.cc:1048] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c69b9803be4c71b38b9cc8c8a89b2a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:37.468823  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:37.480490  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:37.481082  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:37.499027  2812 raft_consensus.cc:1275] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:37.501286  3159 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "620b99ab8ada48d4a2b355358d59bf15" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:37.502722  2887 raft_consensus.cc:1275] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Refusing update from remote peer e1c69b9803be4c71b38b9cc8c8a89b2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:37.504174  3159 consensus_queue.cc:1048] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8121be36ee14ab3960ca416d5b47142" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:38.482285  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.489439  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:38.489902  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:39.491060  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.495944  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:39.496402  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.497781  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.503829  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:40.504199  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:41.505196  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.509910  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:41.510367  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.511340  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.516398  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:42.516768  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:43.517813  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:43.523360  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:43.523806  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.524945  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.530565  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:44.531075  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:45.532233  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.538265  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:45.538686  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:46.710994  2677 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:19:46.711617  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
I20260709 12:19:46.749945  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:46.750906  2677 tablet_replica.cc:333] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.752265  2677 raft_consensus.cc:2243] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.753508  2677 raft_consensus.cc:2272] T b08137ac3f47435f8726e42673b6bfc7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.756335  2677 tablet_replica.cc:333] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.756942  2677 raft_consensus.cc:2243] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.757406  2677 raft_consensus.cc:2272] T fd0e833ad4cc42749cae4e1025a34e91 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.759361  2677 tablet_replica.cc:333] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.760059  2677 raft_consensus.cc:2243] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.760509  2677 raft_consensus.cc:2272] T f0d71f1150674c99aa96bd950206f83e P 620b99ab8ada48d4a2b355358d59bf15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.762629  2677 tablet_replica.cc:333] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.763412  2677 raft_consensus.cc:2243] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.764101  2677 raft_consensus.cc:2272] T 41c5ec4c77164510a213f6d5511b91b3 P 620b99ab8ada48d4a2b355358d59bf15 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:46.765072  2852 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:46.766780  2677 tablet_replica.cc:333] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.767529  2677 raft_consensus.cc:2243] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.768729  2677 raft_consensus.cc:2272] T e3814a22dec347edbaa470674d932c77 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:46.768959  2852 consensus_peers.cc:597] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 -> Peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Couldn't send request to peer 620b99ab8ada48d4a2b355358d59bf15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.771025  2677 tablet_replica.cc:333] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.771744  2677 raft_consensus.cc:2243] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.772318  2677 raft_consensus.cc:2272] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.774458  2677 tablet_replica.cc:333] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.775190  2677 raft_consensus.cc:2243] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.775781  2677 raft_consensus.cc:2272] T 798ee51672da4e82bc936c7514431d4e P 620b99ab8ada48d4a2b355358d59bf15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.777805  2677 tablet_replica.cc:333] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.778347  2677 raft_consensus.cc:2243] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.779307  2677 raft_consensus.cc:2272] T 53935279e2fa4b23b607548b55439946 P 620b99ab8ada48d4a2b355358d59bf15 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.781409  2677 tablet_replica.cc:333] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15: stopping tablet replica
I20260709 12:19:46.781901  2677 raft_consensus.cc:2243] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.782369  2677 raft_consensus.cc:2272] T 92bdb0e5528a47b2a173dc9271301ae7 P 620b99ab8ada48d4a2b355358d59bf15 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:46.877617  2852 consensus_peers.cc:597] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 -> Peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Couldn't send request to peer 620b99ab8ada48d4a2b355358d59bf15. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.877866  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
I20260709 12:19:46.901361  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:19:46.918037  2926 consensus_peers.cc:597] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a -> Peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Couldn't send request to peer 620b99ab8ada48d4a2b355358d59bf15. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.932526  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:46.933252  2677 tablet_replica.cc:333] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.933916  2677 raft_consensus.cc:2243] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.934536  2677 raft_consensus.cc:2272] T 92bdb0e5528a47b2a173dc9271301ae7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.936411  2677 tablet_replica.cc:333] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.937022  2677 raft_consensus.cc:2243] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.937500  2677 raft_consensus.cc:2272] T 41c5ec4c77164510a213f6d5511b91b3 P a8121be36ee14ab3960ca416d5b47142 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.939194  2677 tablet_replica.cc:333] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.939770  2677 raft_consensus.cc:2243] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.940582  2677 raft_consensus.cc:2272] T f0d71f1150674c99aa96bd950206f83e P a8121be36ee14ab3960ca416d5b47142 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.942302  2677 tablet_replica.cc:333] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.942859  2677 raft_consensus.cc:2243] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.943742  2677 raft_consensus.cc:2272] T fd0e833ad4cc42749cae4e1025a34e91 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.945644  2677 tablet_replica.cc:333] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.946182  2677 raft_consensus.cc:2243] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.946657  2677 raft_consensus.cc:2272] T b08137ac3f47435f8726e42673b6bfc7 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.948441  2677 tablet_replica.cc:333] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.948980  2677 raft_consensus.cc:2243] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:46.949811  2677 raft_consensus.cc:2272] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.951748  2677 tablet_replica.cc:333] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.952251  2677 raft_consensus.cc:2243] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.952829  2677 raft_consensus.cc:2272] T e3814a22dec347edbaa470674d932c77 P a8121be36ee14ab3960ca416d5b47142 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.955523  2677 tablet_replica.cc:333] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.956084  2677 raft_consensus.cc:2243] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.956586  2677 raft_consensus.cc:2272] T 53935279e2fa4b23b607548b55439946 P a8121be36ee14ab3960ca416d5b47142 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:46.958509  2677 tablet_replica.cc:333] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142: stopping tablet replica
I20260709 12:19:46.959033  2677 raft_consensus.cc:2243] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:46.959584  2677 raft_consensus.cc:2272] T 798ee51672da4e82bc936c7514431d4e P a8121be36ee14ab3960ca416d5b47142 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:46.977135  2926 consensus_peers.cc:597] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a -> Peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Couldn't send request to peer 620b99ab8ada48d4a2b355358d59bf15. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:46.977802  2926 consensus_peers.cc:597] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a -> Peer 620b99ab8ada48d4a2b355358d59bf15 (127.2.157.65:40637): Couldn't send request to peer 620b99ab8ada48d4a2b355358d59bf15. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.992303  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
I20260709 12:19:47.014227  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
I20260709 12:19:47.044643  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:47.045565  2677 tablet_replica.cc:333] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
W20260709 12:19:47.045778  2926 consensus_peers.cc:597] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a -> Peer a8121be36ee14ab3960ca416d5b47142 (127.2.157.66:46697): Couldn't send request to peer a8121be36ee14ab3960ca416d5b47142. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:46697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:47.046888  2677 raft_consensus.cc:2243] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:47.048025  2677 raft_consensus.cc:2272] T 92bdb0e5528a47b2a173dc9271301ae7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.050042  2677 tablet_replica.cc:333] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.050577  2677 raft_consensus.cc:2243] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:47.051362  2677 raft_consensus.cc:2272] T 798ee51672da4e82bc936c7514431d4e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.053315  2677 tablet_replica.cc:333] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.053853  2677 raft_consensus.cc:2243] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.054296  2677 raft_consensus.cc:2272] T fd0e833ad4cc42749cae4e1025a34e91 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.056270  2677 tablet_replica.cc:333] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.056804  2677 raft_consensus.cc:2243] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.057252  2677 raft_consensus.cc:2272] T 53935279e2fa4b23b607548b55439946 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.058974  2677 tablet_replica.cc:333] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.059561  2677 raft_consensus.cc:2243] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.059998  2677 raft_consensus.cc:2272] T f0d71f1150674c99aa96bd950206f83e P e1c69b9803be4c71b38b9cc8c8a89b2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.061733  2677 tablet_replica.cc:333] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.062216  2677 raft_consensus.cc:2243] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:47.063122  2677 raft_consensus.cc:2272] T 41c5ec4c77164510a213f6d5511b91b3 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.065025  2677 tablet_replica.cc:333] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.065508  2677 raft_consensus.cc:2243] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.065910  2677 raft_consensus.cc:2272] T f9bd4203df9c4fe4adc4d1c7b1f264e9 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.067638  2677 tablet_replica.cc:333] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.068077  2677 raft_consensus.cc:2243] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.068468  2677 raft_consensus.cc:2272] T e3814a22dec347edbaa470674d932c77 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.070108  2677 tablet_replica.cc:333] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a: stopping tablet replica
I20260709 12:19:47.070547  2677 raft_consensus.cc:2243] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.070933  2677 raft_consensus.cc:2272] T b08137ac3f47435f8726e42673b6bfc7 P e1c69b9803be4c71b38b9cc8c8a89b2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.099776  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
I20260709 12:19:47.118070  2677 master.cc:562] Master@127.2.157.126:40493 shutting down...
I20260709 12:19:47.303102  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:47.303846  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.304154  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4ebd9e6a7f9746968955df9a305f0f85: stopping tablet replica
W20260709 12:19:47.590018  2740 debug-util.cc:398] Leaking SignalData structure 0x7b080014db00 after lost signal to thread 2680
W20260709 12:19:47.590826  2740 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1c00 after lost signal to thread 2743
W20260709 12:19:47.591759  2740 debug-util.cc:398] Leaking SignalData structure 0x7b0800062180 after lost signal to thread 2836
W20260709 12:19:47.592429  2740 debug-util.cc:398] Leaking SignalData structure 0x7b08001bea60 after lost signal to thread 2911
W20260709 12:19:47.593102  2740 debug-util.cc:398] Leaking SignalData structure 0x7b0800092be0 after lost signal to thread 2985
I20260709 12:19:47.794411  2677 master.cc:584] Master@127.2.157.126:40493 shutdown complete.
620b99ab8ada48d4a2b355358d59bf15  4
a8121be36ee14ab3960ca416d5b47142  4
e1c69b9803be4c71b38b9cc8c8a89b2a  1
620b99ab8ada48d4a2b355358d59bf15  3
a8121be36ee14ab3960ca416d5b47142  3
e1c69b9803be4c71b38b9cc8c8a89b2a  3
620b99ab8ada48d4a2b355358d59bf15  0
a8121be36ee14ab3960ca416d5b47142  8
e1c69b9803be4c71b38b9cc8c8a89b2a  1
620b99ab8ada48d4a2b355358d59bf15  3
a8121be36ee14ab3960ca416d5b47142  3
e1c69b9803be4c71b38b9cc8c8a89b2a  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31959 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:19:47.836165  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:38489
I20260709 12:19:47.837289  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:47.843161  3205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.843365  3204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:47.844749  3207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:47.845973  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:47.847098  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:47.847298  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:47.847543  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599587847521 us; error 0 us; skew 500 ppm
I20260709 12:19:47.848145  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:47.850644  2677 webserver.cc:533] Webserver started at http://127.2.157.126:41665/ using document root <none> and password file <none>
I20260709 12:19:47.851188  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:47.851397  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:47.851773  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:47.853010  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "80112ba06c65479c8dcd8f7dfce2b10a"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-sx71"
I20260709 12:19:47.857930  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:47.861456  3212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:47.862227  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:47.862552  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "80112ba06c65479c8dcd8f7dfce2b10a"
format_stamp: "Formatted at 2026-07-09 12:19:47 on dist-test-slave-sx71"
I20260709 12:19:47.862839  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:47.874684  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:47.876066  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:47.915704  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:38489
I20260709 12:19:47.915807  3263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:38489 every 8 connection(s)
I20260709 12:19:47.919692  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:47.929502  3264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a: Bootstrap starting.
I20260709 12:19:47.934267  3264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.938645  3264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a: No bootstrap required, opened a new log
I20260709 12:19:47.941144  3264 raft_consensus.cc:359] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER }
I20260709 12:19:47.941638  3264 raft_consensus.cc:385] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.941845  3264 raft_consensus.cc:740] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80112ba06c65479c8dcd8f7dfce2b10a, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.942430  3264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER }
I20260709 12:19:47.942931  3264 raft_consensus.cc:399] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:47.943162  3264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:47.943403  3264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.947890  3264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER }
I20260709 12:19:47.948467  3264 leader_election.cc:304] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80112ba06c65479c8dcd8f7dfce2b10a; no voters: 
I20260709 12:19:47.949690  3264 leader_election.cc:290] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:47.950223  3267 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.951756  3267 raft_consensus.cc:697] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 1 LEADER]: Becoming Leader. State: Replica: 80112ba06c65479c8dcd8f7dfce2b10a, State: Running, Role: LEADER
I20260709 12:19:47.952621  3267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER }
I20260709 12:19:47.953068  3264 sys_catalog.cc:565] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:47.958945  3269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80112ba06c65479c8dcd8f7dfce2b10a. Latest consensus state: current_term: 1 leader_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER } }
I20260709 12:19:47.959430  3268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80112ba06c65479c8dcd8f7dfce2b10a" member_type: VOTER } }
I20260709 12:19:47.960008  3269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:47.960208  3268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:47.962479  3276 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:47.967821  3276 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:47.970404  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:47.977484  3276 catalog_manager.cc:1383] Generated new cluster ID: 9869f68f8cac401294f0f66df0f5d5b7
I20260709 12:19:47.977849  3276 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:47.997144  3276 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:47.998524  3276 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:48.019564  3276 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a: Generated new TSK 0
I20260709 12:19:48.020201  3276 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:48.037352  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:48.044091  3285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:48.045461  3286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:48.047061  3288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.047955  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:48.049106  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:48.049361  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:48.049554  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599588049535 us; error 0 us; skew 500 ppm
I20260709 12:19:48.050153  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:48.052680  2677 webserver.cc:533] Webserver started at http://127.2.157.65:41403/ using document root <none> and password file <none>
I20260709 12:19:48.053176  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:48.053380  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:48.053670  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:48.054731  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "21a7da760f914c22bc6e0f064fd0371a"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.059293  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:19:48.062954  3293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.064097  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:19:48.064450  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "21a7da760f914c22bc6e0f064fd0371a"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.064890  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:48.084182  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:48.085552  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:48.087157  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:48.089709  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:48.089956  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.090291  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:48.090507  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.134519  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:42025
I20260709 12:19:48.134634  3355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:42025 every 8 connection(s)
I20260709 12:19:48.139788  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:48.148172  3360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:48.149333  3361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.152755  2677 server_base.cc:1061] running on GCE node
W20260709 12:19:48.152673  3363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.154826  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:48.155098  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:48.155318  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599588155296 us; error 0 us; skew 500 ppm
I20260709 12:19:48.156175  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:48.158553  3356 heartbeater.cc:344] Connected to a master server at 127.2.157.126:38489
I20260709 12:19:48.159078  3356 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:48.159318  2677 webserver.cc:533] Webserver started at http://127.2.157.66:43827/ using document root <none> and password file <none>
I20260709 12:19:48.160034  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:48.160077  3356 heartbeater.cc:507] Master 127.2.157.126:38489 requested a full tablet report, sending...
I20260709 12:19:48.160385  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:48.160771  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:48.162315  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.162845  3229 ts_manager.cc:194] Registered new tserver with Master: 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025)
I20260709 12:19:48.165019  3229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39354
I20260709 12:19:48.168308  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:19:48.172201  3368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.173136  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:19:48.173484  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.173828  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:48.184733  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:48.186233  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:48.188174  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:48.190712  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:48.190991  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.191274  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:48.191496  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.236868  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:36889
I20260709 12:19:48.237028  3430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:36889 every 8 connection(s)
I20260709 12:19:48.242178  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:48.249995  3434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:48.251605  3435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.255211  3431 heartbeater.cc:344] Connected to a master server at 127.2.157.126:38489
W20260709 12:19:48.255733  3438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:48.255767  3431 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:48.255980  2677 server_base.cc:1061] running on GCE node
I20260709 12:19:48.257009  3431 heartbeater.cc:507] Master 127.2.157.126:38489 requested a full tablet report, sending...
I20260709 12:19:48.257134  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:48.257448  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:48.257650  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599588257630 us; error 0 us; skew 500 ppm
I20260709 12:19:48.258350  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:48.259518  3229 ts_manager.cc:194] Registered new tserver with Master: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:48.261271  2677 webserver.cc:533] Webserver started at http://127.2.157.67:36355/ using document root <none> and password file <none>
I20260709 12:19:48.261328  3229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39358
I20260709 12:19:48.261921  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:48.262187  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:48.262542  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:48.263960  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "847cefe303d24f1a9b179d5e73c0b176"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.268990  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:48.272549  3442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.273309  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:48.273638  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "847cefe303d24f1a9b179d5e73c0b176"
format_stamp: "Formatted at 2026-07-09 12:19:48 on dist-test-slave-sx71"
I20260709 12:19:48.273989  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:48.301685  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:48.302991  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:48.304678  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:48.307143  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:48.307397  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.307689  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:48.307883  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:48.351142  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:44097
I20260709 12:19:48.351300  3504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:44097 every 8 connection(s)
I20260709 12:19:48.366902  3505 heartbeater.cc:344] Connected to a master server at 127.2.157.126:38489
I20260709 12:19:48.367303  3505 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:48.368093  3505 heartbeater.cc:507] Master 127.2.157.126:38489 requested a full tablet report, sending...
I20260709 12:19:48.369975  3229 ts_manager.cc:194] Registered new tserver with Master: 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:48.370653  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01589758s
I20260709 12:19:48.371371  3229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39360
I20260709 12:19:48.401547  3229 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39374:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:48.404841  3229 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:48.484162  3470 tablet_service.cc:1511] Processing CreateTablet for tablet ded85a0d21be4283922bc3b0b7b38551 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:48.485661  3470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded85a0d21be4283922bc3b0b7b38551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.485385  3468 tablet_service.cc:1511] Processing CreateTablet for tablet b708456509284106a26c3817795d96e5 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:48.486896  3468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b708456509284106a26c3817795d96e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.488050  3469 tablet_service.cc:1511] Processing CreateTablet for tablet b6d5d738cc624f83bc2b0b50fb89c5b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:48.489401  3469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d5d738cc624f83bc2b0b50fb89c5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.491055  3467 tablet_service.cc:1511] Processing CreateTablet for tablet e5c3027e5185488cab81539041d29126 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:48.492834  3467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c3027e5185488cab81539041d29126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.497231  3466 tablet_service.cc:1511] Processing CreateTablet for tablet 8071bc88755c4d9da6eb10c01e2b3694 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:48.498802  3466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071bc88755c4d9da6eb10c01e2b3694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.506771  3465 tablet_service.cc:1511] Processing CreateTablet for tablet c6f260b5d24045cab281430163b9d7b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:48.508399  3465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f260b5d24045cab281430163b9d7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.514442  3464 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa950e1ef248bc9d27637de0940f17 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:48.515344  3520 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:48.516713  3464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa950e1ef248bc9d27637de0940f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.520691  3395 tablet_service.cc:1511] Processing CreateTablet for tablet b6d5d738cc624f83bc2b0b50fb89c5b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:48.522181  3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d5d738cc624f83bc2b0b50fb89c5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.522419  3393 tablet_service.cc:1511] Processing CreateTablet for tablet e5c3027e5185488cab81539041d29126 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:48.524753  3392 tablet_service.cc:1511] Processing CreateTablet for tablet 8071bc88755c4d9da6eb10c01e2b3694 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:48.524891  3394 tablet_service.cc:1511] Processing CreateTablet for tablet b708456509284106a26c3817795d96e5 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:48.525418  3396 tablet_service.cc:1511] Processing CreateTablet for tablet ded85a0d21be4283922bc3b0b7b38551 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:48.525851  3520 tablet_bootstrap.cc:654] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.527078  3391 tablet_service.cc:1511] Processing CreateTablet for tablet c6f260b5d24045cab281430163b9d7b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:48.529516  3390 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa950e1ef248bc9d27637de0940f17 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:48.532552  3389 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5cd815aded4a63b07b41e3f4431fe7 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:48.536520  3388 tablet_service.cc:1511] Processing CreateTablet for tablet 4c0d9c6ae0d44077b9b66583501c4df8 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:48.540371  3387 tablet_service.cc:1511] Processing CreateTablet for tablet bcc0e251552e40f6aea054d14b664e6b (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:48.541993  3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c3027e5185488cab81539041d29126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.543195  3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b708456509284106a26c3817795d96e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.543939  3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071bc88755c4d9da6eb10c01e2b3694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.545765  3467 tablet_service.cc:1511] Processing CreateTablet for tablet bcc0e251552e40f6aea054d14b664e6b (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:48.547243  3467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc0e251552e40f6aea054d14b664e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.548476  3469 tablet_service.cc:1511] Processing CreateTablet for tablet 4c0d9c6ae0d44077b9b66583501c4df8 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:48.549804  3469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0d9c6ae0d44077b9b66583501c4df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.551277  3470 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5cd815aded4a63b07b41e3f4431fe7 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:48.552052  3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f260b5d24045cab281430163b9d7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.552606  3470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5cd815aded4a63b07b41e3f4431fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.554849  3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa950e1ef248bc9d27637de0940f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.555518  3396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded85a0d21be4283922bc3b0b7b38551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.559866  3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc0e251552e40f6aea054d14b664e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.563279  3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5cd815aded4a63b07b41e3f4431fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.571875  3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0d9c6ae0d44077b9b66583501c4df8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:48.633236  3216 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.157.67:44097, user_credentials={real_user=slave}} blocked reactor thread for 55946.3us
I20260709 12:19:48.638494  3321 tablet_service.cc:1511] Processing CreateTablet for tablet ded85a0d21be4283922bc3b0b7b38551 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:48.640828  3320 tablet_service.cc:1511] Processing CreateTablet for tablet b6d5d738cc624f83bc2b0b50fb89c5b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:48.641950  3315 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfa950e1ef248bc9d27637de0940f17 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:48.642072  3313 tablet_service.cc:1511] Processing CreateTablet for tablet 4c0d9c6ae0d44077b9b66583501c4df8 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:48.642987  3319 tablet_service.cc:1511] Processing CreateTablet for tablet b708456509284106a26c3817795d96e5 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:48.644297  3312 tablet_service.cc:1511] Processing CreateTablet for tablet bcc0e251552e40f6aea054d14b664e6b (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:48.640833  3314 tablet_service.cc:1511] Processing CreateTablet for tablet 5e5cd815aded4a63b07b41e3f4431fe7 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:48.645303  3318 tablet_service.cc:1511] Processing CreateTablet for tablet e5c3027e5185488cab81539041d29126 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:48.645861  3522 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:48.647239  3317 tablet_service.cc:1511] Processing CreateTablet for tablet 8071bc88755c4d9da6eb10c01e2b3694 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:48.649398  3316 tablet_service.cc:1511] Processing CreateTablet for tablet c6f260b5d24045cab281430163b9d7b6 (DEFAULT_TABLE table=test-workload [id=6bd74080d95749b3a61ff3fea35773d3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:48.651046  3321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded85a0d21be4283922bc3b0b7b38551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.656981  3313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c0d9c6ae0d44077b9b66583501c4df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.658684  3314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5cd815aded4a63b07b41e3f4431fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.652071  3520 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:48.659770  3520 ts_tablet_manager.cc:1403] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.145s	user 0.026s	sys 0.042s
I20260709 12:19:48.660130  3312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcc0e251552e40f6aea054d14b664e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.663380  3318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c3027e5185488cab81539041d29126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.665251  3317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8071bc88755c4d9da6eb10c01e2b3694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.672178  3319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b708456509284106a26c3817795d96e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.673625  3520 raft_consensus.cc:359] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.676139  3320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d5d738cc624f83bc2b0b50fb89c5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.681201  3315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfa950e1ef248bc9d27637de0940f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.682073  3316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f260b5d24045cab281430163b9d7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:48.715628  3520 raft_consensus.cc:385] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.716161  3520 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.717316  3520 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.727712  3505 heartbeater.cc:499] Master 127.2.157.126:38489 was elected leader, sending a full tablet report...
I20260709 12:19:48.732157  3524 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.732743  3524 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.745529  3524 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:48.750070  3520 ts_tablet_manager.cc:1434] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.089s	user 0.003s	sys 0.004s
I20260709 12:19:48.751221  3520 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:48.770803  3520 tablet_bootstrap.cc:654] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.778985  3523 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:48.784973  3522 tablet_bootstrap.cc:654] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.786329  3523 tablet_bootstrap.cc:654] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.788843  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:48.789125  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
W20260709 12:19:48.791793  3445 leader_election.cc:343] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:48.792572  3445 leader_election.cc:343] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.793036  3445 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:48.793957  3524 raft_consensus.cc:2749] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.798228  3520 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:48.799080  3520 ts_tablet_manager.cc:1403] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.000s
I20260709 12:19:48.803491  3520 raft_consensus.cc:359] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.804234  3520 raft_consensus.cc:385] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.804526  3520 raft_consensus.cc:740] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.805269  3520 consensus_queue.cc:260] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.806854  3522 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:48.807320  3522 ts_tablet_manager.cc:1403] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.180s	user 0.004s	sys 0.009s
I20260709 12:19:48.808169  3520 ts_tablet_manager.cc:1434] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:19:48.809182  3520 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:48.810350  3522 raft_consensus.cc:359] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.811053  3522 raft_consensus.cc:385] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.811336  3522 raft_consensus.cc:740] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.814081  3523 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:48.814584  3523 ts_tablet_manager.cc:1403] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.000s
I20260709 12:19:48.815881  3520 tablet_bootstrap.cc:654] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.815856  3522 consensus_queue.cc:260] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.817497  3523 raft_consensus.cc:359] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.818282  3523 raft_consensus.cc:385] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.818589  3523 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.818790  3530 raft_consensus.cc:493] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.819511  3530 raft_consensus.cc:515] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.819808  3523 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.826557  3522 ts_tablet_manager.cc:1434] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 12:19:48.827823  3431 heartbeater.cc:499] Master 127.2.157.126:38489 was elected leader, sending a full tablet report...
I20260709 12:19:48.835083  3522 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:48.852706  3356 heartbeater.cc:499] Master 127.2.157.126:38489 was elected leader, sending a full tablet report...
I20260709 12:19:48.853205  3523 ts_tablet_manager.cc:1434] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.026s
I20260709 12:19:48.854264  3523 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:48.855690  3522 tablet_bootstrap.cc:654] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.847805  3530 leader_election.cc:290] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:48.860092  3520 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:48.860586  3520 ts_tablet_manager.cc:1403] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.021s
I20260709 12:19:48.862757  3523 tablet_bootstrap.cc:654] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.863735  3520 raft_consensus.cc:359] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:48.864492  3520 raft_consensus.cc:385] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.864801  3520 raft_consensus.cc:740] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.865594  3520 consensus_queue.cc:260] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:48.868824  3520 ts_tablet_manager.cc:1434] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:48.879966  3523 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:48.880685  3523 ts_tablet_manager.cc:1403] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.012s
I20260709 12:19:48.884796  3523 raft_consensus.cc:359] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.886457  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:48.886906  3523 raft_consensus.cc:385] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.887284  3480 raft_consensus.cc:2468] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:48.887470  3523 raft_consensus.cc:740] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.880704  3520 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:48.888551  3523 consensus_queue.cc:260] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.889055  3372 leader_election.cc:304] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:48.890030  3530 raft_consensus.cc:2804] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.890436  3530 raft_consensus.cc:493] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.890827  3530 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.891355  3523 ts_tablet_manager.cc:1434] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:48.892540  3523 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:48.893365  3522 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:48.893846  3522 ts_tablet_manager.cc:1403] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.019s
I20260709 12:19:48.895839  3520 tablet_bootstrap.cc:654] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.896806  3522 raft_consensus.cc:359] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.897568  3522 raft_consensus.cc:385] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.897866  3522 raft_consensus.cc:740] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.898895  3522 consensus_queue.cc:260] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.900118  3523 tablet_bootstrap.cc:654] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.902102  3522 ts_tablet_manager.cc:1434] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:48.903407  3522 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:48.913439  3522 tablet_bootstrap.cc:654] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.917351  3520 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:48.917917  3520 ts_tablet_manager.cc:1403] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.007s
I20260709 12:19:48.917968  3524 raft_consensus.cc:493] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.918506  3524 raft_consensus.cc:515] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:48.920655  3524 leader_election.cc:290] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025)
I20260709 12:19:48.921052  3520 raft_consensus.cc:359] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.921782  3520 raft_consensus.cc:385] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.921459  3530 raft_consensus.cc:515] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.922102  3520 raft_consensus.cc:740] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.922616  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:48.923106  3520 consensus_queue.cc:260] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
W20260709 12:19:48.924062  3445 leader_election.cc:343] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.925303  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
W20260709 12:19:48.926633  3445 leader_election.cc:343] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.927078  3445 leader_election.cc:304] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:48.927991  3525 raft_consensus.cc:2749] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.930084  3530 leader_election.cc:290] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:48.930866  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:48.932119  3520 ts_tablet_manager.cc:1434] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:19:48.932049  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
W20260709 12:19:48.932655  3371 leader_election.cc:343] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.933280  3520 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
W20260709 12:19:48.933660  3371 leader_election.cc:343] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.933818  3523 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:48.934358  3523 ts_tablet_manager.cc:1403] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.017s
I20260709 12:19:48.934386  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:48.935122  3480 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.937861  3523 raft_consensus.cc:359] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.938473  3520 tablet_bootstrap.cc:654] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.938724  3523 raft_consensus.cc:385] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.939162  3523 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.940053  3523 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.942533  3523 ts_tablet_manager.cc:1434] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:48.943827  3523 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:48.950075  3522 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:48.950829  3523 tablet_bootstrap.cc:654] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.950855  3522 ts_tablet_manager.cc:1403] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.014s
I20260709 12:19:48.956429  3522 raft_consensus.cc:359] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.957335  3522 raft_consensus.cc:385] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.957701  3522 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.957872  3520 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:48.958458  3520 ts_tablet_manager.cc:1403] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.010s
I20260709 12:19:48.958881  3522 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.961647  3522 ts_tablet_manager.cc:1434] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:48.962817  3522 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
W20260709 12:19:48.964260  3277 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:48.967092  3520 raft_consensus.cc:359] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.967654  3480 raft_consensus.cc:2468] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 1.
I20260709 12:19:48.967976  3520 raft_consensus.cc:385] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.968478  3520 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.969116  3372 leader_election.cc:304] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:48.969393  3520 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.970405  3530 raft_consensus.cc:2804] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.970589  3522 tablet_bootstrap.cc:654] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.970996  3530 raft_consensus.cc:697] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:48.972062  3520 ts_tablet_manager.cc:1434] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:19:48.972086  3530 consensus_queue.cc:237] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.973129  3520 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:48.978286  3523 tablet_bootstrap.cc:492] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:48.978907  3523 ts_tablet_manager.cc:1403] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.005s
I20260709 12:19:48.980999  3520 tablet_bootstrap.cc:654] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.981633  3524 raft_consensus.cc:493] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.981956  3523 raft_consensus.cc:359] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.982182  3524 raft_consensus.cc:515] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.982686  3523 raft_consensus.cc:385] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.982983  3523 raft_consensus.cc:740] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.983757  3523 consensus_queue.cc:260] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:48.984357  3524 leader_election.cc:290] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:48.986234  3523 ts_tablet_manager.cc:1434] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:19:48.986831  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:48.987248  3523 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
W20260709 12:19:48.988461  3445 leader_election.cc:343] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:48.992435  3432 tablet.cc:2406] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:48.994714  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:48.995086  3523 tablet_bootstrap.cc:654] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.995515  3331 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 0.
I20260709 12:19:48.995930  3522 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:48.996467  3522 ts_tablet_manager.cc:1403] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 12:19:49.000324  3445 leader_election.cc:304] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.001581  3524 raft_consensus.cc:2804] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.999527  3520 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:49.002040  3524 raft_consensus.cc:493] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.002480  3524 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.002549  3520 ts_tablet_manager.cc:1403] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.002s
I20260709 12:19:49.006011  3522 raft_consensus.cc:359] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.006891  3522 raft_consensus.cc:385] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.007280  3522 raft_consensus.cc:740] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.006693  3520 raft_consensus.cc:359] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.008073  3520 raft_consensus.cc:385] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.008170  3522 consensus_queue.cc:260] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.008630  3520 raft_consensus.cc:740] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.010075  3520 consensus_queue.cc:260] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.010974  3522 ts_tablet_manager.cc:1434] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:49.012298  3522 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.013463  3520 ts_tablet_manager.cc:1434] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:19:49.014918  3520 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:49.019622  3522 tablet_bootstrap.cc:654] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.033527  3530 raft_consensus.cc:493] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.034268  3530 raft_consensus.cc:515] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.037992  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
W20260709 12:19:49.040021  3371 leader_election.cc:343] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.042459  3530 leader_election.cc:290] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.042662  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.043426  3520 tablet_bootstrap.cc:654] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.044418  3372 leader_election.cc:343] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.044910  3372 leader_election.cc:304] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:49.045821  3530 raft_consensus.cc:2749] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.049193  3524 raft_consensus.cc:515] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.051324  3226 catalog_manager.cc:5697] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.053918  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.054699  3331 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.057583  3520 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:49.058176  3520 ts_tablet_manager.cc:1403] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.006s
I20260709 12:19:49.059134  3523 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.059672  3523 ts_tablet_manager.cc:1403] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.039s
I20260709 12:19:49.061457  3520 raft_consensus.cc:359] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.062279  3520 raft_consensus.cc:385] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.062630  3520 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.062907  3523 raft_consensus.cc:359] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.063733  3523 raft_consensus.cc:385] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.064060  3530 raft_consensus.cc:493] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.064149  3523 raft_consensus.cc:740] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.064731  3530 raft_consensus.cc:515] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.065065  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.065227  3523 consensus_queue.cc:260] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.067965  3523 ts_tablet_manager.cc:1434] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:49.068559  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.069128  3523 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
W20260709 12:19:49.069305  3445 leader_election.cc:343] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:49.070154  3371 leader_election.cc:343] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.071007  3530 leader_election.cc:290] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.071734  3520 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.074051  3530 raft_consensus.cc:493] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.074162  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.074841  3530 raft_consensus.cc:515] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.077844  3523 tablet_bootstrap.cc:654] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.078400  3530 leader_election.cc:290] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.078912  3524 leader_election.cc:290] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:49.078765  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.080542  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.074965  3480 raft_consensus.cc:2468] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:49.082973  3479 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:49.084195  3520 ts_tablet_manager.cc:1434] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
W20260709 12:19:49.084266  3371 leader_election.cc:343] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.085429  3520 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:49.085796  3522 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.086321  3522 ts_tablet_manager.cc:1403] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.006s
I20260709 12:19:49.086404  3372 leader_election.cc:304] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.088294  3372 leader_election.cc:304] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.090912  3531 raft_consensus.cc:2804] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.091434  3531 raft_consensus.cc:493] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.089704  3522 raft_consensus.cc:359] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.091837  3531 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.092054  3522 raft_consensus.cc:385] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.092415  3522 raft_consensus.cc:740] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.093772  3522 consensus_queue.cc:260] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.094492  3520 tablet_bootstrap.cc:654] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.095526  3530 raft_consensus.cc:2804] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.095959  3530 raft_consensus.cc:493] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.096331  3530 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.101846  3520 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:49.102349  3520 ts_tablet_manager.cc:1403] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.007s
I20260709 12:19:49.091857  3331 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 1.
I20260709 12:19:49.103834  3445 leader_election.cc:304] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.106325  3520 raft_consensus.cc:359] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.107010  3520 raft_consensus.cc:385] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.107306  3520 raft_consensus.cc:740] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.107383  3530 raft_consensus.cc:515] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.108191  3520 consensus_queue.cc:260] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.109323  3531 raft_consensus.cc:515] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.110301  3520 ts_tablet_manager.cc:1434] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:49.110289  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.111411  3520 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:49.111552  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.116583  3531 leader_election.cc:290] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.116783  3479 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.118582  3522 ts_tablet_manager.cc:1434] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.008s
W20260709 12:19:49.115761  3371 leader_election.cc:343] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.119594  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.111829  3530 leader_election.cc:290] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.104769  3524 raft_consensus.cc:2804] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.116706  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.120764  3524 raft_consensus.cc:697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:19:49.120918  3522 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.120975  3480 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.121748  3524 consensus_queue.cc:237] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.122356  3523 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.122928  3523 ts_tablet_manager.cc:1403] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.020s
W20260709 12:19:49.123323  3371 leader_election.cc:343] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.126041  3479 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 1.
I20260709 12:19:49.126289  3523 raft_consensus.cc:359] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.127213  3523 raft_consensus.cc:385] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.127622  3523 raft_consensus.cc:740] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.127591  3372 leader_election.cc:304] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.127765  3480 raft_consensus.cc:2468] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 1.
I20260709 12:19:49.128903  3523 consensus_queue.cc:260] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.129969  3530 raft_consensus.cc:2804] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.130530  3530 raft_consensus.cc:697] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:49.131834  3523 ts_tablet_manager.cc:1434] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:19:49.131544  3530 consensus_queue.cc:237] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.133031  3523 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:49.129288  3372 leader_election.cc:304] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.133790  3531 raft_consensus.cc:2804] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.134306  3531 raft_consensus.cc:697] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:49.135203  3531 consensus_queue.cc:237] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.141182  3522 tablet_bootstrap.cc:654] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.143218  3520 tablet_bootstrap.cc:654] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.143647  3523 tablet_bootstrap.cc:654] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.158442  3520 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:49.159747  3533 raft_consensus.cc:493] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.160323  3533 raft_consensus.cc:515] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.159199  3520 ts_tablet_manager.cc:1403] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.006s
I20260709 12:19:49.168257  3533 leader_election.cc:290] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.169452  3520 raft_consensus.cc:359] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.170300  3520 raft_consensus.cc:385] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.170642  3520 raft_consensus.cc:740] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.171866  3520 consensus_queue.cc:260] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.175359  3520 ts_tablet_manager.cc:1434] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:19:49.176847  3520 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: Bootstrap starting.
I20260709 12:19:49.177589  3523 tablet_bootstrap.cc:492] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.178184  3523 ts_tablet_manager.cc:1403] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.012s
I20260709 12:19:49.183970  3520 tablet_bootstrap.cc:654] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.185081  3523 raft_consensus.cc:359] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.186084  3523 raft_consensus.cc:385] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.185098  3226 catalog_manager.cc:5697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 0 to 1, leader changed from <none> to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.186421  3523 raft_consensus.cc:740] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.192273  3531 raft_consensus.cc:493] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.192840  3531 raft_consensus.cc:515] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.193924  3523 consensus_queue.cc:260] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.194621  3522 tablet_bootstrap.cc:492] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.195084  3531 leader_election.cc:290] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.195302  3522 ts_tablet_manager.cc:1403] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.007s
I20260709 12:19:49.197367  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.198257  3479 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:49.199421  3372 leader_election.cc:304] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:49.200080  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.200532  3531 raft_consensus.cc:2804] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.200776  3331 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:49.200937  3531 raft_consensus.cc:493] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.201274  3531 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.208992  3531 raft_consensus.cc:515] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.210703  3522 raft_consensus.cc:359] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.211690  3522 raft_consensus.cc:385] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.211999  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.212163  3522 raft_consensus.cc:740] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.212687  3331 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.213487  3533 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.213446  3522 consensus_queue.cc:260] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.214483  3533 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.216399  3522 ts_tablet_manager.cc:1434] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:19:49.216832  3533 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.217710  3522 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.220278  3331 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 1.
I20260709 12:19:49.211711  3523 ts_tablet_manager.cc:1434] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 12:19:49.222047  3371 leader_election.cc:304] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.222546  3523 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:49.222884  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.224551  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.226436  3522 tablet_bootstrap.cc:654] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.226182  3530 raft_consensus.cc:2804] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:49.226933  3296 leader_election.cc:343] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.227551  3530 raft_consensus.cc:697] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
W20260709 12:19:49.227727  3296 leader_election.cc:343] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.228593  3530 consensus_queue.cc:237] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.229686  3523 tablet_bootstrap.cc:654] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.232225  3520 tablet_bootstrap.cc:492] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: No bootstrap required, opened a new log
I20260709 12:19:49.232868  3520 ts_tablet_manager.cc:1403] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.004s
I20260709 12:19:49.236423  3520 raft_consensus.cc:359] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.237169  3520 raft_consensus.cc:385] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.237421  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.238178  3531 leader_election.cc:290] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.238092  3480 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.236728  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.238924  3479 raft_consensus.cc:2468] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.237442  3520 raft_consensus.cc:740] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.239738  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.240314  3480 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.240684  3297 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.241703  3533 raft_consensus.cc:2804] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.242172  3297 leader_election.cc:304] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.242240  3533 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.243012  3533 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.240700  3520 consensus_queue.cc:260] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.246670  3520 ts_tablet_manager.cc:1434] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:19:49.237896  3226 catalog_manager.cc:5697] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.260692  3522 tablet_bootstrap.cc:492] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.261480  3522 ts_tablet_manager.cc:1403] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.008s
I20260709 12:19:49.258987  3533 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.255026  3226 catalog_manager.cc:5697] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.268679  3480 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 1.
I20260709 12:19:49.268752  3522 raft_consensus.cc:359] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.271607  3522 raft_consensus.cc:385] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.272301  3567 raft_consensus.cc:2804] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.272883  3567 raft_consensus.cc:493] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.272853  3522 raft_consensus.cc:740] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.273378  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.274112  3522 consensus_queue.cc:260] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
W20260709 12:19:49.275116  3296 leader_election.cc:343] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.273442  3567 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.277269  3522 ts_tablet_manager.cc:1434] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:19:49.278352  3533 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.278586  3522 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.280531  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.280984  3523 tablet_bootstrap.cc:492] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.281250  3480 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.281482  3523 ts_tablet_manager.cc:1403] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.059s	user 0.031s	sys 0.019s
I20260709 12:19:49.284307  3523 raft_consensus.cc:359] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.285190  3523 raft_consensus.cc:385] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.285518  3523 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.286460  3523 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.288973  3523 ts_tablet_manager.cc:1434] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:19:49.289956  3523 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:49.290566  3522 tablet_bootstrap.cc:654] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.293483  3530 raft_consensus.cc:493] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.294162  3530 raft_consensus.cc:515] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.295400  3523 tablet_bootstrap.cc:654] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.296582  3530 leader_election.cc:290] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.300844  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.302182  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.303005  3479 raft_consensus.cc:2468] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 0.
I20260709 12:19:49.307873  3480 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.308925  3567 raft_consensus.cc:515] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.312590  3522 tablet_bootstrap.cc:492] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.313555  3523 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.315316  3522 ts_tablet_manager.cc:1403] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.013s
I20260709 12:19:49.315536  3523 ts_tablet_manager.cc:1403] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 12:19:49.315969  3372 leader_election.cc:304] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:49.317339  3530 raft_consensus.cc:2804] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.316494  3567 leader_election.cc:290] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.317718  3530 raft_consensus.cc:493] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.318284  3530 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.318435  3523 raft_consensus.cc:359] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.318882  3297 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.319181  3523 raft_consensus.cc:385] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.319489  3523 raft_consensus.cc:740] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.317684  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.320287  3523 consensus_queue.cc:260] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.320485  3522 raft_consensus.cc:359] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.320943  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.321265  3522 raft_consensus.cc:385] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.321261  3533 raft_consensus.cc:2804] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.321520  3480 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.321832  3522 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.322327  3523 ts_tablet_manager.cc:1434] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:49.323231  3523 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: Bootstrap starting.
I20260709 12:19:49.322834  3522 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.325309  3522 ts_tablet_manager.cc:1434] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:19:49.326340  3522 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.326545  3530 raft_consensus.cc:515] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.327736  3405 raft_consensus.cc:2393] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21a7da760f914c22bc6e0f064fd0371a in current term 1: Already voted for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in this term.
I20260709 12:19:49.327944  3331 raft_consensus.cc:2393] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in current term 1: Already voted for candidate 21a7da760f914c22bc6e0f064fd0371a in this term.
I20260709 12:19:49.313715  3228 catalog_manager.cc:5697] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.333441  3522 tablet_bootstrap.cc:654] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.337431  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.338274  3331 raft_consensus.cc:2393] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in current term 1: Already voted for candidate 21a7da760f914c22bc6e0f064fd0371a in this term.
I20260709 12:19:49.338413  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.340628  3372 leader_election.cc:304] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:49.341842  3531 raft_consensus.cc:2749] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.342851  3530 leader_election.cc:290] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.344024  3567 raft_consensus.cc:493] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.344645  3567 raft_consensus.cc:515] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.334388  3480 raft_consensus.cc:2468] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.348542  3297 leader_election.cc:304] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.349548  3567 leader_election.cc:290] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.350135  3567 raft_consensus.cc:493] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.351806  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.353084  3523 tablet_bootstrap.cc:654] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.350589  3567 raft_consensus.cc:515] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.356827  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.357918  3480 raft_consensus.cc:2393] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21a7da760f914c22bc6e0f064fd0371a in current term 1: Already voted for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in this term.
I20260709 12:19:49.362550  3567 leader_election.cc:290] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.363869  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.364868  3405 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.359617  3297 leader_election.cc:304] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a; no voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:49.363173  3567 raft_consensus.cc:493] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.366684  3296 leader_election.cc:304] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.366806  3567 raft_consensus.cc:515] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.368223  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.369118  3479 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.369757  3522 tablet_bootstrap.cc:492] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.370241  3522 ts_tablet_manager.cc:1403] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.002s
I20260709 12:19:49.371233  3523 tablet_bootstrap.cc:492] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: No bootstrap required, opened a new log
I20260709 12:19:49.371793  3523 ts_tablet_manager.cc:1403] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.000s
I20260709 12:19:49.372993  3522 raft_consensus.cc:359] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.373667  3522 raft_consensus.cc:385] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.373929  3522 raft_consensus.cc:740] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.374702  3523 raft_consensus.cc:359] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.375643  3523 raft_consensus.cc:385] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.376101  3523 raft_consensus.cc:740] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.377175  3523 consensus_queue.cc:260] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.378050  3567 leader_election.cc:290] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:49.378621  3567 raft_consensus.cc:2804] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.379086  3567 raft_consensus.cc:697] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.379422  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.379731  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.379980  3567 consensus_queue.cc:237] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.380290  3479 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.380390  3405 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.382759  3296 leader_election.cc:304] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.377648  3530 consensus_queue.cc:1048] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:49.385651  3577 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.374614  3522 consensus_queue.cc:260] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.395849  3575 raft_consensus.cc:2804] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.397105  3523 ts_tablet_manager.cc:1434] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:19:49.398949  3522 ts_tablet_manager.cc:1434] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:19:49.401741  3522 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Bootstrap starting.
I20260709 12:19:49.408632  3575 raft_consensus.cc:493] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.409061  3575 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.415277  3571 raft_consensus.cc:2804] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.415815  3571 raft_consensus.cc:493] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.415570  3567 raft_consensus.cc:493] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.416388  3575 raft_consensus.cc:515] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.417390  3533 raft_consensus.cc:697] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.416292  3571 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.417052  3567 raft_consensus.cc:515] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.418658  3533 consensus_queue.cc:237] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.421629  3567 leader_election.cc:290] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.424355  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.425242  3522 tablet_bootstrap.cc:654] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.428526  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.429155  3406 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.442981  3524 raft_consensus.cc:493] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.425203  3405 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.443737  3524 raft_consensus.cc:515] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.447795  3296 leader_election.cc:304] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.450287  3567 raft_consensus.cc:2804] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.450836  3567 raft_consensus.cc:493] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.451311  3567 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.433002  3577 raft_consensus.cc:2749] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.452580  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.453467  3479 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 0.
I20260709 12:19:49.454638  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.456732  3554 consensus_queue.cc:1048] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.461361  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" is_pre_election: true
I20260709 12:19:49.462128  3524 leader_election.cc:290] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:49.487591  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.488233  3479 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.482282  3405 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 0.
I20260709 12:19:49.510375  3445 leader_election.cc:304] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:49.511711  3524 raft_consensus.cc:2804] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.512208  3524 raft_consensus.cc:493] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.512630  3524 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.537325  3567 raft_consensus.cc:515] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.539055  3330 raft_consensus.cc:2393] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847cefe303d24f1a9b179d5e73c0b176 in current term 1: Already voted for candidate 21a7da760f914c22bc6e0f064fd0371a in this term.
I20260709 12:19:49.545245  3479 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.491202  3571 raft_consensus.cc:515] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.546173  3406 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.480931  3575 leader_election.cc:290] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.546684  3297 leader_election.cc:304] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:49.547977  3575 raft_consensus.cc:2804] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.548854  3571 leader_election.cc:290] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Requested vote from peers 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:49.549566  3575 raft_consensus.cc:697] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.549963  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.549783  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.550614  3406 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.550796  3479 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.550731  3575 consensus_queue.cc:237] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.556044  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.556826  3405 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.557884  3406 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.557888  3479 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.559259  3296 leader_election.cc:304] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.560189  3580 raft_consensus.cc:2804] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.560654  3580 raft_consensus.cc:697] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.561383  3580 consensus_queue.cc:237] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:19:49.568164  3405 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 1.
I20260709 12:19:49.569756  3296 leader_election.cc:304] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.570621  3580 raft_consensus.cc:2804] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.571120  3580 raft_consensus.cc:697] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.571758  3554 consensus_queue.cc:1048] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.572173  3522 tablet_bootstrap.cc:492] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: No bootstrap required, opened a new log
I20260709 12:19:49.571954  3580 consensus_queue.cc:237] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.572832  3522 ts_tablet_manager.cc:1403] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent bootstrapping tablet: real 0.171s	user 0.036s	sys 0.041s
I20260709 12:19:49.575338  3567 leader_election.cc:290] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 1 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.579145  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.581821  3522 raft_consensus.cc:359] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.582808  3522 raft_consensus.cc:385] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.583158  3522 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.587075  3524 raft_consensus.cc:515] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.588640  3478 raft_consensus.cc:2393] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21a7da760f914c22bc6e0f064fd0371a in current term 1: Already voted for candidate 847cefe303d24f1a9b179d5e73c0b176 in this term.
I20260709 12:19:49.589570  3524 leader_election.cc:290] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:49.590842  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.590564  3522 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.592779  3522 ts_tablet_manager.cc:1434] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:19:49.593371  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.594331  3405 raft_consensus.cc:2393] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 847cefe303d24f1a9b179d5e73c0b176 in current term 1: Already voted for candidate 21a7da760f914c22bc6e0f064fd0371a in this term.
I20260709 12:19:49.595983  3445 leader_election.cc:304] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847cefe303d24f1a9b179d5e73c0b176; no voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.599474  3525 raft_consensus.cc:2749] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.602118  3554 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.604290  3405 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.610880  3331 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.602840  3554 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.615039  3554 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.615309  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21a7da760f914c22bc6e0f064fd0371a" is_pre_election: true
I20260709 12:19:49.616987  3525 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.618278  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847cefe303d24f1a9b179d5e73c0b176" is_pre_election: true
I20260709 12:19:49.619067  3478 raft_consensus.cc:2393] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in current term 1: Already voted for candidate 21a7da760f914c22bc6e0f064fd0371a in this term.
I20260709 12:19:49.620397  3372 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:49.620219  3228 catalog_manager.cc:5697] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 1 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.624730  3531 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.624058  3228 catalog_manager.cc:5697] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 1 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.626062  3228 catalog_manager.cc:5697] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 1 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.632607  3590 consensus_queue.cc:1048] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.638072  3531 raft_consensus.cc:2749] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.645572  3524 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.662343  3330 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.672056  3531 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.673779  3226 catalog_manager.cc:5697] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 1 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.675894  3226 catalog_manager.cc:5697] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 0 to 1, leader changed from <none> to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 1 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.684214  3590 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.732093  3405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:19:49.732650  3405 raft_consensus.cc:606] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.743697  3405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:19:49.744190  3405 raft_consensus.cc:606] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:19:49.757320  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:47830
I20260709 12:19:49.757879  3330 raft_consensus.cc:606] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Received request to transfer leadership to TS 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.774652  3480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
mode: GRACEFUL
new_leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:39038
I20260709 12:19:49.775220  3480 raft_consensus.cc:606] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 LEADER]: Received request to transfer leadership to TS 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.781031  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:47830
I20260709 12:19:49.781589  3330 raft_consensus.cc:606] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Received request to transfer leadership to TS 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:19:49.786592  3405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:19:49.787072  3405 raft_consensus.cc:606] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Received request to transfer leadership to TS 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:49.810506  3590 consensus_queue.cc:1048] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.823390  3530 consensus_queue.cc:1048] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.870184  3530 raft_consensus.cc:993] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:19:49.870661  3530 raft_consensus.cc:1081] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:19:49.873221  3330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41514
I20260709 12:19:49.873347  3580 consensus_queue.cc:1048] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.873944  3330 raft_consensus.cc:493] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.874838  3330 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.876178  3580 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.881676  3575 raft_consensus.cc:993] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:49.882303  3575 raft_consensus.cc:1081] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Signalling peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:49.882930  3330 raft_consensus.cc:515] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.885689  3330 leader_election.cc:290] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.887157  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.887797  3478 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.884858  3405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:48696
I20260709 12:19:49.888862  3405 raft_consensus.cc:493] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.889395  3405 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.890177  3406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d5d738cc624f83bc2b0b50fb89c5b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:49.890789  3406 raft_consensus.cc:3055] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:49.891113  3406 raft_consensus.cc:740] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:49.891966  3406 consensus_queue.cc:260] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.893345  3406 raft_consensus.cc:3060] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.901250  3405 raft_consensus.cc:515] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.902537  3404 raft_consensus.cc:1240] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Rejecting Update request from peer 21a7da760f914c22bc6e0f064fd0371a for earlier term 1. Current term is 2. Ops: []
I20260709 12:19:49.904439  3405 leader_election.cc:290] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:49.904446  3575 consensus_queue.cc:1048] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.902340  3580 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:49.905604  3533 consensus_queue.cc:1059] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.906435  3533 raft_consensus.cc:3055] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:49.906803  3533 raft_consensus.cc:740] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.907697  3533 consensus_queue.cc:260] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.908183  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:49.908756  3479 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.909518  3533 raft_consensus.cc:3060] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.910284  3406 raft_consensus.cc:2468] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:19:49.911849  3478 raft_consensus.cc:2468] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:19:49.911892  3296 leader_election.cc:304] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:49.914146  3580 raft_consensus.cc:2804] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:49.914813  3580 raft_consensus.cc:697] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:49.915705  3580 consensus_queue.cc:237] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.917249  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c0d9c6ae0d44077b9b66583501c4df8" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:49.918421  3479 raft_consensus.cc:2468] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:19:49.919845  3372 leader_election.cc:304] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:49.920667  3531 raft_consensus.cc:2804] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:49.921176  3531 raft_consensus.cc:697] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:49.922080  3531 consensus_queue.cc:237] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:49.924366  3478 raft_consensus.cc:1240] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Rejecting Update request from peer 21a7da760f914c22bc6e0f064fd0371a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:19:49.931878  3227 catalog_manager.cc:5697] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 1 to 2, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 2 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.935143  3330 raft_consensus.cc:2468] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:19:49.941901  3533 consensus_queue.cc:1048] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.943639  3227 catalog_manager.cc:5697] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 1 to 2, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.953438  3575 consensus_queue.cc:1048] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.061172  3575 consensus_queue.cc:1048] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.072573  3533 consensus_queue.cc:1048] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.074970  3554 raft_consensus.cc:993] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:50.075484  3554 raft_consensus.cc:993] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:19:50.076001  3554 raft_consensus.cc:1081] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Signalling peer 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:50.077023  3554 raft_consensus.cc:1081] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:19:50.079053  3330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41514
I20260709 12:19:50.079630  3330 raft_consensus.cc:493] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.080004  3330 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.080470  3478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:43568
I20260709 12:19:50.081084  3478 raft_consensus.cc:493] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.081467  3478 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.087705  3533 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.088857  3478 raft_consensus.cc:515] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.089474  3330 raft_consensus.cc:515] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.091903  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:50.092460  3330 leader_election.cc:290] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:50.092545  3331 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.092986  3404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcc0e251552e40f6aea054d14b664e6b" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:50.093247  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:50.093638  3404 raft_consensus.cc:3055] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.093573  3478 leader_election.cc:290] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:50.094235  3404 raft_consensus.cc:740] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:50.095479  3480 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.095819  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:50.095412  3404 consensus_queue.cc:260] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.096419  3405 raft_consensus.cc:3055] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.096799  3405 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:50.097079  3404 raft_consensus.cc:3060] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.097711  3405 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.099004  3405 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.103477  3480 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:19:50.105036  3297 leader_election.cc:304] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:50.105728  3404 raft_consensus.cc:2468] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 2.
I20260709 12:19:50.106029  3533 raft_consensus.cc:2804] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.106635  3533 raft_consensus.cc:697] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:50.103348  3331 raft_consensus.cc:2468] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 2.
I20260709 12:19:50.108011  3445 leader_election.cc:304] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:50.108901  3580 raft_consensus.cc:993] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:50.108873  3525 raft_consensus.cc:2804] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.109431  3580 raft_consensus.cc:1081] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Signalling peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:50.109469  3525 raft_consensus.cc:697] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:19:50.110441  3525 consensus_queue.cc:237] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.111614  3405 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:19:50.107508  3533 consensus_queue.cc:237] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.119815  3406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:48696
I20260709 12:19:50.120417  3406 raft_consensus.cc:493] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.120772  3406 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.121438  3227 catalog_manager.cc:5697] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 1 to 2, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.122676  3226 catalog_manager.cc:5697] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 1 to 2, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 2 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.127784  3406 raft_consensus.cc:515] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.130708  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:50.131086  3567 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.133678  3406 leader_election.cc:290] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:50.133885  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:50.137151  3331 raft_consensus.cc:3055] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.137557  3331 raft_consensus.cc:740] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:50.138509  3331 consensus_queue.cc:260] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.139846  3331 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.143325  3525 raft_consensus.cc:993] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: : Instructing follower 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:50.143832  3524 raft_consensus.cc:1081] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 LEADER]: Signalling peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:19:50.145377  3406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:48692
I20260709 12:19:50.145851  3406 raft_consensus.cc:493] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.146176  3406 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.146584  3331 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:19:50.147688  3371 leader_election.cc:304] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:50.148502  3530 raft_consensus.cc:2804] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.149008  3530 raft_consensus.cc:697] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:50.149837  3530 consensus_queue.cc:237] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.152212  3406 raft_consensus.cc:515] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.154417  3406 leader_election.cc:290] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:19:50.156132  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:19:50.156440  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:50.156781  3478 raft_consensus.cc:3055] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.157068  3331 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.157164  3478 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:19:50.158229  3478 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.157966  3226 catalog_manager.cc:5697] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 1 to 2, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.159574  3478 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.162757  3331 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:19:50.164117  3371 leader_election.cc:304] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:19:50.164996  3530 raft_consensus.cc:2804] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.165234  3478 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:19:50.165458  3530 raft_consensus.cc:697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:19:50.166419  3530 consensus_queue.cc:237] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:50.173048  3226 catalog_manager.cc:5697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 1 to 2, leader changed from 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67) to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.318653  3478 raft_consensus.cc:1275] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.319975  3567 consensus_queue.cc:1048] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.327725  3406 raft_consensus.cc:1275] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.329335  3571 consensus_queue.cc:1048] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.350842  3478 raft_consensus.cc:1275] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.352149  3590 consensus_queue.cc:1048] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.362661  3331 raft_consensus.cc:1275] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.365692  3554 consensus_queue.cc:1048] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:50.566242  3406 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.567719  3575 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.576900  3478 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.578424  3571 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.654188  3406 raft_consensus.cc:1275] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.655818  3524 consensus_queue.cc:1048] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.674017  3331 raft_consensus.cc:1275] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.679153  3615 consensus_queue.cc:1048] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:50.684650  3330 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.687790  3554 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.704069  3478 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.705536  3531 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.746896  3331 raft_consensus.cc:1275] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.748277  3531 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.757651  3478 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.765558  3478 raft_consensus.cc:1275] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.766939  3619 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:52.821177  2677 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:19:52.821938  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.838912  3331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:19:52.839540  3331 raft_consensus.cc:606] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Received request to transfer leadership to TS 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:52.842080  3331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:19:52.842607  3331 raft_consensus.cc:606] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Received request to transfer leadership to TS 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:19:52.843751  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:52.844269  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.914078  3571 raft_consensus.cc:993] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:52.914593  3620 raft_consensus.cc:1081] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Signalling peer 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:52.916301  3480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:19:52.916851  3480 raft_consensus.cc:493] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.917181  3480 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.921972  3480 raft_consensus.cc:515] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:52.923717  3480 leader_election.cc:290] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 3 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:52.925009  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:52.925009  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:52.925926  3405 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.925949  3331 raft_consensus.cc:3055] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:52.926554  3331 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:52.927522  3331 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:52.928906  3331 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.934204  3405 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 3.
I20260709 12:19:52.935752  3445 leader_election.cc:304] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:52.936497  3615 raft_consensus.cc:2804] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:52.936384  3331 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 3.
I20260709 12:19:52.937886  3615 raft_consensus.cc:697] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:19:52.938786  3615 consensus_queue.cc:237] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:52.946377  3227 catalog_manager.cc:5697] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 2 to 3, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.218482  3620 raft_consensus.cc:993] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:53.219029  3571 raft_consensus.cc:1081] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Signalling peer 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:19:53.220644  3480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:19:53.221194  3480 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:53.221514  3480 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.226358  3480 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:53.228243  3480 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:19:53.229013  3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:19:53.229329  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:19:53.229655  3331 raft_consensus.cc:3055] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:53.229884  3405 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.230007  3331 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:19:53.230849  3331 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:53.231913  3331 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:53.234784  3405 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 2.
I20260709 12:19:53.235939  3445 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:19:53.236748  3615 raft_consensus.cc:2804] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:53.236806  3331 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 2.
I20260709 12:19:53.237349  3615 raft_consensus.cc:697] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:19:53.238207  3615 consensus_queue.cc:237] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:19:53.245676  3227 catalog_manager.cc:5697] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 1 to 2, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.319964  3405 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:53.321566  3615 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:53.334511  3331 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:53.336148  3623 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:53.724859  3330 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.726428  3623 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.736258  3405 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.738158  3615 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.845454  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.851348  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:53.851864  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:55.352610  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:55.360016  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:55.360553  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:19:55.406639  3352 debug-util.cc:398] Leaking SignalData structure 0x7b0800197d00 after lost signal to thread 2680
W20260709 12:19:55.407595  3352 debug-util.cc:398] Leaking SignalData structure 0x7b080014af00 after lost signal to thread 3263
W20260709 12:19:55.408548  3352 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec060 after lost signal to thread 3355
W20260709 12:19:55.409286  3352 debug-util.cc:398] Leaking SignalData structure 0x7b080018fb40 after lost signal to thread 3430
W20260709 12:19:55.409996  3352 debug-util.cc:398] Leaking SignalData structure 0x7b08001fcfc0 after lost signal to thread 3504
I20260709 12:19:56.362426  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:56.370563  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:56.371063  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:57.372321  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:57.377822  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:57.378310  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:58.379350  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:58.385357  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:58.386000  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:59.387109  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:59.393308  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:59.393808  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:00.394809  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:00.401513  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:00.401978  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:01.403028  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:01.409876  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:01.410369  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:02.411368  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:02.416988  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:02.417461  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:03.450809  2677 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:20:03.463536  3478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:39038
I20260709 12:20:03.464310  3478 raft_consensus.cc:606] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:20:03.470042  3478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:39038
I20260709 12:20:03.470558  3478 raft_consensus.cc:606] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:20:03.475775  3403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:20:03.476372  3403 raft_consensus.cc:606] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:20:03.481750  3403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:20:03.482347  3403 raft_consensus.cc:606] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:20:03.487411  3403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
mode: GRACEFUL
new_leader_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:20:03.487995  3403 raft_consensus.cc:606] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Received request to transfer leadership to TS 21a7da760f914c22bc6e0f064fd0371a
I20260709 12:20:03.652648  3642 raft_consensus.cc:993] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.653231  3651 raft_consensus.cc:1081] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.655110  3331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41514
I20260709 12:20:03.655670  3331 raft_consensus.cc:493] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.656020  3331 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.661803  3331 raft_consensus.cc:515] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.664098  3331 leader_election.cc:290] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:03.665354  3403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:03.665383  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dfa950e1ef248bc9d27637de0940f17" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:03.666376  3403 raft_consensus.cc:3055] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:03.666477  3478 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.666914  3403 raft_consensus.cc:740] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:20:03.668089  3403 consensus_queue.cc:260] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.669618  3403 raft_consensus.cc:3060] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:03.672379  3478 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:20:03.673923  3297 leader_election.cc:304] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:03.675055  3649 raft_consensus.cc:2804] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:03.676254  3649 raft_consensus.cc:697] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:03.676472  3403 raft_consensus.cc:2468] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 2.
I20260709 12:20:03.677485  3649 consensus_queue.cc:237] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.693066  3226 catalog_manager.cc:5697] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 1 to 2, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 2 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.749744  3642 raft_consensus.cc:993] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.750236  3651 raft_consensus.cc:1081] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.751873  3330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41514
I20260709 12:20:03.752498  3330 raft_consensus.cc:493] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.752821  3330 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.758073  3330 raft_consensus.cc:515] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.759917  3330 leader_election.cc:290] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:03.760831  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:03.760842  3403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:03.761423  3478 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.761565  3403 raft_consensus.cc:3055] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.761943  3403 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:20:03.762699  3403 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.763793  3403 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.766338  3478 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.767380  3297 leader_election.cc:304] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:03.768136  3649 raft_consensus.cc:2804] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.768604  3649 raft_consensus.cc:697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:03.769852  3403 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.769634  3649 consensus_queue.cc:237] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.777999  3226 catalog_manager.cc:5697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 2 to 3, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 3 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.807312  3659 raft_consensus.cc:993] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.807605  3660 raft_consensus.cc:993] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.808075  3647 raft_consensus.cc:1081] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.808239  3659 raft_consensus.cc:1081] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.810056  3331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41508
I20260709 12:20:03.810698  3331 raft_consensus.cc:493] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.810680  3330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41508
I20260709 12:20:03.811205  3331 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.811347  3330 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.811949  3330 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.816447  3331 raft_consensus.cc:515] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.817448  3330 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.818425  3331 leader_election.cc:290] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 4 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:03.819391  3403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:03.819777  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8071bc88755c4d9da6eb10c01e2b3694" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:03.820116  3403 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.820364  3478 raft_consensus.cc:3055] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:03.820735  3478 raft_consensus.cc:740] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:20:03.821516  3478 consensus_queue.cc:260] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.822381  3330 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:03.822767  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:03.823515  3480 raft_consensus.cc:3055] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.823848  3480 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:20:03.822853  3478 raft_consensus.cc:3060] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:03.824707  3480 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.822769  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:03.826179  3480 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.826601  3405 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.829484  3403 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 4.
I20260709 12:20:03.831110  3478 raft_consensus.cc:2468] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 4.
I20260709 12:20:03.831274  3296 leader_election.cc:304] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 2a7b5bcf9d4f48ec9eb80b9df7b9ab97; no voters: 
I20260709 12:20:03.833009  3649 raft_consensus.cc:2804] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:03.833508  3649 raft_consensus.cc:697] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 4 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:03.833544  3480 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.834906  3297 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:03.834596  3649 consensus_queue.cc:237] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.835153  3405 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.835784  3652 raft_consensus.cc:2804] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.837280  3652 raft_consensus.cc:697] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:03.838060  3652 consensus_queue.cc:237] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.843297  3226 catalog_manager.cc:5697] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 3 to 4, leader changed from 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 4 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.855273  3226 catalog_manager.cc:5697] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 2 to 3, leader changed from 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 3 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:03.903331  3642 raft_consensus.cc:993] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: : Instructing follower 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.903904  3651 raft_consensus.cc:1081] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Signalling peer 21a7da760f914c22bc6e0f064fd0371a to start an election
I20260709 12:20:03.905437  3330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
 from {username='slave'} at 127.0.0.1:41514
I20260709 12:20:03.906033  3330 raft_consensus.cc:493] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.906306  3330 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.911214  3330 raft_consensus.cc:515] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.912932  3330 leader_election.cc:290] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Requested vote from peers 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:03.913980  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:03.914002  3405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f260b5d24045cab281430163b9d7b6" candidate_uuid: "21a7da760f914c22bc6e0f064fd0371a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:03.914526  3480 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.914646  3405 raft_consensus.cc:3055] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:03.915019  3405 raft_consensus.cc:740] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:20:03.915835  3405 consensus_queue.cc:260] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.916919  3405 raft_consensus.cc:3060] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:03.919713  3480 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.920727  3297 leader_election.cc:304] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:03.921557  3652 raft_consensus.cc:2804] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:03.921967  3652 raft_consensus.cc:697] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Becoming Leader. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:03.922585  3405 raft_consensus.cc:2468] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21a7da760f914c22bc6e0f064fd0371a in term 3.
I20260709 12:20:03.922828  3652 consensus_queue.cc:237] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:03.932155  3226 catalog_manager.cc:5697] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a reported cstate change: term changed from 2 to 3, leader changed from 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66) to 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65). New cstate: current_term: 3 leader_uuid: "21a7da760f914c22bc6e0f064fd0371a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.076050  3405 raft_consensus.cc:1275] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.077620  3652 consensus_queue.cc:1048] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.088860  3480 raft_consensus.cc:1275] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:04.095322  3652 consensus_queue.cc:1048] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.276172  3478 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.278120  3671 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:04.290485  3406 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.291113  3403 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.291731  3480 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.292943  3649 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.293233  3671 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:04.292912  3405 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.296442  3649 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.299718  3649 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.335232  3480 raft_consensus.cc:1275] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:04.339694  3662 consensus_queue.cc:1048] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:04.441526  3480 raft_consensus.cc:1275] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.442829  3662 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:04.454049  3403 raft_consensus.cc:1275] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Refusing update from remote peer 21a7da760f914c22bc6e0f064fd0371a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:04.455741  3649 consensus_queue.cc:1048] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:05.178038  3260 debug-util.cc:398] Leaking SignalData structure 0x7b0800050ae0 after lost signal to thread 2680
W20260709 12:20:05.179018  3260 debug-util.cc:398] Leaking SignalData structure 0x7b080004f200 after lost signal to thread 3263
W20260709 12:20:05.180001  3260 debug-util.cc:398] Leaking SignalData structure 0x7b080017e760 after lost signal to thread 3355
W20260709 12:20:05.180783  3260 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6440 after lost signal to thread 3430
W20260709 12:20:05.181478  3260 debug-util.cc:398] Leaking SignalData structure 0x7b080009d9c0 after lost signal to thread 3504
I20260709 12:20:06.549202  2677 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:20:06.550491  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.563103  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:20:06.564265  3330 raft_consensus.cc:606] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Received request to transfer leadership to TS 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:20:06.567817  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b708456509284106a26c3817795d96e5"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:20:06.568477  3330 raft_consensus.cc:606] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Received request to transfer leadership to TS 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:20:06.571205  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:20:06.571837  3330 raft_consensus.cc:606] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Received request to transfer leadership to TS 2a7b5bcf9d4f48ec9eb80b9df7b9ab97
I20260709 12:20:06.574617  3330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
mode: GRACEFUL
new_leader_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:47844
I20260709 12:20:06.575230  3330 raft_consensus.cc:606] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Received request to transfer leadership to TS 847cefe303d24f1a9b179d5e73c0b176
I20260709 12:20:06.576642  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:06.577252  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:06.711246  3662 raft_consensus.cc:993] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:20:06.711908  3680 raft_consensus.cc:1081] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Signalling peer 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:20:06.713804  3478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:20:06.714334  3478 raft_consensus.cc:493] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.714753  3478 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.727159  3478 raft_consensus.cc:515] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.729689  3478 leader_election.cc:290] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 4 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:20:06.730811  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:20:06.731632  3330 raft_consensus.cc:3055] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:06.731484  3403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e5cd815aded4a63b07b41e3f4431fe7" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:06.731935  3330 raft_consensus.cc:740] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:06.732136  3403 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.732698  3330 consensus_queue.cc:260] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.734295  3330 raft_consensus.cc:3060] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.740268  3330 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 4.
I20260709 12:20:06.740744  3403 raft_consensus.cc:2468] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 4.
I20260709 12:20:06.741875  3445 leader_election.cc:304] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21a7da760f914c22bc6e0f064fd0371a, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:06.742867  3647 raft_consensus.cc:2804] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:06.744201  3647 raft_consensus.cc:697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:20:06.745288  3647 consensus_queue.cc:237] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.757277  3227 catalog_manager.cc:5697] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 3 to 4, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.807077  3682 raft_consensus.cc:993] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:20:06.807595  3662 raft_consensus.cc:1081] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Signalling peer 847cefe303d24f1a9b179d5e73c0b176 to start an election
I20260709 12:20:06.809289  3478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5c3027e5185488cab81539041d29126"
dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:20:06.809813  3478 raft_consensus.cc:493] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.810117  3478 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.816287  3478 raft_consensus.cc:515] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.818256  3478 leader_election.cc:290] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 4 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889)
I20260709 12:20:06.819144  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:20:06.819504  3403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c3027e5185488cab81539041d29126" candidate_uuid: "847cefe303d24f1a9b179d5e73c0b176" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
I20260709 12:20:06.819816  3330 raft_consensus.cc:3055] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:06.820168  3403 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.820170  3330 raft_consensus.cc:740] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:06.821228  3330 consensus_queue.cc:260] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.822585  3330 raft_consensus.cc:3060] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:06.825850  3403 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 4.
I20260709 12:20:06.827172  3445 leader_election.cc:304] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:06.828037  3647 raft_consensus.cc:2804] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:06.828632  3647 raft_consensus.cc:697] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 LEADER]: Becoming Leader. State: Replica: 847cefe303d24f1a9b179d5e73c0b176, State: Running, Role: LEADER
I20260709 12:20:06.829613  3647 consensus_queue.cc:237] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.832150  3330 raft_consensus.cc:2468] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847cefe303d24f1a9b179d5e73c0b176 in term 4.
I20260709 12:20:06.838575  3227 catalog_manager.cc:5697] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 reported cstate change: term changed from 3 to 4, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "847cefe303d24f1a9b179d5e73c0b176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.841481  3662 raft_consensus.cc:993] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:20:06.842070  3680 raft_consensus.cc:1081] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Signalling peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:20:06.843969  3403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:48696
I20260709 12:20:06.844455  3403 raft_consensus.cc:493] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.844833  3403 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.850606  3403 raft_consensus.cc:515] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:20:06.853238  3403 leader_election.cc:290] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Requested vote from peers 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097), 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025)
I20260709 12:20:06.853873  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:20:06.853899  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded85a0d21be4283922bc3b0b7b38551" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:06.854628  3330 raft_consensus.cc:3055] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.854868  3478 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.854987  3330 raft_consensus.cc:740] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:06.855973  3330 consensus_queue.cc:260] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:20:06.857622  3330 raft_consensus.cc:3060] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.860064  3478 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:20:06.861780  3372 leader_election.cc:304] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:06.862632  3651 raft_consensus.cc:2804] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.864192  3651 raft_consensus.cc:697] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:20:06.865480  3330 raft_consensus.cc:2468] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:20:06.865293  3651 consensus_queue.cc:237] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } }
I20260709 12:20:06.875066  3227 catalog_manager.cc:5697] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 1 to 2, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.890152  3680 raft_consensus.cc:993] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: : Instructing follower 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:20:06.890669  3682 raft_consensus.cc:1081] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Signalling peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 to start an election
I20260709 12:20:06.892441  3403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b708456509284106a26c3817795d96e5"
dest_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97"
 from {username='slave'} at 127.0.0.1:48696
I20260709 12:20:06.892947  3403 raft_consensus.cc:493] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.893316  3403 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.898272  3403 raft_consensus.cc:515] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.899945  3403 leader_election.cc:290] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Requested vote from peers 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025), 847cefe303d24f1a9b179d5e73c0b176 (127.2.157.67:44097)
I20260709 12:20:06.901228  3478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847cefe303d24f1a9b179d5e73c0b176"
I20260709 12:20:06.901062  3330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b708456509284106a26c3817795d96e5" candidate_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21a7da760f914c22bc6e0f064fd0371a"
I20260709 12:20:06.901875  3478 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.901966  3330 raft_consensus.cc:3055] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.902376  3330 raft_consensus.cc:740] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21a7da760f914c22bc6e0f064fd0371a, State: Running, Role: LEADER
I20260709 12:20:06.903192  3330 consensus_queue.cc:260] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.904525  3330 raft_consensus.cc:3060] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.906970  3478 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:20:06.908152  3372 leader_election.cc:304] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, 847cefe303d24f1a9b179d5e73c0b176; no voters: 
I20260709 12:20:06.908985  3651 raft_consensus.cc:2804] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.909488  3651 raft_consensus.cc:697] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Becoming Leader. State: Replica: 2a7b5bcf9d4f48ec9eb80b9df7b9ab97, State: Running, Role: LEADER
I20260709 12:20:06.910465  3651 consensus_queue.cc:237] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } }
I20260709 12:20:06.911499  3330 raft_consensus.cc:2468] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 in term 2.
I20260709 12:20:06.919710  3227 catalog_manager.cc:5697] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 reported cstate change: term changed from 1 to 2, leader changed from 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65) to 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.134202  3330 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.135779  3647 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:07.155655  3403 raft_consensus.cc:1275] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.157452  3647 consensus_queue.cc:1048] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:07.320102  3330 raft_consensus.cc:1275] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.321667  3651 consensus_queue.cc:1048] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.332173  3478 raft_consensus.cc:1275] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.333814  3651 consensus_queue.cc:1048] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.374914  3403 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.376292  3647 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a7b5bcf9d4f48ec9eb80b9df7b9ab97" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 36889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:07.391595  3330 raft_consensus.cc:1275] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Refusing update from remote peer 847cefe303d24f1a9b179d5e73c0b176: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:07.393577  3647 consensus_queue.cc:1048] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:07.403700  3478 raft_consensus.cc:1275] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.405377  3690 consensus_queue.cc:1048] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847cefe303d24f1a9b179d5e73c0b176" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.427412  3330 raft_consensus.cc:1275] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Refusing update from remote peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.429189  3690 consensus_queue.cc:1048] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a7da760f914c22bc6e0f064fd0371a" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.578480  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.584230  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:07.584702  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:08.585876  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.591553  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:08.591971  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:09.592932  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:09.599687  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:09.600108  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:10.601148  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.607929  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:10.608359  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:11.609241  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:11.615558  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:11.616154  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:12.617149  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:12.622912  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:12.623349  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:13.624385  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:13.630450  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:13.631034  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:14.632145  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.637840  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:14.638307  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:15.639240  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.645602  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:15.646166  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:16.682832  2677 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:20:16.683396  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
W20260709 12:20:16.704734  3445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:20:16.708882  3445 consensus_peers.cc:597] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 -> Peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Couldn't send request to peer 21a7da760f914c22bc6e0f064fd0371a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.716320  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:16.717196  2677 tablet_replica.cc:333] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.717967  2677 raft_consensus.cc:2243] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.719084  2677 raft_consensus.cc:2272] T 8071bc88755c4d9da6eb10c01e2b3694 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.721370  2677 tablet_replica.cc:333] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.721903  2677 raft_consensus.cc:2243] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.722419  2677 raft_consensus.cc:2272] T b708456509284106a26c3817795d96e5 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.724412  2677 tablet_replica.cc:333] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.724970  2677 raft_consensus.cc:2243] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.726089  2677 raft_consensus.cc:2272] T 4dfa950e1ef248bc9d27637de0940f17 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.728052  2677 tablet_replica.cc:333] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.728529  2677 raft_consensus.cc:2243] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.728945  2677 raft_consensus.cc:2272] T ded85a0d21be4283922bc3b0b7b38551 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.730803  2677 tablet_replica.cc:333] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.731346  2677 raft_consensus.cc:2243] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.732002  2677 raft_consensus.cc:2272] T bcc0e251552e40f6aea054d14b664e6b P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.734109  2677 tablet_replica.cc:333] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.734582  2677 raft_consensus.cc:2243] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.735101  2677 raft_consensus.cc:2272] T 4c0d9c6ae0d44077b9b66583501c4df8 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.737125  2677 tablet_replica.cc:333] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.737574  2677 raft_consensus.cc:2243] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.738379  2677 raft_consensus.cc:2272] T c6f260b5d24045cab281430163b9d7b6 P 21a7da760f914c22bc6e0f064fd0371a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.740316  2677 tablet_replica.cc:333] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.740757  2677 raft_consensus.cc:2243] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.741549  2677 raft_consensus.cc:2272] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 21a7da760f914c22bc6e0f064fd0371a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.743337  2677 tablet_replica.cc:333] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.743855  2677 raft_consensus.cc:2243] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.744293  2677 raft_consensus.cc:2272] T 5e5cd815aded4a63b07b41e3f4431fe7 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.746137  2677 tablet_replica.cc:333] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a: stopping tablet replica
I20260709 12:20:16.746543  2677 raft_consensus.cc:2243] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.746904  2677 raft_consensus.cc:2272] T e5c3027e5185488cab81539041d29126 P 21a7da760f914c22bc6e0f064fd0371a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:16.759352  3445 consensus_peers.cc:597] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 -> Peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Couldn't send request to peer 21a7da760f914c22bc6e0f064fd0371a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.799177  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
I20260709 12:20:16.823833  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:20:16.845402  3445 consensus_peers.cc:597] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 -> Peer 21a7da760f914c22bc6e0f064fd0371a (127.2.157.65:42025): Couldn't send request to peer 21a7da760f914c22bc6e0f064fd0371a. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.858654  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:16.859622  2677 tablet_replica.cc:333] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.860647  2677 raft_consensus.cc:2243] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.861676  2677 raft_consensus.cc:2272] T ded85a0d21be4283922bc3b0b7b38551 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.864022  2677 tablet_replica.cc:333] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.864745  2677 raft_consensus.cc:2243] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.865752  2677 raft_consensus.cc:2272] T b708456509284106a26c3817795d96e5 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.867913  2677 tablet_replica.cc:333] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.868512  2677 raft_consensus.cc:2243] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.869031  2677 raft_consensus.cc:2272] T 4dfa950e1ef248bc9d27637de0940f17 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.871090  2677 tablet_replica.cc:333] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.871768  2677 raft_consensus.cc:2243] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.872705  2677 raft_consensus.cc:2272] T 4c0d9c6ae0d44077b9b66583501c4df8 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.874629  2677 tablet_replica.cc:333] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.875270  2677 raft_consensus.cc:2243] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.875895  2677 raft_consensus.cc:2272] T c6f260b5d24045cab281430163b9d7b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.877779  2677 tablet_replica.cc:333] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.878329  2677 raft_consensus.cc:2243] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.878758  2677 raft_consensus.cc:2272] T bcc0e251552e40f6aea054d14b664e6b P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.880576  2677 tablet_replica.cc:333] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.881063  2677 raft_consensus.cc:2243] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.881436  2677 raft_consensus.cc:2272] T 8071bc88755c4d9da6eb10c01e2b3694 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.883095  2677 tablet_replica.cc:333] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.883615  2677 raft_consensus.cc:2243] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.884011  2677 raft_consensus.cc:2272] T 5e5cd815aded4a63b07b41e3f4431fe7 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.885811  2677 tablet_replica.cc:333] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.886229  2677 raft_consensus.cc:2243] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.886646  2677 raft_consensus.cc:2272] T e5c3027e5185488cab81539041d29126 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.888299  2677 tablet_replica.cc:333] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97: stopping tablet replica
I20260709 12:20:16.888687  2677 raft_consensus.cc:2243] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.889043  2677 raft_consensus.cc:2272] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:16.893867  3445 consensus_peers.cc:597] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 -> Peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Couldn't send request to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.920467  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
I20260709 12:20:16.942744  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
W20260709 12:20:16.971395  3445 consensus_peers.cc:597] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 -> Peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97 (127.2.157.66:36889): Couldn't send request to peer 2a7b5bcf9d4f48ec9eb80b9df7b9ab97. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:36889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.974483  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:16.975251  2677 tablet_replica.cc:333] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.976091  2677 raft_consensus.cc:2243] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.976775  2677 raft_consensus.cc:2272] T b708456509284106a26c3817795d96e5 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.978745  2677 tablet_replica.cc:333] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.979295  2677 raft_consensus.cc:2243] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.979765  2677 raft_consensus.cc:2272] T 4dfa950e1ef248bc9d27637de0940f17 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.981498  2677 tablet_replica.cc:333] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.981963  2677 raft_consensus.cc:2243] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.982376  2677 raft_consensus.cc:2272] T 8071bc88755c4d9da6eb10c01e2b3694 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.984197  2677 tablet_replica.cc:333] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.984685  2677 raft_consensus.cc:2243] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.985472  2677 raft_consensus.cc:2272] T e5c3027e5185488cab81539041d29126 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.987299  2677 tablet_replica.cc:333] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.987850  2677 raft_consensus.cc:2243] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.988245  2677 raft_consensus.cc:2272] T b6d5d738cc624f83bc2b0b50fb89c5b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.989890  2677 tablet_replica.cc:333] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.990343  2677 raft_consensus.cc:2243] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:16.991079  2677 raft_consensus.cc:2272] T 5e5cd815aded4a63b07b41e3f4431fe7 P 847cefe303d24f1a9b179d5e73c0b176 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.992805  2677 tablet_replica.cc:333] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.993304  2677 raft_consensus.cc:2243] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.993682  2677 raft_consensus.cc:2272] T ded85a0d21be4283922bc3b0b7b38551 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.995225  2677 tablet_replica.cc:333] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.995728  2677 raft_consensus.cc:2243] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.996171  2677 raft_consensus.cc:2272] T c6f260b5d24045cab281430163b9d7b6 P 847cefe303d24f1a9b179d5e73c0b176 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.997907  2677 tablet_replica.cc:333] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:16.998334  2677 raft_consensus.cc:2243] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.998687  2677 raft_consensus.cc:2272] T 4c0d9c6ae0d44077b9b66583501c4df8 P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.000350  2677 tablet_replica.cc:333] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176: stopping tablet replica
I20260709 12:20:17.000735  2677 raft_consensus.cc:2243] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.001508  2677 raft_consensus.cc:2272] T bcc0e251552e40f6aea054d14b664e6b P 847cefe303d24f1a9b179d5e73c0b176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.031984  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
I20260709 12:20:17.051791  2677 master.cc:562] Master@127.2.157.126:38489 shutting down...
I20260709 12:20:17.077221  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:17.077905  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.078256  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P 80112ba06c65479c8dcd8f7dfce2b10a: stopping tablet replica
I20260709 12:20:17.118384  2677 master.cc:584] Master@127.2.157.126:38489 shutdown complete.
21a7da760f914c22bc6e0f064fd0371a  5
2a7b5bcf9d4f48ec9eb80b9df7b9ab97  4
847cefe303d24f1a9b179d5e73c0b176  1
21a7da760f914c22bc6e0f064fd0371a  3
2a7b5bcf9d4f48ec9eb80b9df7b9ab97  4
847cefe303d24f1a9b179d5e73c0b176  3
21a7da760f914c22bc6e0f064fd0371a  8
2a7b5bcf9d4f48ec9eb80b9df7b9ab97  1
847cefe303d24f1a9b179d5e73c0b176  1
21a7da760f914c22bc6e0f064fd0371a  4
2a7b5bcf9d4f48ec9eb80b9df7b9ab97  3
847cefe303d24f1a9b179d5e73c0b176  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29327 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:20:17.163558  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:36337
I20260709 12:20:17.164804  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.170434  3723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.172323  3724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.172546  2677 server_base.cc:1061] running on GCE node
W20260709 12:20:17.172537  3726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.173888  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.174158  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.174331  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599617174316 us; error 0 us; skew 500 ppm
I20260709 12:20:17.174912  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.177660  2677 webserver.cc:533] Webserver started at http://127.2.157.126:46629/ using document root <none> and password file <none>
I20260709 12:20:17.178228  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.178422  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.178730  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.180164  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "8bd543252a59424d81c6f755d59f4ddf"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.184865  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:17.188550  3731 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.189347  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:17.189668  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "8bd543252a59424d81c6f755d59f4ddf"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.189961  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.213469  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.214941  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.255595  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:36337
I20260709 12:20:17.255712  3782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:36337 every 8 connection(s)
I20260709 12:20:17.259738  3783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.270005  3783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Bootstrap starting.
I20260709 12:20:17.274848  3783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:17.279277  3783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: No bootstrap required, opened a new log
I20260709 12:20:17.281515  3783 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER }
I20260709 12:20:17.281942  3783 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:17.282133  3783 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd543252a59424d81c6f755d59f4ddf, State: Initialized, Role: FOLLOWER
I20260709 12:20:17.282706  3783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER }
I20260709 12:20:17.283164  3783 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:17.283368  3783 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:17.283672  3783 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:17.287909  3783 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER }
I20260709 12:20:17.288496  3783 leader_election.cc:304] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bd543252a59424d81c6f755d59f4ddf; no voters: 
I20260709 12:20:17.289831  3783 leader_election.cc:290] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:17.290264  3786 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:17.291668  3786 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 1 LEADER]: Becoming Leader. State: Replica: 8bd543252a59424d81c6f755d59f4ddf, State: Running, Role: LEADER
I20260709 12:20:17.292466  3786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER }
I20260709 12:20:17.293134  3783 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:17.297281  3787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bd543252a59424d81c6f755d59f4ddf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER } }
I20260709 12:20:17.297726  3788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bd543252a59424d81c6f755d59f4ddf. Latest consensus state: current_term: 1 leader_uuid: "8bd543252a59424d81c6f755d59f4ddf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bd543252a59424d81c6f755d59f4ddf" member_type: VOTER } }
I20260709 12:20:17.298059  3787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:17.300063  3788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:17.300200  3793 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:17.308786  3793 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:17.309868  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:17.318753  3793 catalog_manager.cc:1383] Generated new cluster ID: 525233c722424047abf982c4d18c66ab
I20260709 12:20:17.319063  3793 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:17.333204  3793 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:17.334496  3793 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:17.348599  3793 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Generated new TSK 0
I20260709 12:20:17.349292  3793 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:17.376667  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.382928  3804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.384490  3805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.387431  3807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.387753  2677 server_base.cc:1061] running on GCE node
I20260709 12:20:17.388782  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.389003  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.389185  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599617389166 us; error 0 us; skew 500 ppm
I20260709 12:20:17.389737  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.392378  2677 webserver.cc:533] Webserver started at http://127.2.157.65:44617/ using document root <none> and password file <none>
I20260709 12:20:17.392882  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.393100  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.393375  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.394577  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "bd47d64594f743eba2922d79251c1c5c"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.400473  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:20:17.403934  3812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.404814  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:17.405210  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "bd47d64594f743eba2922d79251c1c5c"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.405577  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.417685  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.418972  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.420603  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.423194  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.423381  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.423730  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.423913  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.466665  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:37307
I20260709 12:20:17.466732  3874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:37307 every 8 connection(s)
I20260709 12:20:17.471917  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.479700  3879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.482935  3880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.484112  3882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.484565  2677 server_base.cc:1061] running on GCE node
I20260709 12:20:17.485611  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.485901  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.486159  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599617486137 us; error 0 us; skew 500 ppm
I20260709 12:20:17.486722  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.489601  3875 heartbeater.cc:344] Connected to a master server at 127.2.157.126:36337
I20260709 12:20:17.489758  2677 webserver.cc:533] Webserver started at http://127.2.157.66:44219/ using document root <none> and password file <none>
I20260709 12:20:17.489971  3875 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.490433  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.490695  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.490864  3875 heartbeater.cc:507] Master 127.2.157.126:36337 requested a full tablet report, sending...
I20260709 12:20:17.490984  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.492497  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.493223  3748 ts_manager.cc:194] Registered new tserver with Master: bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:17.495152  3748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57290
I20260709 12:20:17.497769  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:17.501497  3887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.502351  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:17.502686  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.503014  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.516412  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.517714  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.519224  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.521633  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.521885  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.522152  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.522336  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.563212  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:38799
I20260709 12:20:17.563323  3949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:38799 every 8 connection(s)
I20260709 12:20:17.568095  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:17.575922  3953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:17.578537  3954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.579628  2677 server_base.cc:1061] running on GCE node
W20260709 12:20:17.580406  3956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:17.581660  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:17.581885  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:17.582136  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599617582107 us; error 0 us; skew 500 ppm
I20260709 12:20:17.582921  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:17.582913  3950 heartbeater.cc:344] Connected to a master server at 127.2.157.126:36337
I20260709 12:20:17.583541  3950 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.584528  3950 heartbeater.cc:507] Master 127.2.157.126:36337 requested a full tablet report, sending...
I20260709 12:20:17.585963  2677 webserver.cc:533] Webserver started at http://127.2.157.67:39445/ using document root <none> and password file <none>
I20260709 12:20:17.586678  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:17.586946  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:17.587301  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:17.587270  3748 ts_manager.cc:194] Registered new tserver with Master: 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:17.589180  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "32d706e2535f4fa19a09382d4edac677"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.589425  3748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57298
I20260709 12:20:17.594755  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:20:17.598662  3961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.599653  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:17.600001  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "32d706e2535f4fa19a09382d4edac677"
format_stamp: "Formatted at 2026-07-09 12:20:17 on dist-test-slave-sx71"
I20260709 12:20:17.600335  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:17.628980  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:17.630354  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:17.632010  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:17.634696  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:17.634959  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.635236  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:17.635433  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:17.680203  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:35865
I20260709 12:20:17.680331  4023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:35865 every 8 connection(s)
I20260709 12:20:17.695350  4024 heartbeater.cc:344] Connected to a master server at 127.2.157.126:36337
I20260709 12:20:17.695801  4024 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:17.696557  4024 heartbeater.cc:507] Master 127.2.157.126:36337 requested a full tablet report, sending...
I20260709 12:20:17.698470  3748 ts_manager.cc:194] Registered new tserver with Master: 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:17.698576  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015152202s
I20260709 12:20:17.699994  3748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57314
I20260709 12:20:17.726534  3748 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:17.733351  3748 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:17.957413  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 565a1813fc6b4a21aa0897f0624b5122 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:17.958150  3840 tablet_service.cc:1511] Processing CreateTablet for tablet ce77a1e41f7b43cc965d6fd6976759cd (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:17.959092  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565a1813fc6b4a21aa0897f0624b5122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.959733  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce77a1e41f7b43cc965d6fd6976759cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.960824  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 99966b4924ae49f889200899350931bb (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:17.962663  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99966b4924ae49f889200899350931bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.965045  3836 tablet_service.cc:1511] Processing CreateTablet for tablet 610ee9fca78e4559ab9cde25d14edade (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:17.966939  3836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ee9fca78e4559ab9cde25d14edade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.969287  3835 tablet_service.cc:1511] Processing CreateTablet for tablet e029f255cf96482eb49b53e7dc7ed25d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:17.969578  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc6b8b0d8114762a0c8cec5e5461a82 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:17.971297  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc6b8b0d8114762a0c8cec5e5461a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.971802  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 565a1813fc6b4a21aa0897f0624b5122 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:17.973372  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565a1813fc6b4a21aa0897f0624b5122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.972851  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc6b8b0d8114762a0c8cec5e5461a82 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:17.971319  3835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f255cf96482eb49b53e7dc7ed25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.977151  3987 tablet_service.cc:1511] Processing CreateTablet for tablet 99966b4924ae49f889200899350931bb (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:17.977324  3834 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:17.977404  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 610ee9fca78e4559ab9cde25d14edade (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:17.978832  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99966b4924ae49f889200899350931bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.978852  3834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.969800  3989 tablet_service.cc:1511] Processing CreateTablet for tablet ce77a1e41f7b43cc965d6fd6976759cd (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:17.981071  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce77a1e41f7b43cc965d6fd6976759cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.985450  3984 tablet_service.cc:1511] Processing CreateTablet for tablet e029f255cf96482eb49b53e7dc7ed25d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:17.987128  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f255cf96482eb49b53e7dc7ed25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.987491  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc6b8b0d8114762a0c8cec5e5461a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.991844  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ee9fca78e4559ab9cde25d14edade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.991384  3833 tablet_service.cc:1511] Processing CreateTablet for tablet 2900e71c0212466e8be300d30595c609 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:17.994529  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:17.995986  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:17.994974  3833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2900e71c0212466e8be300d30595c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.007926  3832 tablet_service.cc:1511] Processing CreateTablet for tablet f3bacd87db564c3ba5256af726514f84 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:18.008764  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 2900e71c0212466e8be300d30595c609 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:18.009493  3832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bacd87db564c3ba5256af726514f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.010169  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2900e71c0212466e8be300d30595c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.014062  3831 tablet_service.cc:1511] Processing CreateTablet for tablet c9cb9cc431d048dd8cfea736da6af5fa (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:18.015905  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cb9cc431d048dd8cfea736da6af5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.018285  3981 tablet_service.cc:1511] Processing CreateTablet for tablet f3bacd87db564c3ba5256af726514f84 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:18.019903  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bacd87db564c3ba5256af726514f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.030133  4039 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.046614  3986 tablet_service.cc:1511] Processing CreateTablet for tablet c9cb9cc431d048dd8cfea736da6af5fa (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:18.048211  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cb9cc431d048dd8cfea736da6af5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.048393  4039 tablet_bootstrap.cc:654] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.056032  3915 tablet_service.cc:1511] Processing CreateTablet for tablet ce77a1e41f7b43cc965d6fd6976759cd (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:18.057607  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce77a1e41f7b43cc965d6fd6976759cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.060915  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 565a1813fc6b4a21aa0897f0624b5122 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:18.062537  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565a1813fc6b4a21aa0897f0624b5122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.062489  3910 tablet_service.cc:1511] Processing CreateTablet for tablet e029f255cf96482eb49b53e7dc7ed25d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:18.064792  3911 tablet_service.cc:1511] Processing CreateTablet for tablet 610ee9fca78e4559ab9cde25d14edade (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:18.067073  3912 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc6b8b0d8114762a0c8cec5e5461a82 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:18.069429  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 99966b4924ae49f889200899350931bb (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:18.074606  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f255cf96482eb49b53e7dc7ed25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.077014  3831 tablet_service.cc:1511] Processing CreateTablet for tablet f9a206840e1648aeb4571019fa4ca639 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:18.078604  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a206840e1648aeb4571019fa4ca639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.084758  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ee9fca78e4559ab9cde25d14edade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.087308  3980 tablet_service.cc:1511] Processing CreateTablet for tablet f9a206840e1648aeb4571019fa4ca639 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:18.088171  3909 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:18.091207  3908 tablet_service.cc:1511] Processing CreateTablet for tablet 2900e71c0212466e8be300d30595c609 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:18.094288  3907 tablet_service.cc:1511] Processing CreateTablet for tablet f3bacd87db564c3ba5256af726514f84 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:18.095304  3835 tablet_service.cc:1511] Processing CreateTablet for tablet 56a5b44f8f3e46ae9582b9f86d191610 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:18.096827  3835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a5b44f8f3e46ae9582b9f86d191610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.097201  3906 tablet_service.cc:1511] Processing CreateTablet for tablet c9cb9cc431d048dd8cfea736da6af5fa (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:18.099613  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc6b8b0d8114762a0c8cec5e5461a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.084712  4040 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.103848  3908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2900e71c0212466e8be300d30595c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.107838  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba6f4e278ba4a6daa236e0b38b36cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.109930  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cb9cc431d048dd8cfea736da6af5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.118328  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bacd87db564c3ba5256af726514f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.118409  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a206840e1648aeb4571019fa4ca639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.140865  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61667a526f478f888a20a9619a1e2b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:18.148267  4042 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:18.156147  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61667a526f478f888a20a9619a1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.160925  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 138b76e837f84a518585fccdcf9ff6d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:18.162433  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b76e837f84a518585fccdcf9ff6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.163046  4040 tablet_bootstrap.cc:654] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.163600  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99966b4924ae49f889200899350931bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.156752  3914 tablet_service.cc:1511] Processing CreateTablet for tablet f9a206840e1648aeb4571019fa4ca639 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:18.170828  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a206840e1648aeb4571019fa4ca639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.176899  3910 tablet_service.cc:1511] Processing CreateTablet for tablet 56a5b44f8f3e46ae9582b9f86d191610 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:18.178491  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a5b44f8f3e46ae9582b9f86d191610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.179983  3911 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61667a526f478f888a20a9619a1e2b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:18.184242  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61667a526f478f888a20a9619a1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.191004  3981 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61667a526f478f888a20a9619a1e2b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:18.196650  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61667a526f478f888a20a9619a1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.202021  4039 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.202626  4039 ts_tablet_manager.cc:1403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.173s	user 0.012s	sys 0.045s
I20260709 12:20:18.206364  4039 raft_consensus.cc:359] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.207294  4039 raft_consensus.cc:385] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.207667  4039 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.208534  4039 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.171350  4042 tablet_bootstrap.cc:654] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.191005  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 56a5b44f8f3e46ae9582b9f86d191610 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:18.261283  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 138b76e837f84a518585fccdcf9ff6d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:18.261863  4039 ts_tablet_manager.cc:1434] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.004s
I20260709 12:20:18.262830  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b76e837f84a518585fccdcf9ff6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.262986  4040 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:18.263530  4040 ts_tablet_manager.cc:1403] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.179s	user 0.034s	sys 0.028s
I20260709 12:20:18.264685  4039 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.265133  3837 tablet_service.cc:1511] Processing CreateTablet for tablet e7012fd3393d4b19bd0d25e82fc612df (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:18.266563  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7012fd3393d4b19bd0d25e82fc612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.267777  4024 heartbeater.cc:499] Master 127.2.157.126:36337 was elected leader, sending a full tablet report...
I20260709 12:20:18.268060  4040 raft_consensus.cc:359] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.268855  4040 raft_consensus.cc:385] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.269150  4040 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.271826  4040 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.276274  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a5b44f8f3e46ae9582b9f86d191610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.276342  4039 tablet_bootstrap.cc:654] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.288004  4044 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.289330  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 138b76e837f84a518585fccdcf9ff6d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:18.291754  4044 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.296002  4040 ts_tablet_manager.cc:1434] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 12:20:18.297068  4040 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.296751  3907 tablet_service.cc:1511] Processing CreateTablet for tablet e7012fd3393d4b19bd0d25e82fc612df (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:18.297150  3875 heartbeater.cc:499] Master 127.2.157.126:36337 was elected leader, sending a full tablet report...
I20260709 12:20:18.313443  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7012fd3393d4b19bd0d25e82fc612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.299662  4044 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:18.322655  4040 tablet_bootstrap.cc:654] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.328398  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138b76e837f84a518585fccdcf9ff6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.336189  4042 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:18.336721  4042 ts_tablet_manager.cc:1403] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.012s
W20260709 12:20:18.341384  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:18.351017  3980 tablet_service.cc:1511] Processing CreateTablet for tablet e7012fd3393d4b19bd0d25e82fc612df (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:18.351419  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 7469adb046a64b1b9311cea78d13a0e6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:18.351315  3984 tablet_service.cc:1511] Processing CreateTablet for tablet 7469adb046a64b1b9311cea78d13a0e6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:18.352538  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7012fd3393d4b19bd0d25e82fc612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.352445  4042 raft_consensus.cc:359] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.353359  4042 raft_consensus.cc:385] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.353438  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469adb046a64b1b9311cea78d13a0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.353760  4042 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.354056  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469adb046a64b1b9311cea78d13a0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.350975  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 7469adb046a64b1b9311cea78d13a0e6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:18.372970  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:18.374890  3962 leader_election.cc:343] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.375540  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7469adb046a64b1b9311cea78d13a0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.362380  4042 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.380223  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 30c0e62036464a72858695d542f42a18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:18.381253  4039 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.381610  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c0e62036464a72858695d542f42a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.381865  4039 ts_tablet_manager.cc:1403] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.000s
I20260709 12:20:18.385309  4039 raft_consensus.cc:359] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.386077  4039 raft_consensus.cc:385] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.386426  4039 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.387197  4039 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.391001  4039 ts_tablet_manager.cc:1434] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:20:18.391309  3912 tablet_service.cc:1511] Processing CreateTablet for tablet 30c0e62036464a72858695d542f42a18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:18.392186  4039 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.392755  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c0e62036464a72858695d542f42a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.393848  4040 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:18.394388  4040 ts_tablet_manager.cc:1403] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.003s
I20260709 12:20:18.395138  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:18.396911  3964 leader_election.cc:343] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.397364  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:18.397593  4040 raft_consensus.cc:359] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.398495  4040 raft_consensus.cc:385] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.398509  4044 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.399051  4040 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.400053  4040 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.405025  4040 ts_tablet_manager.cc:1434] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:20:18.406054  4040 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.409996  3980 tablet_service.cc:1511] Processing CreateTablet for tablet 30c0e62036464a72858695d542f42a18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:18.411418  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c0e62036464a72858695d542f42a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.412696  4040 tablet_bootstrap.cc:654] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.420854  4039 tablet_bootstrap.cc:654] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.421970  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 67af26a7a42843f6855950af7a5b7781 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:18.426865  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67af26a7a42843f6855950af7a5b7781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.426878  3950 heartbeater.cc:499] Master 127.2.157.126:36337 was elected leader, sending a full tablet report...
I20260709 12:20:18.447940  3984 tablet_service.cc:1511] Processing CreateTablet for tablet 67af26a7a42843f6855950af7a5b7781 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:18.449378  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67af26a7a42843f6855950af7a5b7781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.451323  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 67af26a7a42843f6855950af7a5b7781 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:18.452730  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67af26a7a42843f6855950af7a5b7781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.452517  3839 tablet_service.cc:1511] Processing CreateTablet for tablet a66f6f6f296148d9b3b0931f1c94d49a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:18.453912  3906 tablet_service.cc:1511] Processing CreateTablet for tablet a66f6f6f296148d9b3b0931f1c94d49a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:18.456833  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66f6f6f296148d9b3b0931f1c94d49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.463961  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66f6f6f296148d9b3b0931f1c94d49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.470453  3983 tablet_service.cc:1511] Processing CreateTablet for tablet a66f6f6f296148d9b3b0931f1c94d49a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:18.471863  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66f6f6f296148d9b3b0931f1c94d49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.488449  3837 tablet_service.cc:1511] Processing CreateTablet for tablet f370e99c95594dc19f98fb403380e06c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:18.489975  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f370e99c95594dc19f98fb403380e06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.493716  3914 tablet_service.cc:1511] Processing CreateTablet for tablet f370e99c95594dc19f98fb403380e06c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:18.495160  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f370e99c95594dc19f98fb403380e06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.501636  4042 ts_tablet_manager.cc:1434] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.165s	user 0.005s	sys 0.009s
I20260709 12:20:18.503140  4042 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:18.503618  4040 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:18.505764  4040 ts_tablet_manager.cc:1403] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.035s
I20260709 12:20:18.504948  3980 tablet_service.cc:1511] Processing CreateTablet for tablet f370e99c95594dc19f98fb403380e06c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:18.508018  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f370e99c95594dc19f98fb403380e06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.509330  4040 raft_consensus.cc:359] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.510870  4040 raft_consensus.cc:385] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.513073  4040 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.513911  4040 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.517980  4042 tablet_bootstrap.cc:654] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.533246  4040 ts_tablet_manager.cc:1434] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:20:18.519845  4039 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.534077  4039 ts_tablet_manager.cc:1403] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.029s
I20260709 12:20:18.534538  4040 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.526454  3831 tablet_service.cc:1511] Processing CreateTablet for tablet c95cac50f4de4720ab08d1d1e49d71b5 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:18.537317  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cac50f4de4720ab08d1d1e49d71b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.538189  4039 raft_consensus.cc:359] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.539281  4039 raft_consensus.cc:385] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.539742  4039 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.540812  4039 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.543972  4039 ts_tablet_manager.cc:1434] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:20:18.544219  4040 tablet_bootstrap.cc:654] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.545461  4039 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.559221  4039 tablet_bootstrap.cc:654] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.571007  4040 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:18.571748  4040 ts_tablet_manager.cc:1403] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.012s
I20260709 12:20:18.572050  3907 tablet_service.cc:1511] Processing CreateTablet for tablet c95cac50f4de4720ab08d1d1e49d71b5 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:18.572569  4039 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.573290  4039 ts_tablet_manager.cc:1403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:20:18.573633  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cac50f4de4720ab08d1d1e49d71b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.575762  4040 raft_consensus.cc:359] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.576712  4040 raft_consensus.cc:385] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.577069  4044 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.577133  4040 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.577265  4039 raft_consensus.cc:359] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.577723  4044 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.578456  4039 raft_consensus.cc:385] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.578974  4039 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.578549  4040 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.580235  4039 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.582463  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:18.583859  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:18.584262  4040 ts_tablet_manager.cc:1434] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:20:18.584615  3850 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:18.585393  4044 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:18.585619  4040 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.586930  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:18.587193  4039 ts_tablet_manager.cc:1434] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
W20260709 12:20:18.588460  3964 leader_election.cc:343] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.588646  4039 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.590036  4044 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.590504  4044 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.590970  4044 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.594080  4040 tablet_bootstrap.cc:654] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.597843  4039 tablet_bootstrap.cc:654] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.618273  4039 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.619007  4039 ts_tablet_manager.cc:1403] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:20:18.622887  4039 raft_consensus.cc:359] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.624217  4039 raft_consensus.cc:385] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.624699  4039 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.626695  4047 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.626221  4039 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.627211  4047 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.636722  3912 tablet_service.cc:1511] Processing CreateTablet for tablet fdd5ceb511e74bc7a94d43444ea1d35e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:18.638332  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd5ceb511e74bc7a94d43444ea1d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.638135  4044 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.643676  4047 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.648974  4039 ts_tablet_manager.cc:1434] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.001s
I20260709 12:20:18.650545  4039 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.653841  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:18.654603  3850 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.674151  3980 tablet_service.cc:1511] Processing CreateTablet for tablet c95cac50f4de4720ab08d1d1e49d71b5 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:18.675347  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cac50f4de4720ab08d1d1e49d71b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.677676  3984 tablet_service.cc:1511] Processing CreateTablet for tablet fdd5ceb511e74bc7a94d43444ea1d35e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:18.678705  4044 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:18.679185  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd5ceb511e74bc7a94d43444ea1d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.680100  4042 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:18.680159  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:18.680672  4039 tablet_bootstrap.cc:654] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.680862  4042 ts_tablet_manager.cc:1403] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.178s	user 0.062s	sys 0.083s
W20260709 12:20:18.681905  3964 leader_election.cc:343] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.686841  4052 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.687599  3850 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:18.687419  4052 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.689441  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:18.692266  4044 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.693017  4044 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:18.695679  4047 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.696269  4047 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.698837  4047 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.694218  4044 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.703054  4040 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:18.703780  4040 ts_tablet_manager.cc:1403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.019s
I20260709 12:20:18.704409  4052 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.710048  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe9e57610c4d9b92c97966fbbfc00d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:18.711735  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe9e57610c4d9b92c97966fbbfc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.715896  4047 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.716511  4047 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.718946  4047 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.721168  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe9e57610c4d9b92c97966fbbfc00d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:18.722572  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe9e57610c4d9b92c97966fbbfc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.723778  4045 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.724329  4045 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.729175  3914 tablet_service.cc:1511] Processing CreateTablet for tablet dfad3fb2927f45958c4a0cf0768a8b53 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:18.730665  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad3fb2927f45958c4a0cf0768a8b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.731434  4045 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:18.732887  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:18.733055  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:18.734504  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:18.736855  3831 tablet_service.cc:1511] Processing CreateTablet for tablet fdd5ceb511e74bc7a94d43444ea1d35e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:18.737651  4040 raft_consensus.cc:359] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.738490  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd5ceb511e74bc7a94d43444ea1d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.739182  4039 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:18.739704  4039 ts_tablet_manager.cc:1403] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.003s
I20260709 12:20:18.739728  4042 raft_consensus.cc:359] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.741715  4042 raft_consensus.cc:385] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.742059  4042 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.742779  4039 raft_consensus.cc:359] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:18.735332  3964 leader_election.cc:343] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.743008  4042 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:18.744834  3962 leader_election.cc:343] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.745527  4042 ts_tablet_manager.cc:1434] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.002s
I20260709 12:20:18.747221  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:18.747818  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:18.748247  4045 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:18.735041  3888 leader_election.cc:343] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.743592  4039 raft_consensus.cc:385] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.749929  4039 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.750891  3980 tablet_service.cc:1511] Processing CreateTablet for tablet dfad3fb2927f45958c4a0cf0768a8b53 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:18.750828  4039 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.751144  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbe9e57610c4d9b92c97966fbbfc00d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:18.752034  3999 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:18.752449  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad3fb2927f45958c4a0cf0768a8b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.752874  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe9e57610c4d9b92c97966fbbfc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.752791  3913 tablet_service.cc:1511] Processing CreateTablet for tablet a29f44dfd3d24dccaa224167c983a5a4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:18.754642  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29f44dfd3d24dccaa224167c983a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.756286  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:18.757476  4042 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:18.759347  4052 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.759833  4052 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.760250  4052 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.761287  3839 tablet_service.cc:1511] Processing CreateTablet for tablet dfad3fb2927f45958c4a0cf0768a8b53 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:18.762913  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad3fb2927f45958c4a0cf0768a8b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.770136  3748 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.781260  4042 tablet_bootstrap.cc:654] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.788147  4039 ts_tablet_manager.cc:1434] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 12:20:18.787985  3836 tablet_service.cc:1511] Processing CreateTablet for tablet a29f44dfd3d24dccaa224167c983a5a4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:18.789305  4052 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.790278  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:18.791946  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:18.797676  3984 tablet_service.cc:1511] Processing CreateTablet for tablet a29f44dfd3d24dccaa224167c983a5a4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:18.808316  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:18.808758  3836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29f44dfd3d24dccaa224167c983a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.809059  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 108e3004fd4341f78b24caefdf2ef63f (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:18.807184  4039 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:18.822057  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29f44dfd3d24dccaa224167c983a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.823683  3912 tablet_service.cc:1511] Processing CreateTablet for tablet 108e3004fd4341f78b24caefdf2ef63f (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:18.824124  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac059d92404e2aa8792e1c5b02ae88 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:18.825110  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108e3004fd4341f78b24caefdf2ef63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.825721  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac059d92404e2aa8792e1c5b02ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.825835  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108e3004fd4341f78b24caefdf2ef63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.816270  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:18.738530  4040 raft_consensus.cc:385] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.828006  4040 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.828799  4040 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.831058  4040 ts_tablet_manager.cc:1434] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.127s	user 0.004s	sys 0.002s
I20260709 12:20:18.823302  3998 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
W20260709 12:20:18.845006  3814 leader_election.cc:343] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.845351  3835 tablet_service.cc:1511] Processing CreateTablet for tablet 108e3004fd4341f78b24caefdf2ef63f (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:18.846133  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:18.846730  3835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108e3004fd4341f78b24caefdf2ef63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.847043  4040 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:18.847743  4047 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.848122  4047 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.848454  4047 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.853458  4040 tablet_bootstrap.cc:654] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:18.855979  3814 leader_election.cc:343] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:18.856644  3888 leader_election.cc:343] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.863067  3833 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac059d92404e2aa8792e1c5b02ae88 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:20:18.821061  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65114.8us
I20260709 12:20:18.865063  3833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac059d92404e2aa8792e1c5b02ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.888098  3981 tablet_service.cc:1511] Processing CreateTablet for tablet ba989d98d508441a9e56717e49c9004d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:18.889233  4068 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.889503  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba989d98d508441a9e56717e49c9004d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.891647  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 07eac049e3fe41bf98d28d3d572dcb8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:18.890143  3980 tablet_service.cc:1511] Processing CreateTablet for tablet 63ac059d92404e2aa8792e1c5b02ae88 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:18.894121  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eac049e3fe41bf98d28d3d572dcb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.900449  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 982a62c46cea46f2b2e381471e7e080c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:18.908669  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a62c46cea46f2b2e381471e7e080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.909204  3831 tablet_service.cc:1511] Processing CreateTablet for tablet ba989d98d508441a9e56717e49c9004d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:18.909592  3914 tablet_service.cc:1511] Processing CreateTablet for tablet ba989d98d508441a9e56717e49c9004d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:18.910552  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba989d98d508441a9e56717e49c9004d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.911087  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba989d98d508441a9e56717e49c9004d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.910701  4047 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.919567  4068 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.920665  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:18.921312  3997 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.922428  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac059d92404e2aa8792e1c5b02ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.895071  4052 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.922338  4068 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.928603  4047 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:18.918248  4039 tablet_bootstrap.cc:654] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.928814  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:18.932178  3888 leader_election.cc:343] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.933595  3997 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:18.935035  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:18.937332  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 07eac049e3fe41bf98d28d3d572dcb8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:18.938064  4044 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.938567  4044 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:18.939085  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eac049e3fe41bf98d28d3d572dcb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.941486  4044 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:18.944931  4068 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.947158  4068 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:18.947299  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:18.947826  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:18.948295  4068 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:18.948967  3962 leader_election.cc:343] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.937393  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:18.955394  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:18.956393  3815 leader_election.cc:343] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.956199  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:18.956507  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:18.956885  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:18.957278  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:18.958213  4047 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.959257  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:18.966773  3834 tablet_service.cc:1511] Processing CreateTablet for tablet 982a62c46cea46f2b2e381471e7e080c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:18.968451  3834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a62c46cea46f2b2e381471e7e080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.977322  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 07eac049e3fe41bf98d28d3d572dcb8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:18.978780  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 982a62c46cea46f2b2e381471e7e080c (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:18.979087  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eac049e3fe41bf98d28d3d572dcb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.979910  3909 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:18.980381  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a62c46cea46f2b2e381471e7e080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.981209  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:18.972934  3815 leader_election.cc:343] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.981933  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:20:18.983318  3815 leader_election.cc:343] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:18.984586  3915 tablet_service.cc:1511] Processing CreateTablet for tablet ac719796849e490f935d71c2a43cd7d6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:18.986287  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac719796849e490f935d71c2a43cd7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.989493  3984 tablet_service.cc:1511] Processing CreateTablet for tablet ac719796849e490f935d71c2a43cd7d6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:18.993557  4042 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:18.994136  4042 ts_tablet_manager.cc:1403] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.012s
I20260709 12:20:18.978780  3911 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:18.997494  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.998373  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac719796849e490f935d71c2a43cd7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.001065  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.003270  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.999364  4047 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.019104  3908 tablet_service.cc:1511] Processing CreateTablet for tablet 9b32e0bc8a63482a89916840eae42f8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:19.021262  3908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b32e0bc8a63482a89916840eae42f8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.024449  3964 leader_election.cc:343] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.025018  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:19.025403  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 9b32e0bc8a63482a89916840eae42f8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:19.026422  4044 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:18.962961  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.031814  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b32e0bc8a63482a89916840eae42f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.032289  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:19.033615  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.028761  3815 leader_election.cc:343] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.060684  3912 tablet_service.cc:1511] Processing CreateTablet for tablet a7d019c5856041bca1afab26bbc6c7a6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:19.062274  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d019c5856041bca1afab26bbc6c7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.064781  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:19.066385  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.075572  3832 tablet_service.cc:1511] Processing CreateTablet for tablet ac719796849e490f935d71c2a43cd7d6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:19.076431  4040 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:19.077051  3832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac719796849e490f935d71c2a43cd7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.085157  4042 raft_consensus.cc:359] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.085981  4042 raft_consensus.cc:385] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.086297  4042 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.076975  4040 ts_tablet_manager.cc:1403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.230s	user 0.008s	sys 0.010s
I20260709 12:20:19.093180  4040 raft_consensus.cc:359] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.093989  4040 raft_consensus.cc:385] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.094301  4040 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.095039  4040 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.097720  4040 ts_tablet_manager.cc:1434] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:19.099143  4040 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:19.118067  4047 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.118688  4047 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.120632  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:19.121179  4047 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.121331  3998 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.122939  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:19.117714  3832 tablet_service.cc:1511] Processing CreateTablet for tablet a7d019c5856041bca1afab26bbc6c7a6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:19.087060  4042 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.131204  3832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d019c5856041bca1afab26bbc6c7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.132896  4039 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:19.132822  4042 ts_tablet_manager.cc:1434] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.002s
I20260709 12:20:19.135380  4039 ts_tablet_manager.cc:1403] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.328s	user 0.027s	sys 0.036s
W20260709 12:20:19.138958  3889 leader_election.cc:343] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.139281  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc77961701c41028cd54ea83719dae9 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:19.140213  4039 raft_consensus.cc:359] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.139779  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:19.140993  4039 raft_consensus.cc:385] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.141330  4039 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.142258  4052 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.142212  4039 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:19.143318  3815 leader_election.cc:343] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.144361  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc77961701c41028cd54ea83719dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.153158  4042 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:19.154057  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.154377  3989 tablet_service.cc:1511] Processing CreateTablet for tablet a7d019c5856041bca1afab26bbc6c7a6 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:19.154767  3997 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:19.156132  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d019c5856041bca1afab26bbc6c7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.161011  4039 ts_tablet_manager.cc:1434] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:20:19.162182  4039 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:19.169232  4042 tablet_bootstrap.cc:654] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.166363  3998 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:19.170580  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc77961701c41028cd54ea83719dae9 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:19.175309  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc77961701c41028cd54ea83719dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.178148  3980 tablet_service.cc:1511] Processing CreateTablet for tablet 88805767597d4bf9bed095ba7d4f4a76 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:19.179618  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88805767597d4bf9bed095ba7d4f4a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.190909  3909 tablet_service.cc:1511] Processing CreateTablet for tablet 88805767597d4bf9bed095ba7d4f4a76 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:19.192373  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88805767597d4bf9bed095ba7d4f4a76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.194697  4025 tablet.cc:2406] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:19.123335  3834 tablet_service.cc:1511] Processing CreateTablet for tablet 9b32e0bc8a63482a89916840eae42f8a (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:19.209779  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 58188a85c5c940b2a6a6d9e2640f3b18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:19.210990  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58188a85c5c940b2a6a6d9e2640f3b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.213722  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 91a268ae9485472a8208827344502203 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:19.215039  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a268ae9485472a8208827344502203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.186610  3745 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.217803  3913 tablet_service.cc:1511] Processing CreateTablet for tablet e693a63f62764df9a01acfa82fed09e8 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:19.219115  3989 tablet_service.cc:1511] Processing CreateTablet for tablet e693a63f62764df9a01acfa82fed09e8 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:19.220903  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e693a63f62764df9a01acfa82fed09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.219221  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e693a63f62764df9a01acfa82fed09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.222579  3910 tablet_service.cc:1511] Processing CreateTablet for tablet 83b1a4f620064a52bb4a2fb284f00276 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:19.234248  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b1a4f620064a52bb4a2fb284f00276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.237507  3980 tablet_service.cc:1511] Processing CreateTablet for tablet 58188a85c5c940b2a6a6d9e2640f3b18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:19.246575  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58188a85c5c940b2a6a6d9e2640f3b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.242753  4068 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.252226  4068 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.254422  4068 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.254242  3833 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc77961701c41028cd54ea83719dae9 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:19.256479  4047 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.256983  4047 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.263089  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:19.270007  3911 tablet_service.cc:1511] Processing CreateTablet for tablet bbef64c2ac9444d6983c225484fccfda (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:19.264400  3834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b32e0bc8a63482a89916840eae42f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.271885  3850 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:19.280962  4047 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.280690  3888 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:19.282333  4042 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:19.271899  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:19.271402  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef64c2ac9444d6983c225484fccfda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.267148  3964 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:19.289810  4068 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.291354  3833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc77961701c41028cd54ea83719dae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.291736  4068 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.292152  4068 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.291738  4047 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.296593  4047 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.296983  4047 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.282599  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:19.300748  3815 leader_election.cc:343] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:19.301338  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56330.9us
I20260709 12:20:19.304013  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.304723  3998 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:19.296104  3909 tablet_service.cc:1511] Processing CreateTablet for tablet d96631b804304cddb7995664610e592d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:19.306206  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96631b804304cddb7995664610e592d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.306945  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 83b1a4f620064a52bb4a2fb284f00276 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:19.308496  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b1a4f620064a52bb4a2fb284f00276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.290532  4042 ts_tablet_manager.cc:1403] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.048s
I20260709 12:20:19.309280  4068 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.314489  4047 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.314882  3980 tablet_service.cc:1511] Processing CreateTablet for tablet bbef64c2ac9444d6983c225484fccfda (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:19.316176  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef64c2ac9444d6983c225484fccfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.317517  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:19.319082  3815 leader_election.cc:343] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.321015  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 07eb7068067d45559c8b38061e7c8808 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:19.321596  4039 tablet_bootstrap.cc:654] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.322397  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eb7068067d45559c8b38061e7c8808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.322729  4040 tablet_bootstrap.cc:654] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.326203  3984 tablet_service.cc:1511] Processing CreateTablet for tablet 91a268ae9485472a8208827344502203 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:19.327740  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a268ae9485472a8208827344502203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.328027  4047 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.329027  3982 tablet_service.cc:1511] Processing CreateTablet for tablet d96631b804304cddb7995664610e592d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:19.330355  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96631b804304cddb7995664610e592d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.332437  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 07eb7068067d45559c8b38061e7c8808 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:19.333855  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eb7068067d45559c8b38061e7c8808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.336849  4044 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.341102  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:19.341363  4068 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.341733  3849 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.345965  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:19.346648  3998 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.348918  4042 raft_consensus.cc:359] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:19.379683  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:19.379487  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 125588992e20455d8e0b267fb10d24a7 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:19.386870  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125588992e20455d8e0b267fb10d24a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.388662  3980 tablet_service.cc:1511] Processing CreateTablet for tablet 125588992e20455d8e0b267fb10d24a7 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:19.389907  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125588992e20455d8e0b267fb10d24a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.389902  3981 tablet_service.cc:1511] Processing CreateTablet for tablet 63cbbf40cb084518a89acf7f7026e77b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:19.379762  4042 raft_consensus.cc:385] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:19.368075  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103792us
I20260709 12:20:19.392304  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:19.393117  4047 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.397377  3836 tablet_service.cc:1511] Processing CreateTablet for tablet 91a268ae9485472a8208827344502203 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:19.398805  3836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a268ae9485472a8208827344502203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.398675  3835 tablet_service.cc:1511] Processing CreateTablet for tablet bbef64c2ac9444d6983c225484fccfda (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:19.400285  3835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef64c2ac9444d6983c225484fccfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.400516  3838 tablet_service.cc:1511] Processing CreateTablet for tablet e693a63f62764df9a01acfa82fed09e8 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:19.401782  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e693a63f62764df9a01acfa82fed09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.404682  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 83b1a4f620064a52bb4a2fb284f00276 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:19.406111  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b1a4f620064a52bb4a2fb284f00276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.409019  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 88805767597d4bf9bed095ba7d4f4a76 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:19.410319  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88805767597d4bf9bed095ba7d4f4a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.411818  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 07eb7068067d45559c8b38061e7c8808 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:19.412564  3998 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:19.413116  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eb7068067d45559c8b38061e7c8808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.385447  4040 tablet_bootstrap.cc:492] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:19.413770  4040 ts_tablet_manager.cc:1403] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.000s
I20260709 12:20:19.416271  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:19.416769  4040 raft_consensus.cc:359] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.417248  4068 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.417517  4040 raft_consensus.cc:385] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.417752  4068 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:19.417838  4040 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.419399  3849 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:19.420954  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 58188a85c5c940b2a6a6d9e2640f3b18 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:19.422487  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58188a85c5c940b2a6a6d9e2640f3b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.418710  4068 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.391331  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63cbbf40cb084518a89acf7f7026e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.391602  4042 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.432273  4042 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.438830  4047 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:19.449579  4039 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:19.450277  4039 ts_tablet_manager.cc:1403] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.288s	user 0.019s	sys 0.010s
I20260709 12:20:19.457695  4042 ts_tablet_manager.cc:1434] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.149s	user 0.005s	sys 0.005s
I20260709 12:20:19.460590  4039 raft_consensus.cc:359] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.468654  3837 tablet_service.cc:1511] Processing CreateTablet for tablet 125588992e20455d8e0b267fb10d24a7 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:19.469902  3837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125588992e20455d8e0b267fb10d24a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.468654  3833 tablet_service.cc:1511] Processing CreateTablet for tablet 63cbbf40cb084518a89acf7f7026e77b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:19.473028  3833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63cbbf40cb084518a89acf7f7026e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.473853  3832 tablet_service.cc:1511] Processing CreateTablet for tablet d96631b804304cddb7995664610e592d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:19.475132  3832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96631b804304cddb7995664610e592d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.476473  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.477161  3998 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:19.478507  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 63cbbf40cb084518a89acf7f7026e77b (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:19.479921  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63cbbf40cb084518a89acf7f7026e77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.480027  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:19.480654  3998 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.459250  4042 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:19.486431  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:19.491114  4042 tablet_bootstrap.cc:654] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.491928  3998 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:19.461155  4039 raft_consensus.cc:385] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.499840  4081 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.510821  4081 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.511308  4081 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.511507  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 271f08ec28384c99b6dd3fb41fb92ebf (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:19.513288  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271f08ec28384c99b6dd3fb41fb92ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.516286  3912 tablet_service.cc:1511] Processing CreateTablet for tablet 271f08ec28384c99b6dd3fb41fb92ebf (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:19.517678  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271f08ec28384c99b6dd3fb41fb92ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.503576  4039 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.533150  4039 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.535375  4039 ts_tablet_manager.cc:1434] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 12:20:19.536594  4039 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:19.542513  4039 tablet_bootstrap.cc:654] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.532433  4047 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.553325  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 722124affb914f0496100070a9582045 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:19.454478  4040 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.560578  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 271f08ec28384c99b6dd3fb41fb92ebf (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:19.562399  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:19.555408  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722124affb914f0496100070a9582045. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.570609  3888 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:19.577154  3748 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.596400  4047 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.597031  4047 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:19.597920  4047 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.600461  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271f08ec28384c99b6dd3fb41fb92ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.579560  3981 tablet_service.cc:1511] Processing CreateTablet for tablet 722124affb914f0496100070a9582045 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:20:19.619004  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 56675.1us
I20260709 12:20:19.619222  4080 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.620864  4080 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.621623  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722124affb914f0496100070a9582045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.622975  4042 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:19.623539  4042 ts_tablet_manager.cc:1403] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.165s	user 0.023s	sys 0.004s
I20260709 12:20:19.624917  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:19.625576  4084 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.626080  4084 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:19.626509  3962 leader_election.cc:343] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.626807  4042 raft_consensus.cc:359] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.623199  4080 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:19.652863  4040 ts_tablet_manager.cc:1434] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.239s	user 0.012s	sys 0.015s
I20260709 12:20:19.654093  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 7abd4286feba432697849b5bcf582f63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:19.659549  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abd4286feba432697849b5bcf582f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.661504  3989 tablet_service.cc:1511] Processing CreateTablet for tablet c68343b8d5be4269b4b588c1b34d01e0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:19.654314  3834 tablet_service.cc:1511] Processing CreateTablet for tablet 722124affb914f0496100070a9582045 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:19.663546  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68343b8d5be4269b4b588c1b34d01e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.664407  3834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722124affb914f0496100070a9582045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.655820  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 7abd4286feba432697849b5bcf582f63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:19.668527  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abd4286feba432697849b5bcf582f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.656713  3836 tablet_service.cc:1511] Processing CreateTablet for tablet c68343b8d5be4269b4b588c1b34d01e0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:19.672415  3836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68343b8d5be4269b4b588c1b34d01e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.675884  4081 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.678532  4081 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.684369  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:19.685606  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:19.685892  4052 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.656363  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 7abd4286feba432697849b5bcf582f63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:19.641211  4042 raft_consensus.cc:385] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.695122  4042 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.698709  4042 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.701311  4084 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.701534  4042 ts_tablet_manager.cc:1434] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:20:19.702451  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abd4286feba432697849b5bcf582f63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:19.696779  3815 leader_election.cc:343] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.713228  3911 tablet_service.cc:1511] Processing CreateTablet for tablet c68343b8d5be4269b4b588c1b34d01e0 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:20:19.695843  3964 leader_election.cc:343] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.714601  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:19.718225  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:19.718947  3998 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.718269  3748 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.719833  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.720307  4042 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:19.720599  3997 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:19.725445  4091 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.731405  4040 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:19.731710  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68343b8d5be4269b4b588c1b34d01e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.732862  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:19.761893  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:19.763088  4084 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.788131  4039 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:19.788648  4039 ts_tablet_manager.cc:1403] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.252s	user 0.026s	sys 0.037s
W20260709 12:20:19.791854  3733 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52577.7us
I20260709 12:20:19.792217  4039 raft_consensus.cc:359] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.792946  4039 raft_consensus.cc:385] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.793237  4039 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.794780  4039 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.796456  4042 tablet_bootstrap.cc:654] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.799405  4084 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.801662  4039 ts_tablet_manager.cc:1434] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:20:19.802668  4039 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:19.806756  3831 tablet_service.cc:1511] Processing CreateTablet for tablet c1565e90e2094af9b0891393186e41da (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:19.808089  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1565e90e2094af9b0891393186e41da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.818216  3913 tablet_service.cc:1511] Processing CreateTablet for tablet c1565e90e2094af9b0891393186e41da (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:19.819808  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1565e90e2094af9b0891393186e41da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.820178  3747 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.831610  4040 tablet_bootstrap.cc:654] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.834488  3981 tablet_service.cc:1511] Processing CreateTablet for tablet c1565e90e2094af9b0891393186e41da (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:19.834753  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 9c325a58070740f29bc40a3a22e2b61d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:19.835949  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1565e90e2094af9b0891393186e41da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.836588  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c325a58070740f29bc40a3a22e2b61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.836760  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 9c325a58070740f29bc40a3a22e2b61d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:19.837913  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c325a58070740f29bc40a3a22e2b61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.847502  4039 tablet_bootstrap.cc:654] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.871500  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 9c325a58070740f29bc40a3a22e2b61d (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:19.872073  3834 tablet_service.cc:1511] Processing CreateTablet for tablet d25c2d062dfa4db8852d794adc28cdf2 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:19.873152  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c325a58070740f29bc40a3a22e2b61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.873411  3834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c2d062dfa4db8852d794adc28cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.874607  4040 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:19.875147  4040 ts_tablet_manager.cc:1403] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.014s
I20260709 12:20:19.874915  4068 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.878481  4068 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.880699  4068 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:19.881178  4068 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.881585  4068 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.882323  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:19.883849  4068 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:19.883987  3888 leader_election.cc:343] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.884610  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:19.893445  3849 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:19.894985  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:19.885115  4040 raft_consensus.cc:359] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.885352  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.885550  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:19.859351  3998 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:19.896066  4040 raft_consensus.cc:385] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.896754  4040 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.897629  4040 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.901053  4040 ts_tablet_manager.cc:1434] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
W20260709 12:20:19.900987  3889 leader_election.cc:343] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.901561  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:19.902570  4040 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
W20260709 12:20:19.902760  3889 leader_election.cc:343] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:19.903487  4042 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:19.904147  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:19.905819  4042 ts_tablet_manager.cc:1403] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.040s
I20260709 12:20:19.906347  4084 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.909991  4040 tablet_bootstrap.cc:654] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.909888  4084 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:19.896706  4068 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.910909  4068 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.911932  4068 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.911823  4084 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.917007  4039 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:19.917513  4039 ts_tablet_manager.cc:1403] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.006s
I20260709 12:20:19.917450  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc1f0da5d664bee8661e3dbace70630 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:19.918833  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc1f0da5d664bee8661e3dbace70630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.918689  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc1f0da5d664bee8661e3dbace70630 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:19.920056  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc1f0da5d664bee8661e3dbace70630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.920261  4039 raft_consensus.cc:359] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.920928  4039 raft_consensus.cc:385] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.921176  4039 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.923458  4101 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.925127  3836 tablet_service.cc:1511] Processing CreateTablet for tablet 65de00ab7bf84d57b73f50c0d7c07565 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:19.926424  3836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de00ab7bf84d57b73f50c0d7c07565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.926183  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 65de00ab7bf84d57b73f50c0d7c07565 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:19.927531  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de00ab7bf84d57b73f50c0d7c07565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.938482  3981 tablet_service.cc:1511] Processing CreateTablet for tablet d25c2d062dfa4db8852d794adc28cdf2 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:19.939942  3981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c2d062dfa4db8852d794adc28cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.938268  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc1f0da5d664bee8661e3dbace70630 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:19.940724  4039 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.949339  3912 tablet_service.cc:1511] Processing CreateTablet for tablet ff4bdec26d3e4879bd33a92daad5d607 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:19.950785  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4bdec26d3e4879bd33a92daad5d607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.951622  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 918f90de47bb48d493e4dd0737810b63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:19.952881  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f90de47bb48d493e4dd0737810b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.962409  4039 ts_tablet_manager.cc:1434] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 12:20:19.964790  3913 tablet_service.cc:1511] Processing CreateTablet for tablet d25c2d062dfa4db8852d794adc28cdf2 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:19.970069  4099 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:19.972379  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc1f0da5d664bee8661e3dbace70630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.975581  3984 tablet_service.cc:1511] Processing CreateTablet for tablet 65de00ab7bf84d57b73f50c0d7c07565 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:19.975193  4042 raft_consensus.cc:359] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.987823  4042 raft_consensus.cc:385] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.988200  4042 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.989187  4042 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:19.991029  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25c2d062dfa4db8852d794adc28cdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.993701  4042 ts_tablet_manager.cc:1434] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:20:19.995419  4042 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.003743  3983 tablet_service.cc:1511] Processing CreateTablet for tablet ff4bdec26d3e4879bd33a92daad5d607 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:20.008211  3832 tablet_service.cc:1511] Processing CreateTablet for tablet ff4bdec26d3e4879bd33a92daad5d607 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:20.010070  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de00ab7bf84d57b73f50c0d7c07565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.010391  4039 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.016450  4039 tablet_bootstrap.cc:654] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.030853  3832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4bdec26d3e4879bd33a92daad5d607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.040757  3906 tablet_service.cc:1511] Processing CreateTablet for tablet 918f90de47bb48d493e4dd0737810b63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:20.041224  3980 tablet_service.cc:1511] Processing CreateTablet for tablet f8842b18207e4c90a92bd153fe9d059e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:20.042008  3906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f90de47bb48d493e4dd0737810b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.047379  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 7265897ebd4e4f6ba4330aca29c74838 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:20.048633  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4bdec26d3e4879bd33a92daad5d607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.048758  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7265897ebd4e4f6ba4330aca29c74838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.053135  4040 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.053638  4040 ts_tablet_manager.cc:1403] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.151s	user 0.040s	sys 0.041s
I20260709 12:20:20.054010  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 7265897ebd4e4f6ba4330aca29c74838 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:20.055773  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 918f90de47bb48d493e4dd0737810b63 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:20.056499  4040 raft_consensus.cc:359] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.057153  4040 raft_consensus.cc:385] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.057402  4091 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.057420  4040 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.058010  4091 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.058444  4040 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.060315  4091 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.062348  4040 ts_tablet_manager.cc:1434] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:20:20.063335  4040 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.063426  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.064178  3848 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.047394  3911 tablet_service.cc:1511] Processing CreateTablet for tablet f8842b18207e4c90a92bd153fe9d059e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:20.068954  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8842b18207e4c90a92bd153fe9d059e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.069515  4040 tablet_bootstrap.cc:654] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.069909  4084 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.070298  4084 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.072106  4084 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.072116  3962 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.074075  4101 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:20.074452  4091 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.074988  4091 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.075404  4091 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.075758  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.077103  3748 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.078603  3839 tablet_service.cc:1511] Processing CreateTablet for tablet f8842b18207e4c90a92bd153fe9d059e (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:20.055382  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7265897ebd4e4f6ba4330aca29c74838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.079800  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8842b18207e4c90a92bd153fe9d059e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.080837  3831 tablet_service.cc:1511] Processing CreateTablet for tablet 7265897ebd4e4f6ba4330aca29c74838 (DEFAULT_TABLE table=test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:20.081969  3831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7265897ebd4e4f6ba4330aca29c74838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.084465  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.085171  3925 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.086513  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.087843  3980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8842b18207e4c90a92bd153fe9d059e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.088967  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.089787  3998 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.091792  4093 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.091709  4084 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:20.092278  4093 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.092633  4093 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.096118  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f90de47bb48d493e4dd0737810b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:20.104691  4068 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.106412  3923 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:20.108170  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:20.108801  3848 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:20.112126  3815 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.112792  4068 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.114061  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:20.115109  4042 tablet_bootstrap.cc:654] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.131136  4039 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.131701  4039 ts_tablet_manager.cc:1403] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.009s
I20260709 12:20:20.134514  4039 raft_consensus.cc:359] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.134903  4091 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.135788  4047 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:20.137143  4091 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.140405  3998 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:20.135228  4039 raft_consensus.cc:385] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.142323  4039 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.149634  4039 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.151626  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:20.161176  3848 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:20.162596  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.163532  4052 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.164168  4052 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:20.165019  4052 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.167626  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.175500  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.177126  4087 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.183179  4039 ts_tablet_manager.cc:1434] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:20:20.185922  4039 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.221094  4039 tablet_bootstrap.cc:654] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:20.226264  3815 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.226171  4093 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.227684  3748 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.229307  4093 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.231974  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.233155  3923 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.245126  4091 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.245851  4091 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.250722  4091 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.252202  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.252909  3925 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.254467  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:20.255461  4091 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.255877  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.243877  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:20.256832  3996 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:20.257491  3962 leader_election.cc:343] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.255867  4091 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.258792  4091 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.264091  3996 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:20.266842  4091 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.269236  4040 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.269797  4040 ts_tablet_manager.cc:1403] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.019s
I20260709 12:20:20.270679  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:20.272519  3923 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:20:20.272682  3962 leader_election.cc:343] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.274183  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.277330  4084 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.277616  4039 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.277891  4084 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:20.278096  4039 ts_tablet_manager.cc:1403] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.003s
I20260709 12:20:20.278841  4084 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.280956  4039 raft_consensus.cc:359] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.281631  4039 raft_consensus.cc:385] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.281885  4039 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.293915  4039 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.297211  3745 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.298552  4039 ts_tablet_manager.cc:1434] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:20:20.299769  4039 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.273066  4040 raft_consensus.cc:359] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.301981  4040 raft_consensus.cc:385] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.302291  4040 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.304699  4040 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.310971  4040 ts_tablet_manager.cc:1434] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:20:20.312077  4040 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.316318  4039 tablet_bootstrap.cc:654] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.318045  4040 tablet_bootstrap.cc:654] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.319550  4042 tablet_bootstrap.cc:492] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.320091  4042 ts_tablet_manager.cc:1403] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.325s	user 0.019s	sys 0.044s
I20260709 12:20:20.323182  4042 raft_consensus.cc:359] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.324016  4042 raft_consensus.cc:385] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.324361  4042 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.325059  4115 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:20.325147  4042 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.327804  4042 ts_tablet_manager.cc:1434] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:20.328866  4042 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.336849  4042 tablet_bootstrap.cc:654] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.338642  4039 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.339167  4039 ts_tablet_manager.cc:1403] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.007s
I20260709 12:20:20.340529  4091 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.341964  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.342326  4039 raft_consensus.cc:359] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.342676  3923 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.343048  4039 raft_consensus.cc:385] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.343364  4039 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.344089  4039 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.346077  4039 ts_tablet_manager.cc:1434] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:20:20.346915  4039 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.353338  4115 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.353901  4115 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.366063  3923 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:20.366518  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.367736  4039 tablet_bootstrap.cc:654] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.368182  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.369572  4091 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.370110  4091 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:20.367206  3925 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.371043  4091 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.372699  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.373935  4115 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.374493  4115 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.374846  4115 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.375193  4115 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.386108  4039 tablet_bootstrap.cc:492] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.386792  4039 ts_tablet_manager.cc:1403] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.009s
I20260709 12:20:20.392030  4040 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.392514  4040 ts_tablet_manager.cc:1403] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.013s
I20260709 12:20:20.391589  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:20.396958  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:20.398181  4039 raft_consensus.cc:359] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:20.398527  3815 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.400038  4039 raft_consensus.cc:385] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.400357  4039 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.401091  4039 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.402185  3997 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.404835  4039 ts_tablet_manager.cc:1434] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:20:20.406111  4039 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.412367  4040 raft_consensus.cc:359] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.413079  4040 raft_consensus.cc:385] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.413205  4042 tablet_bootstrap.cc:492] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.413420  4040 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.413838  4042 ts_tablet_manager.cc:1403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.018s
I20260709 12:20:20.414188  4040 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.417089  4040 ts_tablet_manager.cc:1434] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:20:20.418084  4040 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.417613  4042 raft_consensus.cc:359] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.418464  4042 raft_consensus.cc:385] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.418761  4042 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.419380  4042 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.432092  4039 tablet_bootstrap.cc:654] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.432631  4042 ts_tablet_manager.cc:1434] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 12:20:20.433681  4042 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.434192  4040 tablet_bootstrap.cc:654] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.437860  3745 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.439700  4042 tablet_bootstrap.cc:654] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.443915  4115 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.445284  4091 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.446931  4091 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.449481  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.449910  4042 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.450110  3925 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.450376  4042 ts_tablet_manager.cc:1403] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260709 12:20:20.451040  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.445803  4040 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
W20260709 12:20:20.452521  3964 leader_election.cc:343] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.452776  4040 ts_tablet_manager.cc:1403] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.009s
I20260709 12:20:20.453101  4091 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.453279  4042 raft_consensus.cc:359] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.453826  4042 raft_consensus.cc:385] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.453992  4042 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.454531  4042 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.454587  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.455721  4040 raft_consensus.cc:359] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:20.456214  3962 leader_election.cc:343] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.456408  4040 raft_consensus.cc:385] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.456409  4042 ts_tablet_manager.cc:1434] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:20.456825  4040 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.456696  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.457566  4042 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.457563  4091 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.457602  4040 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.460443  4040 ts_tablet_manager.cc:1434] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:20.461514  4040 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.464351  4042 tablet_bootstrap.cc:654] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.467731  4040 tablet_bootstrap.cc:654] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.471817  3925 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:20.474483  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:20.475677  3997 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.477319  4042 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.477759  4042 ts_tablet_manager.cc:1403] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:20:20.480726  4042 raft_consensus.cc:359] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.481398  4042 raft_consensus.cc:385] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.481667  4042 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.482438  4042 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.482954  3997 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:20.483409  4040 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.483608  4039 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.475047  4115 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.483969  4040 ts_tablet_manager.cc:1403] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.002s
I20260709 12:20:20.484452  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.483992  4039 ts_tablet_manager.cc:1403] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.001s
I20260709 12:20:20.486081  4115 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.486825  4040 raft_consensus.cc:359] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.487372  4115 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:20.487597  4040 raft_consensus.cc:385] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.488021  4040 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.488950  4115 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.489008  4042 ts_tablet_manager.cc:1434] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:20:20.487365  4039 raft_consensus.cc:359] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.490586  4039 raft_consensus.cc:385] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.489003  4040 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.490847  4039 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.491591  4039 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.490880  4042 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.493788  4039 ts_tablet_manager.cc:1434] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:20:20.494750  4039 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.494783  4040 ts_tablet_manager.cc:1434] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:20:20.495788  4040 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.501662  4039 tablet_bootstrap.cc:654] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.512830  4040 tablet_bootstrap.cc:654] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.512830  4042 tablet_bootstrap.cc:654] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.513610  4091 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.514101  4091 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.514777  4039 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.515259  4039 ts_tablet_manager.cc:1403] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:20:20.516237  4091 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.518078  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.518916  4039 raft_consensus.cc:359] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.519773  4039 raft_consensus.cc:385] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.520143  4039 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.520344  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.520970  4039 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:20.521651  3962 leader_election.cc:343] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:20.522441  3964 leader_election.cc:343] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.522809  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.523655  4039 ts_tablet_manager.cc:1434] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:20.523737  4087 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.524912  4039 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.531688  4042 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.532097  4039 tablet_bootstrap.cc:654] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.532195  4042 ts_tablet_manager.cc:1403] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.008s
I20260709 12:20:20.533631  3747 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.535291  4042 raft_consensus.cc:359] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.536223  4042 raft_consensus.cc:385] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.536566  4042 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.537443  4042 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.540136  4042 ts_tablet_manager.cc:1434] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:20.543620  4040 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.544119  4040 ts_tablet_manager.cc:1403] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.000s
I20260709 12:20:20.546726  4040 raft_consensus.cc:359] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.547379  4040 raft_consensus.cc:385] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.547664  4040 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.548216  4039 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.549278  4039 ts_tablet_manager.cc:1403] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:20:20.548336  4040 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.551049  4040 ts_tablet_manager.cc:1434] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:20.548519  4042 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.551900  4039 raft_consensus.cc:359] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.552908  4039 raft_consensus.cc:385] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.553169  4039 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.553803  4039 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.555855  4039 ts_tablet_manager.cc:1434] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:20:20.556125  4040 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.556980  4039 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.558111  4042 tablet_bootstrap.cc:654] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.563575  4039 tablet_bootstrap.cc:654] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.565956  4040 tablet_bootstrap.cc:654] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.573940  4042 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.574352  4040 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.574477  4042 ts_tablet_manager.cc:1403] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
I20260709 12:20:20.576316  4040 ts_tablet_manager.cc:1403] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:20:20.577565  4039 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.578146  4039 ts_tablet_manager.cc:1403] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 12:20:20.578171  4042 raft_consensus.cc:359] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.579097  4042 raft_consensus.cc:385] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.579149  4040 raft_consensus.cc:359] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.580070  4040 raft_consensus.cc:385] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.580121  4042 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.580430  4040 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.580981  4042 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.581095  4040 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.581492  4039 raft_consensus.cc:359] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.582646  4039 raft_consensus.cc:385] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.582967  4039 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.583124  4040 ts_tablet_manager.cc:1434] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:20:20.583408  4042 ts_tablet_manager.cc:1434] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:20.584156  4040 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.584321  4042 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.590914  4042 tablet_bootstrap.cc:654] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.590969  4040 tablet_bootstrap.cc:654] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.591336  4087 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.592640  4087 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.595166  4039 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.598155  4087 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.598765  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.599037  4039 ts_tablet_manager.cc:1434] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:20:20.599540  3848 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.600875  4042 tablet_bootstrap.cc:492] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.601373  4110 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.602077  4110 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.602519  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.603192  3925 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.604446  4110 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.601374  4042 ts_tablet_manager.cc:1403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.003s
I20260709 12:20:20.605145  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.607832  4087 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.608278  4087 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.608107  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.608692  4087 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.608614  4042 raft_consensus.cc:359] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.609486  4042 raft_consensus.cc:385] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.609817  4042 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.610536  4042 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.611515  4040 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.611979  4040 ts_tablet_manager.cc:1403] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.001s
I20260709 12:20:20.612812  4042 ts_tablet_manager.cc:1434] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:20.613761  4042 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.614631  4040 raft_consensus.cc:359] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.614930  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.615295  4040 raft_consensus.cc:385] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.615643  4040 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.616482  4040 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.616789  3889 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.617730  4110 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.619915  4042 tablet_bootstrap.cc:654] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.622908  4040 ts_tablet_manager.cc:1434] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:20.624346  4040 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.625989  4039 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.632375  4040 tablet_bootstrap.cc:654] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.636287  4087 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.639424  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:20.640133  3848 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.644840  4039 tablet_bootstrap.cc:654] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.654673  4040 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.655372  4040 ts_tablet_manager.cc:1403] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.003s
I20260709 12:20:20.659109  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.660099  3925 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.662858  4040 raft_consensus.cc:359] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.663938  4040 raft_consensus.cc:385] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.664333  4040 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.665287  4040 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.666424  4087 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.667387  3848 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:20.673485  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.674347  4040 ts_tablet_manager.cc:1434] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:20:20.674672  4087 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.675369  4040 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.676368  4087 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:20.678136  4087 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.681457  4091 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.682224  4040 tablet_bootstrap.cc:654] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.682176  4091 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.686805  4110 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.687543  4110 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.691642  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.692210  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.693216  3923 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.695830  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.696803  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:20.698521  4110 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.699239  4142 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.699875  4142 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.700371  4142 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.700363  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.701200  4091 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.701464  3848 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:20.709396  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.711558  4068 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.712453  4068 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:20.713428  4052 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.714236  4052 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.719105  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.721522  4042 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.722054  4042 ts_tablet_manager.cc:1403] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.040s
I20260709 12:20:20.720786  3925 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:20.723062  4052 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.725193  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.726920  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.727967  4068 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.727627  4142 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.725061  4042 raft_consensus.cc:359] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.729293  4042 raft_consensus.cc:385] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.729732  4042 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.730451  4042 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.731345  3923 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.732024  4042 ts_tablet_manager.cc:1434] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:20:20.732915  4042 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:20.737947  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:20.738441  4142 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.738619  3848 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.740135  4042 tablet_bootstrap.cc:654] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.766422  4068 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:20.768520  4039 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:20.769224  4039 ts_tablet_manager.cc:1403] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.143s	user 0.041s	sys 0.055s
I20260709 12:20:20.773135  4039 raft_consensus.cc:359] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.773919  4039 raft_consensus.cc:385] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.774223  4039 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.774909  4039 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.776752  4039 ts_tablet_manager.cc:1434] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:20.777971  4039 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:20.782684  4115 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:20.786460  4115 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.787326  4115 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.796181  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.797057  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.797197  4093 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.797945  4093 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.798841  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.799937  4047 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.799984  4115 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.800437  4047 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.800866  4047 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.802176  3748 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.759199  3848 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:20.821724  4093 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.822978  4040 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:20.823496  4040 ts_tablet_manager.cc:1403] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.148s	user 0.034s	sys 0.059s
I20260709 12:20:20.826467  4040 raft_consensus.cc:359] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.828791  4040 raft_consensus.cc:385] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.827093  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.829363  4040 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.830178  4040 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.832804  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.833398  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.834082  3922 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.834227  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.835210  3924 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:20.836499  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.837404  3921 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:20.812419  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49415.6us
I20260709 12:20:20.841377  4084 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.830823  4047 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.842305  4084 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.840441  4142 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:20.840946  4093 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.844426  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:20.854897  4040 ts_tablet_manager.cc:1434] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 12:20:20.856742  4142 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:20.859812  4040 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:20.858646  4084 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.863509  4142 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.869879  4068 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.871641  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.871743  4068 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.869756  4084 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.872496  3998 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.873783  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:20.880317  4042 tablet_bootstrap.cc:492] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:20.881002  4042 ts_tablet_manager.cc:1403] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.148s	user 0.039s	sys 0.035s
I20260709 12:20:20.864858  4093 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.898175  3920 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.897058  4052 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.898880  4052 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.901049  4052 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.887601  4091 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.884884  4115 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.875341  4087 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:20:20.901734  4091 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.910699  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.911376  3924 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:20.904668  4115 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.913834  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.917497  4091 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.918205  4091 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.918045  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.919145  4091 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.920796  4068 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.924672  4091 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:20.928661  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.929548  3998 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:20.931260  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.931100  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:20.934887  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:20.939152  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:20.940085  3922 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:20.944341  3964 leader_election.cc:343] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.914373  4115 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.946079  4039 tablet_bootstrap.cc:654] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:20.947960  4091 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.943362  3923 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.953243  4091 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.965339  3747 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.969336  3921 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:20.951583  4047 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.972249  4091 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:20.973673  3964 leader_election.cc:343] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:20.975845  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:20.976245  3922 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:20.976562  3998 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.979612  4093 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:20.967283  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:20.981385  4068 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:20.982065  4084 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.982872  4068 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.988674  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:20.988914  4068 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:20.981891  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:20.995822  4042 raft_consensus.cc:359] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.996592  4042 raft_consensus.cc:385] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:20.996873  4042 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:20.997568  4042 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:20.998730  4052 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:20.999914  4040 tablet_bootstrap.cc:654] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.003925  4042 ts_tablet_manager.cc:1434] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.004s
I20260709 12:20:21.004400  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.005179  4042 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.005582  4084 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.006307  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.010479  4084 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.010655  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.010514  3997 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.014235  4084 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.012261  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.021714  3850 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:21.014575  4093 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:21.013038  3848 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:21.020634  3998 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:20:21.028779  3962 leader_election.cc:343] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.029460  3962 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.035106  4154 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.035175  4091 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.039438  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.040153  3962 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.040683  4093 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.041043  4093 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.041126  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.041461  4093 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.047962  4091 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.059578  4091 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.060137  4091 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.060927  4068 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.062884  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.042296  4154 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.064319  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.144325  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:21.144721  4042 tablet_bootstrap.cc:654] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.148356  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.149139  3997 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.153337  4115 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.154567  3849 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:21.141037  4084 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:20:21.156582  4047 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.159114  4040 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.159662  4040 ts_tablet_manager.cc:1403] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.300s	user 0.017s	sys 0.018s
I20260709 12:20:21.134495  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.139279  4154 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.126372  4091 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.174232  4091 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.175284  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.176192  3919 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:21.161036  4068 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.183085  4040 raft_consensus.cc:359] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.184890  4040 raft_consensus.cc:385] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.185176  4040 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.170065  4115 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.186753  4040 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.178251  4154 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.190400  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.193609  3997 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:21.195106  3964 leader_election.cc:343] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.195151  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:21.196074  3848 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.197008  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:21.182282  3924 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.209383  4152 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.182955  4091 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.211061  4155 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.014s
I20260709 12:20:21.211591  4087 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.212368  4047 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.216348  3848 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:21.218236  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.219429  4040 ts_tablet_manager.cc:1434] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:20:21.218336  4152 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.227415  4040 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.223346  4042 tablet_bootstrap.cc:492] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:21.230512  4042 ts_tablet_manager.cc:1403] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.226s	user 0.025s	sys 0.008s
I20260709 12:20:21.232473  4068 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:21.227573  4153 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
I20260709 12:20:21.224623  4091 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.244216  4093 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.247841  4093 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.238148  4068 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:21.248705  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.252389  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.260057  4039 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.260610  4039 ts_tablet_manager.cc:1403] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.483s	user 0.015s	sys 0.003s
I20260709 12:20:21.260205  4068 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.262058  3997 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.261071  3747 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.269836  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.284492  4042 raft_consensus.cc:359] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.285567  4042 raft_consensus.cc:385] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.285930  4042 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.267848  4152 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.287796  4042 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.294991  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.280499  4142 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.292196  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:21.322825  3815 leader_election.cc:343] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.316118  3923 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.326323  4042 ts_tablet_manager.cc:1434] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.002s
I20260709 12:20:21.327885  4042 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.328415  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.329038  3995 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.331116  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.332366  4093 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.332746  4093 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.333069  4093 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.338853  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.323120  4142 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:21.341033  4142 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.343050  4093 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.344280  3850 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:21.344599  3997 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.353562  4091 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.356734  4040 tablet_bootstrap.cc:654] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.327101  3921 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.366608  4154 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.366472  4039 raft_consensus.cc:359] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.367633  4039 raft_consensus.cc:385] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.367966  4039 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.368788  4039 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.371168  4039 ts_tablet_manager.cc:1434] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:20:21.372397  4039 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:21.384018  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.389492  4093 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.395349  4154 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.399294  4042 tablet_bootstrap.cc:654] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.391397  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:21.403281  3964 leader_election.cc:343] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.405323  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:21.406055  3850 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.407430  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.409626  4091 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.417378  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.417685  3923 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:21.410293  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.419946  4115 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.420473  4115 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.421375  4152 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.421868  4152 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.419272  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.423979  4152 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.426534  3850 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:20:21.427667  3815 leader_election.cc:343] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.427719  3962 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.428117  4165 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:20:21.428660  4142 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.428717  4091 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.429792  4142 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:21.431288  4142 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.421368  4115 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.440227  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.440699  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.441777  4039 tablet_bootstrap.cc:654] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:21.443574  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:20:21.445292  3815 leader_election.cc:343] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:21.446521  3964 leader_election.cc:343] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.450527  4154 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.451092  3995 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.455052  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.466454  3747 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.467396  4151 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.470168  4151 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.472618  4040 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.473234  4040 ts_tablet_manager.cc:1403] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.246s	user 0.013s	sys 0.010s
I20260709 12:20:21.471076  4151 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.473838  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.475293  3995 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.487953  4040 raft_consensus.cc:359] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.488620  4040 raft_consensus.cc:385] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.488891  4040 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.489400  4040 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.491235  3814 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.491787  4040 ts_tablet_manager.cc:1434] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:20:21.492183  4093 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.492704  4093 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.493098  4093 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.493178  3745 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.497713  4040 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.505154  4142 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.513700  4039 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.514201  4039 ts_tablet_manager.cc:1403] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.013s
I20260709 12:20:21.515390  3748 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.521126  4093 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.537896  4039 raft_consensus.cc:359] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.539237  4039 raft_consensus.cc:385] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.539604  4039 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.540228  4040 tablet_bootstrap.cc:654] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.540582  4039 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.543200  4039 ts_tablet_manager.cc:1434] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.029s	user 0.013s	sys 0.009s
I20260709 12:20:21.549630  4039 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:21.554939  3745 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.559013  4093 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.560595  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.562847  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.563704  3995 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:21.566286  3815 leader_election.cc:343] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.600291  4093 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.601886  4042 tablet_bootstrap.cc:492] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:21.602638  4042 ts_tablet_manager.cc:1403] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.275s	user 0.022s	sys 0.015s
I20260709 12:20:21.606647  4042 raft_consensus.cc:359] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.607756  4042 raft_consensus.cc:385] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.608053  4042 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.608843  4042 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.611282  4042 ts_tablet_manager.cc:1434] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:20:21.612521  4042 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.614078  4040 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.614554  4040 ts_tablet_manager.cc:1403] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.117s	user 0.036s	sys 0.043s
I20260709 12:20:21.617170  4040 raft_consensus.cc:359] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.617847  4040 raft_consensus.cc:385] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.618165  4040 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.618934  4040 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.621397  4040 ts_tablet_manager.cc:1434] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:21.622412  4040 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.620357  4042 tablet_bootstrap.cc:654] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.625360  4093 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.631031  4040 tablet_bootstrap.cc:654] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.645454  4042 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:21.646210  4042 ts_tablet_manager.cc:1403] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 12:20:21.650353  4042 raft_consensus.cc:359] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.651114  4042 raft_consensus.cc:385] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.651407  4042 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.611321  4039 tablet_bootstrap.cc:654] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.652181  4042 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.655190  4042 ts_tablet_manager.cc:1434] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:20:21.656301  4042 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.665387  4042 tablet_bootstrap.cc:654] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.673771  4110 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.671278  3995 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.686079  4040 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.686028  3814 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.686800  4040 ts_tablet_manager.cc:1403] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.023s
I20260709 12:20:21.687772  4115 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.688530  4115 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.690026  4040 raft_consensus.cc:359] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.690623  4039 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.690742  4040 raft_consensus.cc:385] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.689792  4115 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.691089  4039 ts_tablet_manager.cc:1403] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.142s	user 0.013s	sys 0.000s
I20260709 12:20:21.691035  4040 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.691869  4040 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.693992  4040 ts_tablet_manager.cc:1434] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:21.694934  4040 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.694649  4039 raft_consensus.cc:359] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.695433  4039 raft_consensus.cc:385] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.695880  4039 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.701788  4040 tablet_bootstrap.cc:654] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.701352  4110 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.704038  3748 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.696635  4039 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.712808  4039 ts_tablet_manager.cc:1434] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:20:21.714049  4039 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:21.716521  4040 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.717037  4040 ts_tablet_manager.cc:1403] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:20:21.720191  4040 raft_consensus.cc:359] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.721160  4040 raft_consensus.cc:385] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.721493  4040 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.724030  4039 tablet_bootstrap.cc:654] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.725224  4040 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.727916  4040 ts_tablet_manager.cc:1434] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:20:21.728873  4040 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.735378  4040 tablet_bootstrap.cc:654] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.752298  4154 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:21.755846  4093 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.756467  4093 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.756534  4047 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.760200  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.760474  4047 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:21.761713  3815 leader_election.cc:343] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.762558  4047 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.763262  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.764503  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:21.764680  3815 leader_election.cc:343] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.765148  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.766636  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.767980  4151 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.768488  4151 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.768946  4151 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.771646  4091 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.772341  4091 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.775072  4091 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.784387  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.782859  3748 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.788385  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.800266  4039 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.800949  4039 ts_tablet_manager.cc:1403] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.000s
I20260709 12:20:21.806633  4151 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.808324  3850 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:21.809894  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.810122  4039 raft_consensus.cc:359] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.810757  4039 raft_consensus.cc:385] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.811062  4039 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
W20260709 12:20:21.812001  3815 leader_election.cc:343] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.814195  4151 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.812093  4039 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.815080  4087 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.815539  4087 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.817579  4087 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.818711  4040 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.819274  4040 ts_tablet_manager.cc:1403] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.091s	user 0.032s	sys 0.025s
W20260709 12:20:21.819751  3964 leader_election.cc:343] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.821630  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.822250  4040 raft_consensus.cc:359] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.822711  3996 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.823115  4040 raft_consensus.cc:385] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.823529  4040 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.824331  4040 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.825064  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.826045  3995 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.827100  4040 ts_tablet_manager.cc:1434] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:21.828239  4040 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.828974  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.830405  4039 ts_tablet_manager.cc:1434] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:20:21.831374  4039 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:21.835493  4040 tablet_bootstrap.cc:654] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.836026  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.836942  4151 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.837343  4151 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.839079  4087 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:21.837688  4151 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.793099  4093 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.837482  4039 tablet_bootstrap.cc:654] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.849385  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.843720  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.853570  4151 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.857918  3995 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.858695  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.859709  3850 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:20:21.860502  3815 leader_election.cc:343] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:21.839561  3964 leader_election.cc:343] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.861905  4042 tablet_bootstrap.cc:492] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:21.862361  4042 ts_tablet_manager.cc:1403] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.206s	user 0.052s	sys 0.083s
I20260709 12:20:21.864964  4042 raft_consensus.cc:359] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.865651  4042 raft_consensus.cc:385] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.865932  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.866794  4087 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.871068  4151 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.873937  4087 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.865932  4042 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.876349  4042 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.878791  4042 ts_tablet_manager.cc:1434] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:20:21.879787  4042 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.880060  4091 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.885031  4040 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:21.885600  4040 ts_tablet_manager.cc:1403] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.010s
I20260709 12:20:21.885748  4042 tablet_bootstrap.cc:654] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.887156  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.888063  4151 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.888546  4151 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.889744  4087 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.889353  4151 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.889869  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:21.890241  4087 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.892371  4087 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.893527  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.894189  3850 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:21.895435  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.896267  4039 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.896292  4087 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.896999  4039 ts_tablet_manager.cc:1403] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.007s
I20260709 12:20:21.896948  4087 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.897430  4087 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.898473  4110 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.898343  4040 raft_consensus.cc:359] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.899262  4040 raft_consensus.cc:385] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.899006  4110 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.899770  4040 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.899756  4039 raft_consensus.cc:359] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.900754  4039 raft_consensus.cc:385] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.901067  4039 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.901759  4110 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.901957  4039 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.902537  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.903362  3850 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:21.904222  4039 ts_tablet_manager.cc:1434] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:21.905467  4039 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:21.908767  3996 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:21.908581  4087 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.911243  4039 tablet_bootstrap.cc:654] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:21.911490  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:21.911851  4087 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:21.912125  3850 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.901953  4040 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.920600  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:21.920928  4040 ts_tablet_manager.cc:1434] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:20:21.921913  4151 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.922343  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.923004  4151 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:21.923918  4151 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:21.926302  3964 leader_election.cc:343] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.927553  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:21.927922  4040 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:21.924342  4084 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.928637  4084 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.929162  4115 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.930788  4084 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.930576  4091 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:21.932546  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.933208  3999 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:21.925666  4042 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:21.933681  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.934299  4042 ts_tablet_manager.cc:1403] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.005s
I20260709 12:20:21.934574  3996 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:21.937297  4148 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.937439  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:21.937803  4042 raft_consensus.cc:359] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.937855  4148 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.938387  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.939284  4084 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:21.939693  4084 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.940032  4084 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.940198  4148 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:21.941375  4040 tablet_bootstrap.cc:654] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:21.941838  3815 leader_election.cc:343] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.942162  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:21.927426  3850 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:21.948529  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.950346  4110 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.954032  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:21.956151  3745 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.957777  4087 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:21.958523  4087 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:20:21.958688  3964 leader_election.cc:343] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.938612  4042 raft_consensus.cc:385] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:21.963726  4042 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:21.959426  4087 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.964540  4042 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.971987  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:21.975597  3919 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:21.975422  4084 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:21.978763  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:21.980399  3815 leader_election.cc:343] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:21.983385  3745 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.987053  4039 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:21.986716  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:21.989485  4039 ts_tablet_manager.cc:1403] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.016s
I20260709 12:20:21.985881  4042 ts_tablet_manager.cc:1434] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 12:20:21.989817  4148 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:21.991204  4042 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:21.989800  4110 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.000366  4084 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.012594  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.013446  3997 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.036171  4110 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.036790  4110 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.040443  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.000998  4084 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:20:22.045246  3745 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.046999  4110 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.049400  4039 raft_consensus.cc:359] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.051558  4039 raft_consensus.cc:385] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.051877  4039 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.052582  4039 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.053421  3919 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.054499  4039 ts_tablet_manager.cc:1434] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:20:22.055483  4039 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.059170  4040 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.058032  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.060611  3996 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:22.059728  4040 ts_tablet_manager.cc:1403] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.005s
I20260709 12:20:22.063244  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.064810  4084 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.065330  4084 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.069125  4151 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.067435  4084 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.077736  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.071532  3997 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:22.076210  4087 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:20:22.082037  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.084132  4042 tablet_bootstrap.cc:654] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.085978  4110 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:22.086937  3815 leader_election.cc:343] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:22.088925  3814 leader_election.cc:343] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.089411  3814 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:22.090629  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.091418  4084 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.092142  4084 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.092650  4084 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:22.093621  4084 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.094763  4110 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:22.097339  4039 tablet_bootstrap.cc:654] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.095242  4110 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.105548  4047 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.122339  4040 raft_consensus.cc:359] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.123406  4040 raft_consensus.cc:385] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.124737  4040 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.125636  4087 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.126260  4087 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.128510  4087 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.129403  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.131174  4040 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.134718  4040 ts_tablet_manager.cc:1434] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.002s
I20260709 12:20:22.135423  3848 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:22.135936  4040 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.137576  3962 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.138811  4087 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.139225  4087 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.139598  4087 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.170630  4110 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.171962  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.172919  4110 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.174453  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:20:22.174695  3964 leader_election.cc:343] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.175886  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.179603  4040 tablet_bootstrap.cc:654] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.181663  4084 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.183063  4087 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.182180  4084 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.188351  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.188783  4084 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.191280  4148 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:22.193451  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.193737  3919 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:22.194176  3999 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:22.195916  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.196934  4039 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.197448  4039 ts_tablet_manager.cc:1403] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.022s
I20260709 12:20:22.196965  4151 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.199954  4151 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.200347  4151 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.199414  3748 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.201046  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:22.205091  3815 leader_election.cc:343] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.206245  4115 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.207186  4115 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.207628  4115 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:22.207964  4087 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.208492  4115 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.213980  4042 tablet_bootstrap.cc:492] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.214547  4042 ts_tablet_manager.cc:1403] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.020s
I20260709 12:20:22.216305  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:22.217034  3848 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.209699  4115 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.217715  4042 raft_consensus.cc:359] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.224053  4039 raft_consensus.cc:359] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.233785  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.226141  4042 raft_consensus.cc:385] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.247121  4042 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.247573  4039 raft_consensus.cc:385] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.247884  4039 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
W20260709 12:20:22.247992  3964 leader_election.cc:343] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.248629  4039 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.246289  4040 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.227731  4151 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.247931  4042 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.250039  4040 ts_tablet_manager.cc:1403] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.114s	user 0.019s	sys 0.022s
I20260709 12:20:22.251590  4042 ts_tablet_manager.cc:1434] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:20:22.253626  4151 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.242861  3848 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:22.254639  4040 raft_consensus.cc:359] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.255115  3962 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.255388  4040 raft_consensus.cc:385] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.255754  4040 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.256404  4142 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.251967  4039 ts_tablet_manager.cc:1434] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.006s
I20260709 12:20:22.256973  4142 raft_consensus.cc:697] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:22.262197  4039 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.262035  4142 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.257758  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:22.266330  3815 leader_election.cc:343] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.258347  4042 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.256949  4040 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.260972  3919 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.268587  4039 tablet_bootstrap.cc:654] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.268740  4040 ts_tablet_manager.cc:1434] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:20:22.269829  4040 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.257148  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.271836  3996 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.276458  4040 tablet_bootstrap.cc:654] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.277598  4039 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.282567  4039 ts_tablet_manager.cc:1403] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 12:20:22.285662  4039 raft_consensus.cc:359] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.286473  4039 raft_consensus.cc:385] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.286643  4042 tablet_bootstrap.cc:654] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.286217  3747 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.286901  4039 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.287154  4115 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.287668  4115 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.287901  4151 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.287846  4039 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.291009  4039 ts_tablet_manager.cc:1434] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:22.292024  4039 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.293644  4084 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.297278  4087 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.297766  4087 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.298427  4039 tablet_bootstrap.cc:654] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.300028  4087 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.300522  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.301586  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:22.303069  3962 leader_election.cc:343] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:22.303682  3815 leader_election.cc:343] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.305518  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:22.307220  3964 leader_election.cc:343] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.307703  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.308825  4087 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.307220  4040 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.310014  4040 ts_tablet_manager.cc:1403] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.008s
I20260709 12:20:22.313027  4040 raft_consensus.cc:359] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.313900  4040 raft_consensus.cc:385] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.314220  4040 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.314905  4040 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.318735  4115 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.281445  3996 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:22.320176  4115 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.320930  4040 ts_tablet_manager.cc:1434] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:22.321511  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.321506  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.329444  4151 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.330128  4151 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:22.331916  4042 tablet_bootstrap.cc:492] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.331275  4151 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.332391  4042 ts_tablet_manager.cc:1403] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.004s
I20260709 12:20:22.333856  4040 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.335034  4042 raft_consensus.cc:359] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.335765  4042 raft_consensus.cc:385] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.336066  4042 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
W20260709 12:20:22.335979  3814 leader_election.cc:343] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.336808  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:22.336970  4042 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.338232  4047 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.338985  4042 ts_tablet_manager.cc:1434] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:20:22.343966  4042 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.347424  4047 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.350041  4042 tablet_bootstrap.cc:654] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.357910  4087 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:22.367259  3964 consensus_peers.cc:597] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.371434  4093 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.372308  4040 tablet_bootstrap.cc:654] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.388995  4042 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.389461  4042 ts_tablet_manager.cc:1403] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.009s
I20260709 12:20:22.392580  4042 raft_consensus.cc:359] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.393812  4042 raft_consensus.cc:385] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.394090  4042 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.394930  4042 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.397050  4042 ts_tablet_manager.cc:1434] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:22.397998  4042 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.404680  4040 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.405359  4040 ts_tablet_manager.cc:1403] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.003s
I20260709 12:20:22.411715  4042 tablet_bootstrap.cc:654] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.413602  4040 raft_consensus.cc:359] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.414335  4040 raft_consensus.cc:385] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.414625  4040 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.415472  4040 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.417817  4040 ts_tablet_manager.cc:1434] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:20:22.418824  4040 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.419209  4039 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.419697  4039 ts_tablet_manager.cc:1403] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.128s	user 0.034s	sys 0.047s
I20260709 12:20:22.434058  4039 raft_consensus.cc:359] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.434772  4039 raft_consensus.cc:385] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.435029  4039 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.435689  4039 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.437250  4039 ts_tablet_manager.cc:1434] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:20:22.438189  4039 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.449535  4040 tablet_bootstrap.cc:654] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.490136  3745 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.503986  4042 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.505623  4042 ts_tablet_manager.cc:1403] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.031s
I20260709 12:20:22.505939  3919 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.508973  4042 raft_consensus.cc:359] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.509645  4042 raft_consensus.cc:385] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.509900  4042 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.510524  4042 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.512524  4042 ts_tablet_manager.cc:1434] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:22.519910  4039 tablet_bootstrap.cc:654] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.524441  4232 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.527081  4040 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.527628  4040 ts_tablet_manager.cc:1403] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
W20260709 12:20:22.532130  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:22.538398  4042 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.541623  4039 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.542186  4039 ts_tablet_manager.cc:1403] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.006s
I20260709 12:20:22.541785  4040 raft_consensus.cc:359] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.543015  4040 raft_consensus.cc:385] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.543385  4040 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.544237  4040 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.546624  4040 ts_tablet_manager.cc:1434] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:20:22.547753  4040 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.550221  4039 raft_consensus.cc:359] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.550753  4148 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.550979  4039 raft_consensus.cc:385] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.551390  4039 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.551280  4148 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.553503  4148 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.552263  4039 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.554740  4040 tablet_bootstrap.cc:654] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.556121  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.558323  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.560689  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.562497  4148 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.563536  4042 tablet_bootstrap.cc:654] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.565974  4039 ts_tablet_manager.cc:1434] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:20:22.567529  4039 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.577162  4039 tablet_bootstrap.cc:654] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.583886  4087 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.584426  4087 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.586485  4087 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.588300  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.590545  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:22.590874  3962 leader_election.cc:343] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.591434  4039 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.592059  4039 ts_tablet_manager.cc:1403] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
W20260709 12:20:22.592190  3964 leader_election.cc:343] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.592654  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.593430  4087 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.590515  4040 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.594154  4040 ts_tablet_manager.cc:1403] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.024s
I20260709 12:20:22.595386  4042 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.596541  4039 raft_consensus.cc:359] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.597538  4039 raft_consensus.cc:385] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.597819  4039 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.598434  4040 raft_consensus.cc:359] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.598589  4039 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.599380  4040 raft_consensus.cc:385] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.599794  4040 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.600859  4039 ts_tablet_manager.cc:1434] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:22.600692  4040 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.602404  4039 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.603711  4040 ts_tablet_manager.cc:1434] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:22.604936  4040 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.608532  4039 tablet_bootstrap.cc:654] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.609354  4042 ts_tablet_manager.cc:1403] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.011s
I20260709 12:20:22.611792  4040 tablet_bootstrap.cc:654] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.614743  4042 raft_consensus.cc:359] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.618702  4042 raft_consensus.cc:385] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.618999  4042 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.619707  4042 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.621961  4039 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.622179  4040 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.622531  4039 ts_tablet_manager.cc:1403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 12:20:22.622839  4040 ts_tablet_manager.cc:1403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:20:22.625239  4039 raft_consensus.cc:359] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.625927  4039 raft_consensus.cc:385] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.626317  4039 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.625758  4040 raft_consensus.cc:359] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.626981  4040 raft_consensus.cc:385] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.627038  4039 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.627419  4040 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.628424  4040 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.629195  4039 ts_tablet_manager.cc:1434] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:22.630106  4039 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.631137  4040 ts_tablet_manager.cc:1434] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:20:22.632556  4040 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.634171  4042 ts_tablet_manager.cc:1434] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:20:22.635083  4042 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.635882  4039 tablet_bootstrap.cc:654] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.641258  4040 tablet_bootstrap.cc:654] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.653709  4042 tablet_bootstrap.cc:654] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.654808  4110 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.655499  4110 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.658253  4110 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.659392  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.659782  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.660521  3999 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:22.664685  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.666507  4087 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.667063  4087 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.667543  4148 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.670276  4087 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.672004  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.672700  3850 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:22.674016  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.674988  4087 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.675407  4087 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.675465  4110 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.675887  4087 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.676028  4110 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.678259  3919 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.676383  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.685568  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:22.689819  3964 leader_election.cc:343] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.722909  4110 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.725454  4110 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.726068  4110 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.748759  4232 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.760844  4148 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.761317  4110 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.762179  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.764200  3848 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:22.761961  4232 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.764569  4040 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.765070  4040 ts_tablet_manager.cc:1403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.026s
I20260709 12:20:22.765619  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.766367  4232 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:22.761997  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 72234.3us
I20260709 12:20:22.767069  4110 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.767549  4110 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.764359  4039 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.768301  4039 ts_tablet_manager.cc:1403] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.031s
I20260709 12:20:22.767943  4040 raft_consensus.cc:359] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.767956  4110 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.769436  4040 raft_consensus.cc:385] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.768708  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.769807  4040 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.770466  3999 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:22.770605  4040 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.772189  4040 ts_tablet_manager.cc:1434] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:20:22.773102  4040 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.774716  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.775374  3999 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:22.776925  4232 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.777529  4151 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.780051  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.780287  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.780120  4110 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.780993  4151 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.781373  4151 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.781710  4151 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.782742  4110 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.784567  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:22.784752  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.785230  3848 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:22.786684  3964 consensus_peers.cc:597] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.788249  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:22.794278  3815 leader_election.cc:343] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.799535  4232 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.799955  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.800241  4232 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.803122  4232 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.804041  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.804227  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.804904  3998 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
W20260709 12:20:22.805481  3815 leader_election.cc:343] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.805327  4151 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.804888  4110 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:22.807626  4151 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.807647  3814 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.808202  4232 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.808719  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.809798  3848 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:22.810096  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.810626  3998 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.811578  4232 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.811971  4232 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.812299  4232 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.812242  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:22.813190  3815 leader_election.cc:343] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.818966  4110 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.820725  4087 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.821280  4110 raft_consensus.cc:697] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:22.821619  4039 raft_consensus.cc:359] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.822368  4039 raft_consensus.cc:385] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.822717  4039 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.823012  4087 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.823683  4039 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:22.824479  3889 leader_election.cc:343] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.825807  4042 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.826038  4039 ts_tablet_manager.cc:1434] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:20:22.826288  4042 ts_tablet_manager.cc:1403] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.191s	user 0.009s	sys 0.003s
I20260709 12:20:22.827033  4039 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:22.822230  4110 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.829236  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:22.829291  4042 raft_consensus.cc:359] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.829962  3848 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.830211  4042 raft_consensus.cc:385] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.830642  4042 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.831233  4042 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.824923  3998 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:22.833931  4042 ts_tablet_manager.cc:1434] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:22.833956  4142 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.834643  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.834591  4142 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.835522  4040 tablet_bootstrap.cc:654] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.836069  4047 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.837013  4142 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.838146  4047 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:22.838747  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.839761  3850 raft_consensus.cc:2393] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:22.839085  4047 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.841733  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.843920  4142 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.844610  4115 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.844452  4142 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.845078  4115 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.844909  4232 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.846552  4142 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.847944  4232 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.835006  4042 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.847268  4115 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.848461  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.849259  3850 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:22.851042  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.852200  4091 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.852594  4091 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.852958  4091 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.852854  4165 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:22.855111  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.855800  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:22.858017  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.858742  3924 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:22.861311  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.861950  3996 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.862612  4042 tablet_bootstrap.cc:654] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.865823  4039 tablet_bootstrap.cc:654] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.862547  4091 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.870889  3996 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:22.873481  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.875983  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.877481  4115 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:22.877867  4115 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.878214  4115 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.880187  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:22.880801  3849 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.885526  4115 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.885979  4042 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:22.886862  4042 ts_tablet_manager.cc:1403] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.014s
I20260709 12:20:22.888319  3849 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:22.889103  4115 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.889654  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.890516  4087 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.891256  4087 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:22.892127  4091 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:22.892164  4087 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.890551  4042 raft_consensus.cc:359] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:22.874256  3889 leader_election.cc:343] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.895860  4042 raft_consensus.cc:385] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.899995  4042 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.894778  3745 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.895543  3848 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:20:22.904533  3964 leader_election.cc:343] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.905916  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:22.906970  4091 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.904843  4042 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.909580  4040 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:22.910077  4040 ts_tablet_manager.cc:1403] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.004s
I20260709 12:20:22.913194  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:22.913848  3996 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.913734  3814 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:22.908569  4091 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:22.916163  4042 ts_tablet_manager.cc:1434] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.006s
I20260709 12:20:22.917814  4042 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:22.918514  4084 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.919494  4084 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:22.920382  4084 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.920017  3746 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.923785  4110 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.924288  4110 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:22.924750  3815 leader_election.cc:343] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.925520  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.918684  4091 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.926419  4110 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:22.928532  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:22.933632  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.935712  3925 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.947036  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:22.947769  3924 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.949847  4039 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:22.950338  4039 ts_tablet_manager.cc:1403] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.008s
I20260709 12:20:22.960321  4040 raft_consensus.cc:359] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.962368  4040 raft_consensus.cc:385] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.962759  4040 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.954262  3745 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.967389  4040 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.965909  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:22.970908  4039 raft_consensus.cc:359] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.976953  4039 raft_consensus.cc:385] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.977275  4039 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.975158  3964 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:22.977995  4039 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:22.984140  4040 ts_tablet_manager.cc:1434] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.005s
I20260709 12:20:22.985188  4040 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:22.988099  4042 tablet_bootstrap.cc:654] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:22.988307  3964 leader_election.cc:343] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:22.989207  3964 leader_election.cc:343] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:22.993639  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:22.993834  4047 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.995810  4256 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.996213  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:22.997859  4091 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.998591  4091 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.000382  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:23.003233  4039 ts_tablet_manager.cc:1434] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:20:23.004181  4039 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:23.005393  4047 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.007385  4047 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:23.008286  4047 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.013085  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:23.014642  3962 leader_election.cc:343] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.015519  3924 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:23.015743  4091 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.020150  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:23.024417  4110 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:23.026549  4042 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:23.027230  4042 ts_tablet_manager.cc:1403] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.008s
I20260709 12:20:23.030526  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.031605  4256 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:23.033386  3964 leader_election.cc:343] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.033840  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:23.041607  4040 tablet_bootstrap.cc:654] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.034766  4256 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:23.055856  4042 raft_consensus.cc:359] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.056550  4042 raft_consensus.cc:385] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.056800  4042 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.057471  4042 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.057946  4039 tablet_bootstrap.cc:654] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.060073  4042 ts_tablet_manager.cc:1434] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:20:23.061407  4042 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:23.048751  3746 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.070124  4040 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:23.070660  4040 ts_tablet_manager.cc:1403] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.011s
I20260709 12:20:23.078661  4042 tablet_bootstrap.cc:654] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.081106  4040 raft_consensus.cc:359] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.082443  4040 raft_consensus.cc:385] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.082733  4040 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.083547  4040 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.085810  3745 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.090605  4042 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:23.091115  4042 ts_tablet_manager.cc:1403] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.005s
I20260709 12:20:23.093852  4042 raft_consensus.cc:359] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.094525  4042 raft_consensus.cc:385] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.094930  4039 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:23.094810  4042 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.095587  4039 ts_tablet_manager.cc:1403] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.007s
I20260709 12:20:23.095913  4042 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.098404  4042 ts_tablet_manager.cc:1434] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:23.099339  4042 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:23.100172  4040 ts_tablet_manager.cc:1434] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 12:20:23.102339  4040 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:23.100890  4039 raft_consensus.cc:359] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.103006  4039 raft_consensus.cc:385] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.103327  4039 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.104925  4151 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.105436  4151 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.105907  4042 tablet_bootstrap.cc:654] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.107573  4151 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.109601  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.110373  4040 tablet_bootstrap.cc:654] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.101260  3747 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:23.111341  3815 leader_election.cc:343] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.112663  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:23.122996  3814 leader_election.cc:343] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.123486  3814 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:23.125079  4115 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:23.125984  4042 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:23.126683  4042 ts_tablet_manager.cc:1403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 12:20:23.104162  4039 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.131024  4042 raft_consensus.cc:359] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.131953  4039 ts_tablet_manager.cc:1434] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:20:23.131963  4042 raft_consensus.cc:385] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.132546  4042 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.133212  4039 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:23.133422  4042 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.141399  4042 ts_tablet_manager.cc:1434] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:20:23.142699  4042 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:23.154382  4039 tablet_bootstrap.cc:654] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.156138  4040 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:23.156695  4040 ts_tablet_manager.cc:1403] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.038s
I20260709 12:20:23.154497  4042 tablet_bootstrap.cc:654] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.158386  4151 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.158936  4151 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.159523  4040 raft_consensus.cc:359] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.160194  4040 raft_consensus.cc:385] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.160460  4040 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.161113  4040 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.162154  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.162509  4039 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:23.163582  4040 ts_tablet_manager.cc:1434] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:23.163563  4039 ts_tablet_manager.cc:1403] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.003s
I20260709 12:20:23.163535  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:23.164145  3815 leader_election.cc:343] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.164716  4040 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:23.166529  4039 raft_consensus.cc:359] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.167095  4039 raft_consensus.cc:385] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.167317  4039 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.167795  4151 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.168119  4039 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.171376  4040 tablet_bootstrap.cc:654] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.171482  4042 tablet_bootstrap.cc:492] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:23.172176  4042 ts_tablet_manager.cc:1403] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.009s
I20260709 12:20:23.172075  3996 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:23.174448  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:23.175230  4047 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.175631  4047 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.175963  4047 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.175047  4042 raft_consensus.cc:359] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.176652  4042 raft_consensus.cc:385] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.176998  4042 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.177914  4042 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.171679  4039 ts_tablet_manager.cc:1434] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:23.184300  4042 ts_tablet_manager.cc:1434] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:23.184811  4039 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:23.185420  4042 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:23.182865  4047 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.194005  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:23.195834  3815 leader_election.cc:343] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.198216  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:23.198922  3996 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.199164  4042 tablet_bootstrap.cc:654] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.202111  4047 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.208915  3996 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:23.210336  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:23.211884  4047 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.212476  4047 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:23.213639  4047 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.217444  4040 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:23.218044  4040 ts_tablet_manager.cc:1403] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.017s
I20260709 12:20:23.218495  4039 tablet_bootstrap.cc:654] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.220854  4040 raft_consensus.cc:359] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.221612  4040 raft_consensus.cc:385] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.221951  4040 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.222770  4040 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.224398  4040 ts_tablet_manager.cc:1434] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:23.225410  4040 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:23.228324  4039 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:23.228833  4039 ts_tablet_manager.cc:1403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 12:20:23.231516  4040 tablet_bootstrap.cc:654] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.232065  4039 raft_consensus.cc:359] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.231141  3746 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.232760  4039 raft_consensus.cc:385] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.232968  4042 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:23.233099  4039 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.233438  4042 ts_tablet_manager.cc:1403] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 12:20:23.233810  4039 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.235970  4039 ts_tablet_manager.cc:1434] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:23.237046  4039 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:23.242291  4039 tablet_bootstrap.cc:654] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.243026  4042 raft_consensus.cc:359] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.243901  4042 raft_consensus.cc:385] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.244256  4042 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.244987  4042 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.247404  3925 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.266566  4047 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:23.269601  4042 ts_tablet_manager.cc:1434] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:20:23.271018  4256 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.272310  4256 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.273026  4040 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:23.273495  4040 ts_tablet_manager.cc:1403] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.028s
I20260709 12:20:23.274492  4256 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.276249  4040 raft_consensus.cc:359] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.276636  4042 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:23.279958  4039 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:23.280426  4039 ts_tablet_manager.cc:1403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.027s
I20260709 12:20:23.271162  4091 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.283653  4040 raft_consensus.cc:385] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.284582  4040 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.285245  4040 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.286880  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.283178  4039 raft_consensus.cc:359] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.287532  4039 raft_consensus.cc:385] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.287961  4039 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.288879  4039 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.290823  3924 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:23.292280  4040 ts_tablet_manager.cc:1434] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:20:23.292594  4039 ts_tablet_manager.cc:1434] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:20:23.294840  4040 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:23.297850  4110 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.298473  4110 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.302662  4110 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.303882  4039 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:23.304066  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:23.304704  3848 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:23.307246  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:23.308216  4256 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.308595  4256 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.308938  4256 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.313090  4042 tablet_bootstrap.cc:654] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.294402  4091 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.317368  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:23.318058  3997 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:23.319068  4091 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.319231  4165 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.319700  4165 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.332602  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:23.333389  3848 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:23.334645  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:23.369100  4110 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.394061  4087 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.394805  4087 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.385851  4110 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.461954  4110 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.455878  4232 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.473227  4232 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.482777  4243 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.497596  4243 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.666651  4087 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.680642  4243 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.684867  4040 tablet_bootstrap.cc:654] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.503981  4232 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.510378  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:23.708837  4087 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:23.598412  4110 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.706223  4165 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.706606  4256 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.717814  4087 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.755204  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.755784  4278 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.756203  3922 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:23.748580  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:23.768132  3916 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.756312  4278 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.809933  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:23.810745  3848 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:23.781569  4232 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.783759  4281 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 12:20:23.782385  3920 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.812361  4093 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.970112  4093 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.970530  4256 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.971954  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.972308  4093 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:23.974020  4087 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:23.913923  4278 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:23.839094  3814 leader_election.cc:343] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.841135  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.958882  4232 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:23.982208  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:23.982447  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:23.911696  4283 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.089s
W20260709 12:20:23.981534  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 142484us
I20260709 12:20:24.004580  4042 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:24.005416  4042 ts_tablet_manager.cc:1403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.729s	user 0.048s	sys 0.097s
W20260709 12:20:24.009758  3890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.025s	sys 0.037s
W20260709 12:20:24.010149  3890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.025s	sys 0.037s
I20260709 12:20:24.002197  3848 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:23.997112  3919 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.990933  4110 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.024325  4284 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.025125  4284 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.026639  4042 raft_consensus.cc:359] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.027812  4042 raft_consensus.cc:385] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.028167  4042 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.029520  4042 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.033952  4039 tablet_bootstrap.cc:654] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.034117  4042 ts_tablet_manager.cc:1434] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:20:24.040621  4042 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:24.045053  4047 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.059727  4040 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:24.060192  4040 ts_tablet_manager.cc:1403] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.766s	user 0.029s	sys 0.025s
I20260709 12:20:24.068012  4280 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.068867  3964 leader_election.cc:343] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.068558  4280 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:24.070367  3964 leader_election.cc:343] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.076099  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:24.076198  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:24.076707  3815 leader_election.cc:343] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.076840  3917 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.077266  3921 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:24.077240  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:24.063413  4110 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:20:24.067030  4232 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.056181  4047 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.088860  4283 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.082120  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.081593  3962 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:24.092530  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:24.109625  4282 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:20:24.107236  4288 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.112030  4281 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.112445  4281 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.112831  4281 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.099308  4047 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.095268  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:24.108901  4040 raft_consensus.cc:359] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.116540  4040 raft_consensus.cc:385] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.116847  4040 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.105698  3916 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.120445  3998 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:24.124615  3917 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:24.117558  4040 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.132748  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:24.133241  4284 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.130275  4281 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.134754  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:24.135376  3850 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.135571  3996 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:24.136420  4039 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:24.136595  4281 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:24.137262  4039 ts_tablet_manager.cc:1403] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.834s	user 0.015s	sys 0.021s
I20260709 12:20:24.139183  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.141662  4280 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.141577  4110 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:24.141160  4243 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.143528  4040 ts_tablet_manager.cc:1434] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.001s
W20260709 12:20:24.128934  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55993.7us
I20260709 12:20:24.148442  4040 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:24.150211  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.164644  4287 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.165411  4287 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.177551  3889 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:24.181447  4278 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:24.181977  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:24.185932  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:24.191757  4281 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.192682  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.196625  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:24.199146  4039 raft_consensus.cc:359] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.200166  4039 raft_consensus.cc:385] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.200528  4039 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.201362  4039 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.209826  4039 ts_tablet_manager.cc:1434] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 12:20:24.211004  4039 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:24.209789  4279 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.211695  4285 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:24.212637  3916 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:24.212021  4279 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:24.213469  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.214123  3999 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:24.215332  4042 tablet_bootstrap.cc:654] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.217553  4287 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.194305  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:24.220863  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.221654  3994 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:24.224118  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.213958  4279 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.247146  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:24.247947  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.248728  4287 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.249300  4287 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:20:24.249473  3814 leader_election.cc:343] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.250175  4287 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.250991  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:24.248659  3999 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:24.257131  3814 leader_election.cc:343] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.252722  4295 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:24.266078  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:24.268075  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:24.268884  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.278136  4293 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:24.281740  4293 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.282177  4293 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.271193  4278 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:24.282728  4278 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.283126  4278 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:24.265362  3815 leader_election.cc:343] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.278290  4289 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.280483  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.260079  4115 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:20:24.268882  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.299983  4047 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:24.300591  4047 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.290491  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:24.303663  4047 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.304342  4115 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.292289  4289 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.309993  4289 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.307245  4295 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:20:24.316056  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.314496  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:24.333587  3889 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:24.338194  4110 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:24.380767  4042 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:24.381319  4042 ts_tablet_manager.cc:1403] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.341s	user 0.008s	sys 0.007s
I20260709 12:20:24.398707  4039 tablet_bootstrap.cc:654] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.332377  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:24.378558  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.405902  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:24.341195  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.410518  4040 tablet_bootstrap.cc:654] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.415606  3841 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.419196  3843 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:24.452009  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:24.452857  3850 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:20:24.479476  4304 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
W20260709 12:20:24.494177  4305 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:20:24.491381  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:24.501902  4279 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:24.517156  3745 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.574401  4042 raft_consensus.cc:359] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.575543  4042 raft_consensus.cc:385] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.575877  4042 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.590348  4042 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.603948  4278 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.606019  4042 ts_tablet_manager.cc:1434] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.224s	user 0.014s	sys 0.000s
I20260709 12:20:24.646004  3918 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:24.681761  4042 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
W20260709 12:20:24.672040  4308 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:20:24.687526  4306 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:20:24.679955  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:24.683341  3815 leader_election.cc:343] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.688666  4293 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.716212  4287 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.732504  4287 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.684209  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:24.774782  4310 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:20:24.719718  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:24.778991  3849 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:24.772280  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:24.777145  4278 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.789865  4040 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:24.790491  4040 ts_tablet_manager.cc:1403] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.645s	user 0.021s	sys 0.020s
W20260709 12:20:24.787353  4315 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:20:24.794236  4256 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:24.791628  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:24.801141  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117869us
I20260709 12:20:24.794677  4292 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.817374  4040 raft_consensus.cc:359] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.824885  4040 raft_consensus.cc:385] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.825269  4040 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
W20260709 12:20:24.803063  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 129873us
W20260709 12:20:24.824134  4321 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:20:24.839810  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:24.844228  3962 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:24.845558  3841 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:24.845901  4281 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.846287  4281 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.846673  4281 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.848042  4326 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.827749  4040 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:24.839978  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 122164us
I20260709 12:20:24.855638  4293 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.856523  4040 ts_tablet_manager.cc:1434] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 12:20:24.864197  4287 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.868124  4281 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.873518  4040 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
W20260709 12:20:24.836758  3815 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:24.877460  4042 tablet_bootstrap.cc:654] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.890188  4256 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:24.868141  3888 leader_election.cc:343] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.893769  4324 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:24.879622  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46848.2us
I20260709 12:20:24.876030  4165 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.901841  4165 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.902377  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:24.903038  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:24.903710  3992 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:24.903110  3999 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
W20260709 12:20:24.897778  4289 consensus_meta.cc:287] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.570s	user 0.015s	sys 0.006s
W20260709 12:20:24.917824  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56525us
I20260709 12:20:24.968247  4281 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:24.982087  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:24.982668  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:24.983426  3843 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.984313  4110 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.984731  4110 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.985069  4110 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.963303  4289 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:24.984161  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:24.998113  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:24.998432  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:24.998675  4289 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:24.998907  3850 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
W20260709 12:20:25.000366  3964 leader_election.cc:343] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.999538  4256 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:24.999635  4324 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:25.001600  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.002736  3847 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:20:25.005888  3964 leader_election.cc:343] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:25.000931  3815 leader_election.cc:343] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.027685  4165 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.040220  4042 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.040704  4042 ts_tablet_manager.cc:1403] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.359s	user 0.031s	sys 0.025s
I20260709 12:20:25.049777  4040 tablet_bootstrap.cc:654] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.036751  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.064936  3994 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.051611  3843 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:25.053265  4039 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.068212  4039 ts_tablet_manager.cc:1403] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.857s	user 0.013s	sys 0.021s
I20260709 12:20:25.055047  4042 raft_consensus.cc:359] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.071519  4042 raft_consensus.cc:385] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.072042  4042 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.073218  4042 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.060652  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64931.2us
I20260709 12:20:25.060798  3992 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:20:25.091522  4042 ts_tablet_manager.cc:1434] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:20:25.123579  3747 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.125402  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:25.125540  4039 raft_consensus.cc:359] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.127732  4039 raft_consensus.cc:385] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.128072  4042 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.128149  4039 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.130326  4039 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.136333  4328 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.136929  4328 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.132092  4287 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:25.140354  4287 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:25.095794  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:25.103617  4110 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.141757  4039 ts_tablet_manager.cc:1434] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.003s
I20260709 12:20:25.141637  4287 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.143517  4328 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.146991  4039 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.150354  4042 tablet_bootstrap.cc:654] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.133894  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.155629  4328 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.162328  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:25.177594  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 43801.7us
I20260709 12:20:25.167012  4328 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.182578  4328 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.173485  3994 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:20:25.161631  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73322.9us
I20260709 12:20:25.189476  4319 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.189459  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:25.190326  4319 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.191602  3888 leader_election.cc:343] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:25.187577  3964 leader_election.cc:343] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.202242  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.207185  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.202864  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.197211  4115 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.194928  4319 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.221664  4115 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.229907  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.230189  4110 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.225309  4335 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:20:25.234793  3923 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.226573  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:25.238126  4165 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.230948  4295 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.254568  4342 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.264228  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.266558  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.262987  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.267220  3993 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.265543  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.262888  4115 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.270164  4291 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:25.269850  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:25.271648  3814 leader_election.cc:343] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:25.274029  3815 leader_election.cc:343] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.279385  4040 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:25.279923  4040 ts_tablet_manager.cc:1403] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.407s	user 0.018s	sys 0.030s
I20260709 12:20:25.275068  4295 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:25.285725  3745 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.259861  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:25.294906  4344 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.307224  4039 tablet_bootstrap.cc:654] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.316084  4344 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:25.317090  4344 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.321091  4350 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:20:25.298568  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60066.1us
I20260709 12:20:25.307663  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.328995  4319 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.329499  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.339625  4040 raft_consensus.cc:359] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.340636  4040 raft_consensus.cc:385] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.340991  4040 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.343719  4040 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.352108  4351 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:20:25.360327  3962 leader_election.cc:343] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.360880  3962 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:25.363080  4334 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.320492  4295 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.367920  3815 leader_election.cc:343] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.368432  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.369282  4292 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.372625  4040 ts_tablet_manager.cc:1434] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 12:20:25.373682  4040 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:25.380856  3993 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:25.382503  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:25.388447  4319 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.392041  4319 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:25.392875  4319 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.398204  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:25.347733  4328 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.405663  4328 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.407565  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.415280  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:25.415982  3842 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.418963  4042 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.419489  4042 ts_tablet_manager.cc:1403] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.292s	user 0.019s	sys 0.004s
I20260709 12:20:25.422245  4042 raft_consensus.cc:359] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.422919  4042 raft_consensus.cc:385] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.423198  4042 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
W20260709 12:20:25.423816  3964 leader_election.cc:343] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.423882  4042 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.426153  4042 ts_tablet_manager.cc:1434] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:20:25.427657  4042 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.428942  4040 tablet_bootstrap.cc:654] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.433818  4039 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.434324  4039 ts_tablet_manager.cc:1403] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.287s	user 0.017s	sys 0.024s
I20260709 12:20:25.435770  4042 tablet_bootstrap.cc:654] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.437492  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.441247  4039 raft_consensus.cc:359] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.444926  4039 raft_consensus.cc:385] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.445248  4039 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.446125  4039 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.448194  4039 ts_tablet_manager.cc:1434] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:20:25.459141  4039 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.466365  4039 tablet_bootstrap.cc:654] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.471282  4040 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:25.471971  4040 ts_tablet_manager.cc:1403] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.003s
I20260709 12:20:25.475219  3842 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:25.480232  4040 raft_consensus.cc:359] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.486649  4040 raft_consensus.cc:385] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.486937  4040 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.483876  4042 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.485785  4039 tablet_bootstrap.cc:492] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.487762  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:25.487897  4040 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.488571  4344 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.489037  4344 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:25.490144  4040 ts_tablet_manager.cc:1434] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:20:25.489876  4344 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.490626  4042 ts_tablet_manager.cc:1403] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 12:20:25.493983  4042 raft_consensus.cc:359] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.494796  4042 raft_consensus.cc:385] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.494956  4039 ts_tablet_manager.cc:1403] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.009s
I20260709 12:20:25.495141  4042 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.495844  4042 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.497320  4040 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:25.497709  4039 raft_consensus.cc:359] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.498379  4039 raft_consensus.cc:385] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.498672  4039 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.503751  4042 ts_tablet_manager.cc:1434] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:20:25.504714  4042 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.512003  4293 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.512552  4293 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.516017  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.516393  4039 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.517921  3814 leader_election.cc:343] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.517853  3745 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.519153  4293 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.518836  4039 ts_tablet_manager.cc:1434] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.004s
I20260709 12:20:25.520367  4039 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.522773  4040 tablet_bootstrap.cc:654] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.521903  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.523998  3747 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:25.524806  3815 leader_election.cc:343] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.525309  3815 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.525980  4042 tablet_bootstrap.cc:654] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.526448  4293 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.546227  4039 tablet_bootstrap.cc:654] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.541968  3746 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.572237  4040 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:25.572928  4040 ts_tablet_manager.cc:1403] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.021s
I20260709 12:20:25.583653  4040 raft_consensus.cc:359] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.584685  4040 raft_consensus.cc:385] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.585327  4040 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.587361  4040 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.591619  4042 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.592128  4042 ts_tablet_manager.cc:1403] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.025s
I20260709 12:20:25.593920  4040 ts_tablet_manager.cc:1434] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:20:25.594902  4040 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:25.594880  4042 raft_consensus.cc:359] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.595695  4042 raft_consensus.cc:385] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.595950  4042 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.596585  4042 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.598421  4283 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.592208  4039 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.599900  4039 ts_tablet_manager.cc:1403] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.008s
I20260709 12:20:25.599151  4283 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.605938  4295 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.606536  4295 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.609107  4295 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.609973  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.609030  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.610841  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.611903  4039 raft_consensus.cc:359] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.612577  4039 raft_consensus.cc:385] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.612875  4039 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.613530  4039 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.613806  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.616066  4039 ts_tablet_manager.cc:1434] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:25.616434  4293 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.616874  4293 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.617069  4039 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.617228  4293 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.617529  3843 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:25.617941  3814 leader_election.cc:343] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.619488  4319 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.615024  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.599285  4042 ts_tablet_manager.cc:1434] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:20:25.622694  4042 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.623512  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.624208  3993 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.626590  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.627388  4291 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.621637  3922 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.627797  4291 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.628168  4291 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.633039  4039 tablet_bootstrap.cc:654] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.633653  4283 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.639593  4291 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.642505  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.643517  3993 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.646215  4283 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.646950  4283 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.651554  4291 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.651889  4283 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.651600  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.662101  3999 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:25.663118  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.665180  3919 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.666002  4040 tablet_bootstrap.cc:654] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.677054  4293 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.680727  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.683180  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.683491  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:25.683746  3814 leader_election.cc:343] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.683987  3922 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.681762  4293 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.685173  3815 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.691411  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:25.696525  4283 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.697268  3999 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:25.699822  4040 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:25.698323  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:25.700889  3993 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:25.702384  4293 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.704033  4042 tablet_bootstrap.cc:654] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.704996  4293 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:25.706002  4293 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.699426  4319 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:25.708745  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.710189  4291 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.710732  4291 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:25.711696  4291 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.717535  4039 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.718062  4039 ts_tablet_manager.cc:1403] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.101s	user 0.030s	sys 0.024s
I20260709 12:20:25.720219  3919 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:25.721015  4040 ts_tablet_manager.cc:1403] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.004s
I20260709 12:20:25.722028  4039 raft_consensus.cc:359] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.727614  4039 raft_consensus.cc:385] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.728040  4039 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.728899  4039 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.734555  4039 ts_tablet_manager.cc:1434] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:20:25.735504  4039 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.723951  4283 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:25.739987  4328 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.740501  4328 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.723948  4040 raft_consensus.cc:359] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.741698  4040 raft_consensus.cc:385] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.742017  4040 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.743285  4328 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.743602  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.744298  3842 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:25.745442  4042 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.745688  3962 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.745925  4042 ts_tablet_manager.cc:1403] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.006s
I20260709 12:20:25.746745  4328 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.747119  4328 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.747478  4328 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.747813  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:25.749332  3964 leader_election.cc:343] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.751309  4042 raft_consensus.cc:359] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.752040  4042 raft_consensus.cc:385] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.752307  4042 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.752970  4042 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.755398  4042 ts_tablet_manager.cc:1434] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:25.755347  4040 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.756429  4042 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.757591  4040 ts_tablet_manager.cc:1434] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:20:25.758546  4040 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:25.760780  4344 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.761920  4039 tablet_bootstrap.cc:654] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.763171  4042 tablet_bootstrap.cc:654] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.781980  4039 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.782496  4039 ts_tablet_manager.cc:1403] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.002s
W20260709 12:20:25.783558  3815 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:25.784991  4039 raft_consensus.cc:359] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.785579  4039 raft_consensus.cc:385] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.785836  4039 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.786470  4039 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.787222  4042 tablet_bootstrap.cc:492] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.781513  4328 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.787736  4042 ts_tablet_manager.cc:1403] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 12:20:25.790050  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:25.790648  3843 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.790484  4042 raft_consensus.cc:359] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.791193  4042 raft_consensus.cc:385] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.791483  4042 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.792327  4042 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.795603  4039 ts_tablet_manager.cc:1434] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:20:25.798528  4039 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.802558  4042 ts_tablet_manager.cc:1434] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:20:25.799081  3843 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:25.811199  4042 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.812291  4040 tablet_bootstrap.cc:654] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.813786  4039 tablet_bootstrap.cc:654] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.816232  4328 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.816381  3962 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.817332  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.818379  4328 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:25.818662  3964 leader_election.cc:343] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.819078  4328 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:25.820022  4328 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.824645  3964 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:25.839433  4042 tablet_bootstrap.cc:654] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.841753  4256 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.842456  4256 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.845026  4040 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:25.845497  4040 ts_tablet_manager.cc:1403] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.000s
I20260709 12:20:25.846259  4256 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.846171  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.847205  3842 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:25.848037  4040 raft_consensus.cc:359] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.848613  3746 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.849212  3962 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.846174  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.850623  3922 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:25.850258  3746 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.849200  4040 raft_consensus.cc:385] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.851372  4042 tablet_bootstrap.cc:492] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.851692  4040 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.851998  4042 ts_tablet_manager.cc:1403] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.001s
I20260709 12:20:25.852398  4040 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.853543  4334 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.855321  4334 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.855717  4334 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.864428  4042 raft_consensus.cc:359] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.865195  4040 ts_tablet_manager.cc:1434] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:20:25.865424  4042 raft_consensus.cc:385] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.865820  4042 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.866173  4040 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:25.866631  4042 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.869457  4042 ts_tablet_manager.cc:1434] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:20:25.863082  4334 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.872449  4042 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:25.872906  4039 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.873653  4039 ts_tablet_manager.cc:1403] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.012s
I20260709 12:20:25.876247  4039 raft_consensus.cc:359] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.876864  4039 raft_consensus.cc:385] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.877128  4039 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.877745  4039 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.878328  4042 tablet_bootstrap.cc:654] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.878260  3745 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.879127  4295 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.879935  4039 ts_tablet_manager.cc:1434] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:25.879647  4295 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.880803  4039 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.881705  4295 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.883474  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.883908  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.884126  3922 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.884505  3993 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.885416  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.886149  4295 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.886543  4295 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.886893  4039 tablet_bootstrap.cc:654] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.886839  4295 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.893909  4293 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.894477  4293 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.897830  4295 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.900620  4344 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.901119  4344 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.901329  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:25.901901  3993 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.903146  4334 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.905915  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.906553  3923 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.906865  4039 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:25.907331  4039 ts_tablet_manager.cc:1403] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 12:20:25.908447  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:25.909044  3922 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.911818  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.912395  4040 tablet_bootstrap.cc:654] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.912292  4293 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.903214  4344 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:25.913695  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:25.913884  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.914294  3842 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.914570  3843 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:25.916690  4039 raft_consensus.cc:359] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.917382  4039 raft_consensus.cc:385] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:25.917650  4039 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:25.918411  4039 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:25.920115  3964 leader_election.cc:343] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.920650  4039 ts_tablet_manager.cc:1434] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:20:25.921048  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:25.921674  4039 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:25.922284  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:25.922427  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:25.923022  3992 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:25.924757  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.925151  4344 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.925503  4344 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.925567  4293 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:25.925899  4344 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:25.925948  4293 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.926373  4293 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:25.928565  3815 leader_election.cc:343] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:25.934074  3842 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:25.928555  4039 tablet_bootstrap.cc:654] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:25.911623  3993 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:25.935364  3962 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.935861  3814 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:25.936381  4334 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.936659  4291 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:25.936923  4334 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:25.937369  4291 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:25.938002  4334 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.938995  4110 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.938233  4291 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.942214  4293 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:25.943289  4295 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.947345  4042 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:25.947882  4042 ts_tablet_manager.cc:1403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.004s
I20260709 12:20:25.948227  3923 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:25.958421  4319 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.970789  4115 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.921047  3922 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:25.981885  4344 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.006973  4319 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.007557  4319 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.009632  4319 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.976078  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:26.011622  4344 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.011755  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:25.989207  3745 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.996910  4293 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:25.997570  4042 raft_consensus.cc:359] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.014489  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:26.015007  4042 raft_consensus.cc:385] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.015326  4042 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.015563  3843 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:26.016072  4042 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.015924  3747 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.017447  4042 ts_tablet_manager.cc:1434] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.001s
I20260709 12:20:26.018244  4042 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:26.004513  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:26.019928  3993 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:26.020959  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:26.022056  3815 leader_election.cc:343] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.022634  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:26.023322  4293 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.024848  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:26.026242  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.027207  4319 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:26.028666  3964 leader_election.cc:343] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.031108  4042 tablet_bootstrap.cc:654] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.029448  4039 tablet_bootstrap.cc:492] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:26.032114  4039 ts_tablet_manager.cc:1403] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.004s
I20260709 12:20:26.034821  4039 raft_consensus.cc:359] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.049623  4039 raft_consensus.cc:385] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.049891  4039 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.050551  4039 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.052451  4039 ts_tablet_manager.cc:1434] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 12:20:26.052856  4319 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.053354  4039 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:26.053606  4319 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.057942  4319 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.059178  4039 tablet_bootstrap.cc:654] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.059087  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:26.061012  3888 leader_election.cc:343] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.041378  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:26.044997  3964 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:26.063021  4334 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.049141  4344 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.064802  4344 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.065588  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:26.066219  3999 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:26.066768  4344 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.067636  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.072762  3889 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.072866  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:26.073453  3962 leader_election.cc:343] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.073606  3922 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:26.074752  4319 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.075124  4319 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.075563  4319 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.077482  4039 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:26.078078  4039 ts_tablet_manager.cc:1403] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:20:26.078225  4040 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:26.079878  4040 ts_tablet_manager.cc:1403] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.214s	user 0.026s	sys 0.002s
I20260709 12:20:26.080932  4344 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.081362  4039 raft_consensus.cc:359] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.084230  4039 raft_consensus.cc:385] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.084599  4039 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.082701  4319 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.088289  4319 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.082351  4040 raft_consensus.cc:359] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.086337  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.088909  4040 raft_consensus.cc:385] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.089237  4040 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.089298  4281 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.089675  4281 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.090011  4281 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.089962  4040 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.091743  4042 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:26.089995  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:26.092191  4042 ts_tablet_manager.cc:1403] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.002s
I20260709 12:20:26.092422  4040 ts_tablet_manager.cc:1434] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:20:26.093394  4040 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
W20260709 12:20:26.093398  3888 leader_election.cc:343] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.094779  4042 raft_consensus.cc:359] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.095494  4042 raft_consensus.cc:385] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.095763  4042 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.097164  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:26.098934  4042 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.096081  4039 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.099818  4040 tablet_bootstrap.cc:654] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.108493  4040 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:26.109041  4040 ts_tablet_manager.cc:1403] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:20:26.109385  4042 ts_tablet_manager.cc:1434] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:26.110327  4042 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:26.112356  4040 raft_consensus.cc:359] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.113181  4040 raft_consensus.cc:385] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.113335  4334 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.113583  4040 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.113821  4334 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.108868  4281 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.117297  4281 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.117475  4334 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.118546  3993 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:26.114593  4040 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.119339  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:26.120707  3964 leader_election.cc:343] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.120615  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:26.121476  3922 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:26.121623  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:26.121809  3889 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.122221  3841 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.123980  4039 ts_tablet_manager.cc:1434] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:20:26.125157  4039 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:26.125093  4040 ts_tablet_manager.cc:1434] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:20:26.126350  4040 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:26.129246  4042 tablet_bootstrap.cc:654] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.129163  3841 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:26.130080  4319 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.131122  3993 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.134835  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:26.136032  4334 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:26.136549  4334 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:26.137387  4334 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.141798  4291 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.154210  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:26.156807  3962 leader_election.cc:343] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.157254  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.157936  4281 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.156828  4040 tablet_bootstrap.cc:654] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.173105  4042 tablet_bootstrap.cc:492] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:26.173583  4042 ts_tablet_manager.cc:1403] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.008s
I20260709 12:20:26.193737  3746 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.205579  4039 tablet_bootstrap.cc:654] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.206329  4042 raft_consensus.cc:359] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.207082  4042 raft_consensus.cc:385] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.215842  4042 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.216214  4291 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:26.217428  4042 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.223834  4042 ts_tablet_manager.cc:1434] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.007s
I20260709 12:20:26.224295  4040 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:26.226722  4110 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.226912  4040 ts_tablet_manager.cc:1403] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.016s
I20260709 12:20:26.227841  4042 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:26.227962  4324 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.228555  4324 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.229605  4040 raft_consensus.cc:359] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.230283  4040 raft_consensus.cc:385] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.230566  4040 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.230829  4324 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.231254  4040 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.227224  4110 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.234308  4040 ts_tablet_manager.cc:1434] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:20:26.234750  4110 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.235055  4039 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:26.235307  4040 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:26.235589  4039 ts_tablet_manager.cc:1403] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.011s
I20260709 12:20:26.236477  4042 tablet_bootstrap.cc:654] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.288947  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:26.307989  4040 tablet_bootstrap.cc:654] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.292716  4328 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.293234  4334 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.312683  4334 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.310941  4328 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.288875  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:26.299592  4042 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:26.331262  4042 ts_tablet_manager.cc:1403] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.005s
I20260709 12:20:26.338045  4328 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.239420  4039 raft_consensus.cc:359] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.348397  4039 raft_consensus.cc:385] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.348759  4039 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.349633  4039 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.355257  4334 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.391096  4039 ts_tablet_manager.cc:1434] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 12:20:26.375006  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:26.396894  3919 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.397312  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:26.398360  3922 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:26.412029  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.413218  3841 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:26.413229  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.415333  3843 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:26.424834  4039 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
W20260709 12:20:26.445737  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 104404us
I20260709 12:20:26.419232  4042 raft_consensus.cc:359] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.449736  4042 raft_consensus.cc:385] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.450110  4042 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.459542  4040 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
W20260709 12:20:26.457013  3964 leader_election.cc:343] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.460542  4042 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.461225  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.461088  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:26.464591  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:26.466591  3964 consensus_peers.cc:597] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:26.467716  4042 ts_tablet_manager.cc:1434] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.000s
I20260709 12:20:26.469288  4042 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:26.471001  3888 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.469826  4281 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.471863  4281 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.472434  4281 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.482985  3888 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.485720  4040 ts_tablet_manager.cc:1403] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.251s	user 0.041s	sys 0.032s
I20260709 12:20:26.486229  4319 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.495790  4039 tablet_bootstrap.cc:654] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.496986  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:26.500044  4334 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.500468  4334 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.500867  4334 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.501096  4328 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.504467  4293 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.505168  4293 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.507800  4293 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.516403  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:26.534281  3814 leader_election.cc:343] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.539743  4042 tablet_bootstrap.cc:654] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.545753  4295 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.562790  4402 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:26.583210  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83475.9us
I20260709 12:20:26.599601  4295 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.601313  4324 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.601874  4110 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.602389  4110 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.617890  3923 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.620715  4281 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.624948  4334 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.625842  4281 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.627575  4110 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.628643  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:26.630563  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.631554  3843 raft_consensus.cc:2393] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:26.627140  4334 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.612254  4040 raft_consensus.cc:359] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.633116  4040 raft_consensus.cc:385] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.633419  4040 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
W20260709 12:20:26.634456  3815 leader_election.cc:343] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:26.639050  3917 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.640362  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:26.642365  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:26.642594  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:26.643519  3921 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.636312  3815 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:26.648347  4403 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:26.650735  3964 leader_election.cc:343] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:26.658787  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47858.4us
I20260709 12:20:26.655243  4040 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.662026  4039 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:26.662586  4039 ts_tablet_manager.cc:1403] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.021s
I20260709 12:20:26.663496  4042 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:26.664306  4042 ts_tablet_manager.cc:1403] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.014s
I20260709 12:20:26.683514  4039 raft_consensus.cc:359] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.688987  4039 raft_consensus.cc:385] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.689463  4039 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:26.692504  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:26.693207  3848 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.690034  3921 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:26.700762  4039 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.706377  4291 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:20:26.706795  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:26.712352  4040 ts_tablet_manager.cc:1434] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.226s	user 0.016s	sys 0.018s
I20260709 12:20:26.727056  4039 ts_tablet_manager.cc:1434] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:20:26.732673  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:26.731300  4042 raft_consensus.cc:359] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.734508  4042 raft_consensus.cc:385] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:26.734745  4042 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
W20260709 12:20:26.737875  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 77905.5us
I20260709 12:20:26.739332  4324 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.740721  4405 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.742213  4042 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.742856  4039 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:26.756067  4040 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:26.759734  4334 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:26.762619  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:26.765419  4281 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:26.766120  4281 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:26.766669  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:26.767113  4281 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.767589  4328 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.768141  4328 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.770316  4328 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.773748  3848 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:26.767357  3842 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.790525  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.839702  4042 ts_tablet_manager.cc:1434] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.175s	user 0.011s	sys 0.017s
W20260709 12:20:26.839872  3962 leader_election.cc:343] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:26.851541  4414 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:26.855516  4042 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:26.871469  4039 tablet_bootstrap.cc:654] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:26.862744  4291 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.885711  4256 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.886375  4256 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.889397  4256 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:26.890393  4291 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:26.945283  4291 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:26.949129  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:26.949882  3843 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:26.950358  4324 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:26.950511  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:26.953967  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:26.970098  3962 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:26.971099  4405 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:26.973450  4405 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.973905  4405 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:26.974000  3842 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:27.013706  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.014179  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:27.014823  3991 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:27.018239  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.016767  4412 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.047520  4412 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:27.062950  4412 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.065245  4295 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.065914  4295 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.066383  4295 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.059844  4324 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.071763  4324 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.100310  4421 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:27.117872  4040 tablet_bootstrap.cc:654] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.132076  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.132931  3842 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:27.130894  4324 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.140799  4405 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.189185  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.206442  4344 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:27.211948  4042 tablet_bootstrap.cc:654] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.202865  3747 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.158445  4295 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.227131  4405 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.227313  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:27.228155  3842 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.231000  4295 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.232646  4039 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
W20260709 12:20:27.232999  3964 leader_election.cc:343] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:27.233958  3964 leader_election.cc:343] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.234397  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.233162  4039 ts_tablet_manager.cc:1403] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.498s	user 0.021s	sys 0.044s
I20260709 12:20:27.241480  4412 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.242390  4334 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:27.244530  4039 raft_consensus.cc:359] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.245329  4039 raft_consensus.cc:385] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.245604  4039 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.246331  4039 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.247782  3842 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:27.251291  3962 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.252565  4405 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.253263  4405 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:27.253813  4039 ts_tablet_manager.cc:1434] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:20:27.255036  4039 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.255039  4405 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.253283  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79757.9us
I20260709 12:20:27.267413  4039 tablet_bootstrap.cc:654] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.272505  4040 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.273036  4040 ts_tablet_manager.cc:1403] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.517s	user 0.023s	sys 0.045s
W20260709 12:20:27.275316  3815 leader_election.cc:343] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.275909  4040 raft_consensus.cc:359] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.276657  4040 raft_consensus.cc:385] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.276953  4040 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.277731  4040 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.280494  4040 ts_tablet_manager.cc:1434] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:20:27.281865  4040 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.283214  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.286696  4042 tablet_bootstrap.cc:492] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:27.287317  4042 ts_tablet_manager.cc:1403] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.432s	user 0.015s	sys 0.024s
I20260709 12:20:27.288964  4040 tablet_bootstrap.cc:654] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.297705  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:27.298004  4042 raft_consensus.cc:359] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.300678  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:27.302289  4042 raft_consensus.cc:385] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.302827  4334 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.301596  3993 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.309847  4042 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.310158  3889 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.309525  4334 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.315913  4110 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.324788  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:27.327957  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.330106  4042 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.330125  3815 leader_election.cc:343] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.329082  3847 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:27.337672  3962 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.346580  4407 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.347026  4407 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.347378  4407 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.351291  3993 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:27.359174  4334 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.361290  4042 ts_tablet_manager.cc:1434] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 12:20:27.363183  4110 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.380167  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:20:27.382210  3964 leader_election.cc:343] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.382803  4042 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:27.391547  4115 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.386507  4405 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:20:27.396646  4412 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:27.401728  4115 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:27.389123  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.402709  4115 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.413676  3964 leader_election.cc:343] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.416914  4407 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.418192  4110 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.418780  4039 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.418691  4110 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.419643  4039 ts_tablet_manager.cc:1403] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.019s
I20260709 12:20:27.424057  4110 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.425454  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.427866  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.429116  3994 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:27.429306  4039 raft_consensus.cc:359] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.426402  3842 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:27.430469  4039 raft_consensus.cc:385] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.431924  4039 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.439316  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:27.440062  3847 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.440042  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.441951  4110 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.440824  4407 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.445822  4040 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.446393  4040 ts_tablet_manager.cc:1403] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.165s	user 0.034s	sys 0.041s
I20260709 12:20:27.448447  4039 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.452008  4110 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.453617  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:27.455365  3964 leader_election.cc:343] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.455402  4040 raft_consensus.cc:359] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.456197  4040 raft_consensus.cc:385] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.456468  4040 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.457217  4040 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.459798  4040 ts_tablet_manager.cc:1434] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:20:27.461019  4040 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.461961  4039 ts_tablet_manager.cc:1434] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:20:27.463018  4039 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.464684  3847 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:27.468498  3962 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:27.469034  4042 tablet_bootstrap.cc:654] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.469537  4344 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.470032  4344 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:27.471184  4344 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.492865  4039 tablet_bootstrap.cc:654] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.495399  4040 tablet_bootstrap.cc:654] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.512718  3745 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.494683  4344 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:20:27.517985  4042 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:27.518518  4042 ts_tablet_manager.cc:1403] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.141s	user 0.013s	sys 0.001s
I20260709 12:20:27.526861  4344 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.527637  4344 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.533751  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.533967  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.533592  3746 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:27.535575  3962 leader_election.cc:343] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.535712  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.521363  4042 raft_consensus.cc:359] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.540678  4042 raft_consensus.cc:385] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.543586  4042 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
W20260709 12:20:27.545224  3964 leader_election.cc:343] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.545827  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.544392  4042 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.546774  4407 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.549690  4042 ts_tablet_manager.cc:1434] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:20:27.554476  4042 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:27.538595  3746 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.562413  4040 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.562932  4040 ts_tablet_manager.cc:1403] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.001s
I20260709 12:20:27.569746  4040 raft_consensus.cc:359] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.570691  4040 raft_consensus.cc:385] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.571534  4040 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.572425  4040 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.574039  4039 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.578255  4040 ts_tablet_manager.cc:1434] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:20:27.578555  4039 ts_tablet_manager.cc:1403] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.038s
I20260709 12:20:27.579555  4040 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.576989  4042 tablet_bootstrap.cc:654] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.584353  4039 raft_consensus.cc:359] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.585062  4039 raft_consensus.cc:385] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.585359  4039 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.586030  4039 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.587709  4039 ts_tablet_manager.cc:1434] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:27.586565  4040 tablet_bootstrap.cc:654] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.588903  4039 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.596920  4344 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.602723  4039 tablet_bootstrap.cc:654] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.604115  4040 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.604707  4040 ts_tablet_manager.cc:1403] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 12:20:27.604643  4412 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:27.608337  4040 raft_consensus.cc:359] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.609126  4040 raft_consensus.cc:385] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.609437  4040 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.610253  4040 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.612390  4040 ts_tablet_manager.cc:1434] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:27.615991  4039 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.616495  4039 ts_tablet_manager.cc:1403] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:20:27.619133  4039 raft_consensus.cc:359] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.619828  4039 raft_consensus.cc:385] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.620078  4039 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.620760  4039 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.622364  4039 ts_tablet_manager.cc:1434] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:27.623739  4039 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.628793  4039 tablet_bootstrap.cc:654] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.634155  4039 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.634647  4039 ts_tablet_manager.cc:1403] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:20:27.637240  4039 raft_consensus.cc:359] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.637904  4039 raft_consensus.cc:385] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.638223  4039 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.638895  4039 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.640231  4042 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:27.640492  4040 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.640743  4042 ts_tablet_manager.cc:1403] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.019s
I20260709 12:20:27.640825  4039 ts_tablet_manager.cc:1434] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:27.642417  4039 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.647135  4040 tablet_bootstrap.cc:654] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.648150  4039 tablet_bootstrap.cc:654] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.649750  4042 raft_consensus.cc:359] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.651854  4295 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.660517  4344 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.663174  3964 consensus_peers.cc:597] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.663556  4295 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.664458  4039 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.664948  4039 ts_tablet_manager.cc:1403] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 12:20:27.665937  4295 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.663592  4344 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.668525  4042 raft_consensus.cc:385] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.668864  4042 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.669620  4042 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.670406  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.674650  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.675361  3994 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:27.675973  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.677393  4344 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:27.677390  3962 leader_election.cc:343] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.677426  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.679203  4293 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.679596  4293 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.679929  4293 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.680315  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:27.681598  3815 leader_election.cc:343] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:27.683508  3964 leader_election.cc:343] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.684095  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.686009  4115 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.686254  4040 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.686610  4042 ts_tablet_manager.cc:1434] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:20:27.686626  4040 ts_tablet_manager.cc:1403] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 12:20:27.686522  4115 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.686769  4344 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.687722  4042 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:27.688750  4115 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.689744  4040 raft_consensus.cc:359] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.690397  4040 raft_consensus.cc:385] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.690613  4040 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.693526  4039 raft_consensus.cc:359] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.694450  4039 raft_consensus.cc:385] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.694856  4039 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.693153  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.695886  4039 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.697100  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.697781  3999 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
W20260709 12:20:27.702565  3815 leader_election.cc:343] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.703660  4039 ts_tablet_manager.cc:1434] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 12:20:27.708549  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:27.709498  4040 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.712368  4401 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.713755  4401 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.714107  4401 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.729893  4039 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
I20260709 12:20:27.734802  4040 ts_tablet_manager.cc:1434] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.048s	user 0.011s	sys 0.006s
W20260709 12:20:27.753080  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:27.753551  4040 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.761023  4039 tablet_bootstrap.cc:654] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.763950  4040 tablet_bootstrap.cc:654] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.764945  4042 tablet_bootstrap.cc:654] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.777007  4110 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.777472  4110 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.776707  4401 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.780216  4040 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.780887  4040 ts_tablet_manager.cc:1403] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.001s
I20260709 12:20:27.781112  4110 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.780717  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.781948  3843 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:27.783558  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:27.784392  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.784900  3993 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.783928  4040 raft_consensus.cc:359] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.785597  4040 raft_consensus.cc:385] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.785955  4040 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.786716  4040 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.786715  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:27.788059  4110 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.793671  4344 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:27.803678  4040 ts_tablet_manager.cc:1434] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:20:27.805884  4040 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.807487  4110 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:27.808589  4042 tablet_bootstrap.cc:492] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:27.809145  4042 ts_tablet_manager.cc:1403] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.005s
I20260709 12:20:27.812285  4042 raft_consensus.cc:359] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.813182  4115 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.815291  4115 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.817730  4115 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.817728  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:27.819839  3815 leader_election.cc:343] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.781831  4401 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.756469  4293 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.824815  3993 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:27.826179  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.814414  4042 raft_consensus.cc:385] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.834411  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:27.838274  4042 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.838582  3991 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:27.835009  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:27.839861  3994 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.841861  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.842236  4040 tablet_bootstrap.cc:654] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.839061  4042 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.835963  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:27.844208  3921 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.838018  3922 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:27.867689  4042 ts_tablet_manager.cc:1434] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.058s	user 0.014s	sys 0.006s
I20260709 12:20:27.870546  4407 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.871213  4407 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.875175  3815 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.875327  4401 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:27.879647  4042 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:27.884693  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.885205  4407 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.884991  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:27.886479  3964 leader_election.cc:343] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:27.829129  4293 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.843580  4295 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.889041  4295 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.884694  4412 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.890662  4295 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.891194  4412 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.893368  4412 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.900753  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:27.901939  3919 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:27.908632  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:27.896340  3847 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:27.915081  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:27.915869  3850 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:27.913524  4407 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:27.920351  4407 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.920729  4407 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.922768  3921 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:27.929067  4295 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.933976  4407 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.945964  4407 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:27.934487  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:27.947366  4407 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:27.947871  4407 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.948280  4407 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.938045  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:27.949187  4293 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.949667  4293 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:27.950464  4293 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.951606  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:27.952260  3850 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.952766  4040 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:27.953254  4040 ts_tablet_manager.cc:1403] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.148s	user 0.030s	sys 0.028s
I20260709 12:20:27.956014  4040 raft_consensus.cc:359] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.956669  4040 raft_consensus.cc:385] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:27.956940  4040 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:27.957743  4405 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:27.957587  4040 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.940165  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:27.961030  3993 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.961627  4042 tablet_bootstrap.cc:654] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:27.959700  4295 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:27.934111  3994 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:27.972218  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:27.972862  3921 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.964534  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:27.975492  4401 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:27.975977  4401 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:27.976868  4401 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:27.977802  3964 consensus_peers.cc:597] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.982177  4040 ts_tablet_manager.cc:1434] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:20:27.984520  4040 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:27.991595  3993 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:27.970182  4407 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.996053  3921 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:27.993045  3850 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:27.936731  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:27.996981  3919 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:27.999353  4042 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:27.943284  4039 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:27.999979  4042 ts_tablet_manager.cc:1403] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
I20260709 12:20:28.006354  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:28.007166  4405 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.007733  4405 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:28.007997  4040 tablet_bootstrap.cc:654] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.007675  4042 raft_consensus.cc:359] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:27.999958  4039 ts_tablet_manager.cc:1403] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.270s	user 0.052s	sys 0.073s
I20260709 12:20:28.008987  4405 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.011782  4039 raft_consensus.cc:359] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.012480  4039 raft_consensus.cc:385] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.013017  4039 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.013645  4039 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.009136  4042 raft_consensus.cc:385] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.014757  4042 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.004513  3919 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:28.015540  4042 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.016327  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:28.018234  4042 ts_tablet_manager.cc:1434] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:20:28.018301  4401 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:28.018863  4401 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:28.019780  4401 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.026492  4042 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:28.033614  4401 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.034224  4401 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.037115  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:28.038808  3815 leader_election.cc:343] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.039860  4401 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.047230  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:28.047945  3995 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:28.049599  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:28.051074  4407 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:28.051753  4039 ts_tablet_manager.cc:1434] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:20:28.052291  4115 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:28.052673  4115 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.052979  4115 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:28.060078  4115 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.064793  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:28.065465  4039 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
W20260709 12:20:28.066056  3815 leader_election.cc:343] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.072620  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:28.099001  4115 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.113351  4042 tablet_bootstrap.cc:654] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.122037  4040 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:28.123158  4040 ts_tablet_manager.cc:1403] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.139s	user 0.040s	sys 0.019s
W20260709 12:20:28.124055  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59233.3us
I20260709 12:20:28.131517  4039 tablet_bootstrap.cc:654] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.134814  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:28.139914  3850 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:28.142078  4040 raft_consensus.cc:359] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.142846  4040 raft_consensus.cc:385] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.143229  4040 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.144250  4040 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.138262  3746 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.162765  4283 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.163314  4283 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.165375  4283 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:28.168151  3964 leader_election.cc:343] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.191242  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:28.206333  4040 ts_tablet_manager.cc:1434] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.014s
I20260709 12:20:28.212733  4040 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:28.200232  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:28.213577  3991 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:28.220057  3814 leader_election.cc:343] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.230015  4040 tablet_bootstrap.cc:654] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.231664  3850 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:20:28.236428  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 95144.5us
I20260709 12:20:28.240026  4039 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:28.262761  4042 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:28.277468  4040 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:28.295822  4039 ts_tablet_manager.cc:1403] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.000s
I20260709 12:20:28.371582  4042 ts_tablet_manager.cc:1403] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.345s	user 0.015s	sys 0.015s
I20260709 12:20:28.376592  4040 ts_tablet_manager.cc:1403] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.164s	user 0.002s	sys 0.014s
I20260709 12:20:28.379704  3747 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 2, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.378497  3991 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:28.396237  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:28.397416  4110 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.397940  4110 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.399248  4115 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:28.399770  4115 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:28.400501  4115 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.404722  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:28.407349  4110 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.386790  4295 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:20:28.410025  4474 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:28.421154  4474 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:28.422039  4474 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.408468  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:28.477892  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49331.6us
I20260709 12:20:28.485057  4470 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.427618  3842 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:28.485620  4470 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:28.476963  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65811.4us
I20260709 12:20:28.532791  4040 raft_consensus.cc:359] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.534541  4040 raft_consensus.cc:385] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.535363  4040 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.544622  4334 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:28.546507  3925 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:28.548465  4040 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.553920  4040 ts_tablet_manager.cc:1434] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.177s	user 0.006s	sys 0.010s
I20260709 12:20:28.570503  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:28.572695  4040 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Bootstrap starting.
I20260709 12:20:28.587178  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:28.590255  4039 raft_consensus.cc:359] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.591084  4039 raft_consensus.cc:385] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.591394  4039 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.595649  4042 raft_consensus.cc:359] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.596462  4042 raft_consensus.cc:385] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.596764  4042 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.597652  4470 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.598125  4039 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.600001  4405 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.600612  4039 ts_tablet_manager.cc:1434] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.230s	user 0.007s	sys 0.001s
I20260709 12:20:28.600634  4405 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.602432  4039 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Bootstrap starting.
W20260709 12:20:28.603045  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59133.5us
I20260709 12:20:28.597671  4042 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.621001  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:28.621762  3999 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:28.623936  4405 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:28.631517  3815 leader_election.cc:343] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.632025  3815 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:28.633219  4469 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:28.633390  4040 tablet_bootstrap.cc:654] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.648463  4042 ts_tablet_manager.cc:1434] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.276s	user 0.008s	sys 0.000s
I20260709 12:20:28.650127  4042 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:28.654592  3746 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.662061  3746 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.700577  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:28.710001  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:28.714879  3962 leader_election.cc:343] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.704339  4468 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:20:28.704741  4469 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:20:28.697942  3888 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:28.719501  4482 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:28.720860  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:28.728562  4484 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.108s	user 0.005s	sys 0.000s
W20260709 12:20:28.793460  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49168us
W20260709 12:20:28.795133  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 94679us
W20260709 12:20:28.797583  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 98594.8us
I20260709 12:20:28.800670  4039 tablet_bootstrap.cc:654] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.799655  4469 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:28.808732  4469 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.809144  4469 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:28.816403  4471 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:28.819851  3920 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:28.820814  4042 tablet_bootstrap.cc:654] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:28.832276  4040 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: No bootstrap required, opened a new log
I20260709 12:20:28.832852  4040 ts_tablet_manager.cc:1403] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Time spent bootstrapping tablet: real 0.261s	user 0.018s	sys 0.033s
I20260709 12:20:28.840483  3919 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:28.846429  3815 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.848466  3747 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:28.806715  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 87682.9us
W20260709 12:20:28.869563  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 70116.8us
I20260709 12:20:28.879079  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:28.880856  3815 leader_election.cc:343] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.879132  4040 raft_consensus.cc:359] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.882253  4040 raft_consensus.cc:385] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:28.882498  4040 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:28.883069  4040 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.884900  4040 ts_tablet_manager.cc:1434] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
W20260709 12:20:28.898841  3964 leader_election.cc:343] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.905208  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:28.908891  4405 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:28.886554  4469 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.934110  4293 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.936034  4293 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:28.936410  4469 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.937984  4293 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:28.942817  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:28.945039  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:28.950768  3815 leader_election.cc:343] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.951503  4042 tablet_bootstrap.cc:492] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
W20260709 12:20:28.951659  3815 leader_election.cc:343] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:28.952019  4042 ts_tablet_manager.cc:1403] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.302s	user 0.014s	sys 0.009s
W20260709 12:20:28.978092  3796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:29.052191  4039 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: No bootstrap required, opened a new log
I20260709 12:20:29.052855  4039 ts_tablet_manager.cc:1403] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Time spent bootstrapping tablet: real 0.451s	user 0.032s	sys 0.026s
I20260709 12:20:29.073473  3745 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.074368  4039 raft_consensus.cc:359] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.075248  4039 raft_consensus.cc:385] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.075600  4039 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.076308  4039 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.078693  4039 ts_tablet_manager.cc:1434] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:20:29.095186  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:29.095279  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:29.095973  3991 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.095964  3994 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:29.099888  4494 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:29.109894  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 145568us
I20260709 12:20:29.110255  3991 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:29.112326  4042 raft_consensus.cc:359] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.118388  4042 raft_consensus.cc:385] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.118708  4042 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.119390  4042 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.121366  4042 ts_tablet_manager.cc:1434] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.169s	user 0.010s	sys 0.000s
I20260709 12:20:29.122325  4042 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.111138  4490 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:20:29.134377  3917 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.136436  4283 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.139541  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:29.140518  4283 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.141693  4283 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.141420  4293 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.142024  4283 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.144688  4042 tablet_bootstrap.cc:654] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.149169  4283 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.153208  4283 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:29.153999  3815 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:29.172466  4042 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.173357  4042 ts_tablet_manager.cc:1403] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:20:29.176684  4042 raft_consensus.cc:359] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.177590  4042 raft_consensus.cc:385] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.177845  4042 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.177999  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:29.178685  3992 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.178546  4042 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.185133  4042 ts_tablet_manager.cc:1434] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:29.186260  4042 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.186388  3992 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:29.188205  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:29.189067  4471 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.189553  4471 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:29.190357  4471 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.195955  4042 tablet_bootstrap.cc:654] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.197379  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.200253  4291 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.200878  4291 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:29.201984  4291 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.205598  4495 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:29.206116  4495 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.217289  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:29.220741  4495 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.278092  4482 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.278578  4482 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.279095  4042 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.279633  4042 ts_tablet_manager.cc:1403] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.060s
I20260709 12:20:29.280928  4482 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.281265  4490 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.281837  4490 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.283025  4042 raft_consensus.cc:359] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.283793  4042 raft_consensus.cc:385] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.283617  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:29.284070  4042 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.284267  3842 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 0.
I20260709 12:20:29.284392  4490 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.284760  4042 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.286144  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:29.286924  3994 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 0.
I20260709 12:20:29.286959  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.286401  4042 ts_tablet_manager.cc:1434] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:29.288127  4415 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.288617  4415 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.288687  3814 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.289005  4415 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.289145  4042 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.289609  4490 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.290050  4490 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.290441  4490 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.303498  4415 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.304765  4490 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.307168  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:29.308040  3844 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:29.310088  4415 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.310683  4490 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.310879  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:29.311550  3994 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.312394  4042 tablet_bootstrap.cc:654] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.317919  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:29.319432  3745 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.330857  3994 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:29.356515  3745 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.357728  3814 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.358141  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:29.358980  3920 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:29.359028  4291 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.359687  4291 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:29.360503  4291 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.361572  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:29.362367  3916 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 1: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:29.375306  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:29.376214  3992 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:20:29.376636  3964 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:29.378410  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:29.384723  3815 leader_election.cc:343] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:29.395179  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:29.396375  3994 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:29.403252  4042 tablet_bootstrap.cc:492] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.403812  4042 ts_tablet_manager.cc:1403] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.115s	user 0.042s	sys 0.025s
I20260709 12:20:29.404910  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 0 to 1, leader changed from <none> to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.409348  4042 raft_consensus.cc:359] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.410698  4042 raft_consensus.cc:385] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.410986  4042 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.411670  4042 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.416798  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:29.417585  4415 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:29.417973  3889 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:29.418695  4415 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.425546  4042 ts_tablet_manager.cc:1434] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:20:29.426622  4042 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.433584  4042 tablet_bootstrap.cc:654] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.441159  4042 tablet_bootstrap.cc:492] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.441648  4042 ts_tablet_manager.cc:1403] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:20:29.444804  4042 raft_consensus.cc:359] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.445726  4042 raft_consensus.cc:385] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.446033  4042 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.446781  4042 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.449041  4042 ts_tablet_manager.cc:1434] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:20:29.450307  4042 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.454619  4042 tablet_bootstrap.cc:654] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.458631  4042 tablet_bootstrap.cc:492] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.459018  4042 ts_tablet_manager.cc:1403] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:29.461544  4042 raft_consensus.cc:359] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.462227  4042 raft_consensus.cc:385] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.462483  4042 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.463111  4042 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.465323  4042 ts_tablet_manager.cc:1434] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:20:29.466243  4042 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Bootstrap starting.
I20260709 12:20:29.472149  4042 tablet_bootstrap.cc:654] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:29.480701  4042 tablet_bootstrap.cc:492] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: No bootstrap required, opened a new log
I20260709 12:20:29.481164  4042 ts_tablet_manager.cc:1403] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:20:29.483417  4042 raft_consensus.cc:359] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.483984  4042 raft_consensus.cc:385] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:29.484272  4042 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Initialized, Role: FOLLOWER
I20260709 12:20:29.487898  4042 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.490211  4042 ts_tablet_manager.cc:1434] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:20:29.516832  4495 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.517443  4495 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.519712  4495 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.520542  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:29.520545  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:29.522303  4493 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.522445  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:29.522789  4493 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.523310  4495 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.525695  4493 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:29.525790  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:29.526576  3842 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:29.526885  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:29.527626  3917 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 0.
I20260709 12:20:29.527635  3962 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.528597  4493 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:29.528951  4493 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.529273  4493 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.535065  4493 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.536710  4493 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:29.537340  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:29.537635  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:29.537883  3842 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.538292  3917 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.545538  3842 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:29.546943  3962 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:29.548900  4493 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:29.550444  4493 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:29.550340  3917 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:29.551548  4493 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.568997  3745 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.580031  3920 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.596019  4495 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.596710  4495 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:29.599211  4495 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:29.596249  3920 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.600224  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:29.607863  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:29.608827  3994 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 1: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:29.611549  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:29.612613  4495 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.619578  4495 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:29.656313  3920 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:29.663040  4295 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.675246  4471 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.838820  4295 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.845747  4295 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:29.887214  4295 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:29.898130  4471 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.092473  4493 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.121229  4496 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:30.171662  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:30.201726  4540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:30.201921  4537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:30.202224  4538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:30.203197  2677 server_base.cc:1061] running on GCE node
I20260709 12:20:30.205857  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:30.206135  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:30.206311  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599630206296 us; error 0 us; skew 500 ppm
I20260709 12:20:30.207171  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:30.211601  2677 webserver.cc:533] Webserver started at http://127.2.157.68:45577/ using document root <none> and password file <none>
I20260709 12:20:30.212186  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:30.212426  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:30.212786  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:30.214322  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-3-root/instance:
uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
format_stamp: "Formatted at 2026-07-09 12:20:30 on dist-test-slave-sx71"
I20260709 12:20:30.219806  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:20:30.223189  4545 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:30.224006  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:30.224346  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
format_stamp: "Formatted at 2026-07-09 12:20:30 on dist-test-slave-sx71"
I20260709 12:20:30.224642  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:30.241463  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:30.243522  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:30.245795  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:30.248677  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:30.248926  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:30.249212  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:30.249409  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:30.321923  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.68:38173
I20260709 12:20:30.322026  4608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.68:38173 every 8 connection(s)
I20260709 12:20:30.327724  2677 auto_leader_rebalancer-test.cc:439] add a tserver: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:30.350114  4609 heartbeater.cc:344] Connected to a master server at 127.2.157.126:36337
I20260709 12:20:30.350806  4609 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:30.352068  4609 heartbeater.cc:507] Master 127.2.157.126:36337 requested a full tablet report, sending...
I20260709 12:20:30.354660  3745 ts_manager.cc:194] Registered new tserver with Master: 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:30.356803  3745 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47674
I20260709 12:20:31.122006  3992 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.130976  3841 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.132531  4412 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.133203  3917 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.135936  4493 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.151911  4412 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.154910  3841 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.164494  3920 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:20:31.166591  3964 consensus_peers.cc:597] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1565e90e2094af9b0891393186e41da. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.181912  3745 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:31.232616  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58388.6us
I20260709 12:20:31.248927  3841 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.256978  3994 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.259078  4293 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.259919  3920 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.263023  4293 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:31.276000  3815 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83b1a4f620064a52bb4a2fb284f00276. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.278216  4628 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.283046  3917 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.287973  3994 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.300652  3842 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.305853  3746 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:31.326620  3815 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba989d98d508441a9e56717e49c9004d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.327549  3917 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.328620  3994 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.334770  4293 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:31.335860  4471 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.345603  4471 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.347947  3994 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.350497  3917 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.360324  4609 heartbeater.cc:499] Master 127.2.157.126:36337 was elected leader, sending a full tablet report...
I20260709 12:20:31.365520  3994 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.366904  3745 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.374693  3920 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.375756  3842 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.377720  4493 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:31.380306  3964 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 271f08ec28384c99b6dd3fb41fb92ebf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.386463  4496 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:31.398540  4493 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.402773  3917 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.414860  3841 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:31.421918  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.710681  4641 ts_tablet_manager.cc:933] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:31.712858  4641 tablet_copy_client.cc:323] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:31.728065  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet c1565e90e2094af9b0891393186e41da from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:31.728718  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet c1565e90e2094af9b0891393186e41da from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-c1565e90e2094af9b0891393186e41da
I20260709 12:20:31.735934  4009 tablet_copy_source_session.cc:215] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.740772  4641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1565e90e2094af9b0891393186e41da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:31.778282  4641 tablet_copy_client.cc:806] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:31.779228  4641 tablet_copy_client.cc:670] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:31.787014  4641 tablet_copy_client.cc:538] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:31.787635  4645 ts_tablet_manager.cc:933] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:31.800837  4645 tablet_copy_client.cc:323] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:31.801625  4641 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:31.833951  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet ba989d98d508441a9e56717e49c9004d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:31.834815  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet ba989d98d508441a9e56717e49c9004d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-ba989d98d508441a9e56717e49c9004d
I20260709 12:20:31.865123  4650 ts_tablet_manager.cc:933] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:31.869686  4641 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:31.870873  4641 tablet_bootstrap.cc:492] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:31.871608  4641 ts_tablet_manager.cc:1403] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.012s
I20260709 12:20:31.871486  3860 tablet_copy_source_session.cc:215] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.873494  4648 ts_tablet_manager.cc:933] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:31.875579  4650 tablet_copy_client.cc:323] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:31.877370  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba989d98d508441a9e56717e49c9004d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:31.880903  4641 raft_consensus.cc:359] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.882064  4641 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:31.883483  4641 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:31.887473  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 271f08ec28384c99b6dd3fb41fb92ebf from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:31.888123  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 271f08ec28384c99b6dd3fb41fb92ebf from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-271f08ec28384c99b6dd3fb41fb92ebf
I20260709 12:20:31.897979  4009 tablet_copy_source_session.cc:215] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.902012  4650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271f08ec28384c99b6dd3fb41fb92ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:31.915940  4645 tablet_copy_client.cc:806] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:31.923182  4648 tablet_copy_client.cc:323] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:31.925244  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet 83b1a4f620064a52bb4a2fb284f00276 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:31.925850  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet 83b1a4f620064a52bb4a2fb284f00276 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-83b1a4f620064a52bb4a2fb284f00276
I20260709 12:20:31.929236  4641 ts_tablet_manager.cc:1434] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.056s	user 0.015s	sys 0.013s
I20260709 12:20:31.935835  3860 tablet_copy_source_session.cc:215] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.939694  4648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b1a4f620064a52bb4a2fb284f00276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:31.945452  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c1565e90e2094af9b0891393186e41da received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:31.946161  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c1565e90e2094af9b0891393186e41da on tablet c1565e90e2094af9b0891393186e41da with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:31.955704  4645 tablet_copy_client.cc:670] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:31.963590  4645 tablet_copy_client.cc:538] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:31.965723  4650 tablet_copy_client.cc:806] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:31.966603  4650 tablet_copy_client.cc:670] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:31.975100  4645 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:31.975258  4650 tablet_copy_client.cc:538] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:31.977160  4648 tablet_copy_client.cc:806] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:31.977977  4648 tablet_copy_client.cc:670] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:31.994380  4650 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:32.007525  4648 tablet_copy_client.cc:538] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:32.022819  4648 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:32.028656  4645 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.029853  4645 tablet_bootstrap.cc:492] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:32.032986  4645 ts_tablet_manager.cc:1403] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.005s
I20260709 12:20:32.033977  4650 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.034925  4650 tablet_bootstrap.cc:492] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:32.035621  4650 ts_tablet_manager.cc:1403] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.012s
I20260709 12:20:32.085987  4645 raft_consensus.cc:359] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.093571  4645 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:32.094516  4645 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.105144  4650 raft_consensus.cc:359] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.106153  4650 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:32.106835  4650 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.116688  4650 ts_tablet_manager.cc:1434] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.081s	user 0.011s	sys 0.005s
I20260709 12:20:32.125284  4648 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.126295  4648 tablet_bootstrap.cc:492] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:32.131979  4648 ts_tablet_manager.cc:1403] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.026s
I20260709 12:20:32.135282  4648 raft_consensus.cc:359] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.136286  4648 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:32.147966  4648 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:32.149360  4645 ts_tablet_manager.cc:1434] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.004s
I20260709 12:20:32.150391  4648 ts_tablet_manager.cc:1434] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:20:32.157910  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ba989d98d508441a9e56717e49c9004d received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:32.158463  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ba989d98d508441a9e56717e49c9004d on tablet ba989d98d508441a9e56717e49c9004d with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:32.160805  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-83b1a4f620064a52bb4a2fb284f00276 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:32.161293  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-83b1a4f620064a52bb4a2fb284f00276 on tablet 83b1a4f620064a52bb4a2fb284f00276 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:32.162912  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-271f08ec28384c99b6dd3fb41fb92ebf received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:32.163406  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-271f08ec28384c99b6dd3fb41fb92ebf on tablet 271f08ec28384c99b6dd3fb41fb92ebf with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:32.249145  4583 raft_consensus.cc:1217] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.275280  4583 raft_consensus.cc:1217] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.295477  4583 raft_consensus.cc:1217] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.412865  4583 raft_consensus.cc:1217] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.850384  4628 raft_consensus.cc:1064] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:32.851123  4493 raft_consensus.cc:1064] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:32.853281  4628 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:32.853454  4493 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:32.860910  4583 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.862561  4622 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.864938  3923 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.865101  3842 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.865407  4583 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.866819  4620 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.868441  4496 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.871505  4493 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.924163  4620 raft_consensus.cc:1064] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:32.926295  3923 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.926972  4620 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:32.933135  3991 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.935351  4622 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.961867  4583 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.963356  3993 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:32.974926  4665 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.958962  4622 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.000691  3844 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.014434  4665 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:33.002372  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 48256.4us
I20260709 12:20:33.002480  4620 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.019394  3919 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.004484  4628 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.007395  3923 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.034560  4665 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:33.038559  4672 raft_consensus.cc:1064] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:33.053396  3844 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.057453  3747 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.074018  4672 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:33.094233  4583 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.098255  3917 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.122900  4582 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.132176  3991 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.131188  4664 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.129854  4582 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.145205  4622 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.147493  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.148662  3917 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.162830  3842 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.163787  4581 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.173034  4672 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:33.176891  3919 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.192500  4677 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:33.238286  3747 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.266172  4628 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.271828  4580 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.302814  3993 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:33.296295  3842 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:33.313118  3991 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:33.329509  4583 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.332108  4620 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:20:33.341631  4583 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.343168  3920 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.343624  3993 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.344861  4664 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.346587  4682 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.352896  3850 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.358072  3919 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.360915  4664 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.368352  4682 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.376868  4582 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.380077  3747 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.379199  4620 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.396611  3844 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.402395  3994 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.402244  3747 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.403936  4580 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.405330  4662 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.376624  3916 raft_consensus.cc:2955] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.413584  4662 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.418128  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1565e90e2094af9b0891393186e41da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.417779  4583 raft_consensus.cc:2955] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.429319  4677 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.437983  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet c1565e90e2094af9b0891393186e41da with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:33.437089  4580 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.440402  3748 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.454946  4695 tablet_replica.cc:333] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:33.459985  4695 raft_consensus.cc:2243] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.461119  4695 raft_consensus.cc:2272] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.460808  3844 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:33.462486  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 271f08ec28384c99b6dd3fb41fb92ebf with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:33.466204  4695 ts_tablet_manager.cc:1916] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.474668  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 271f08ec28384c99b6dd3fb41fb92ebf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.493078  4696 tablet_replica.cc:333] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:33.494112  4696 raft_consensus.cc:2243] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.494819  4696 raft_consensus.cc:2272] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.493078  3748 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.496301  3993 raft_consensus.cc:2955] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.503201  4580 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.506045  3920 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.514343  4628 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.517217  4662 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.528469  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba989d98d508441a9e56717e49c9004d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.527896  4676 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.521596  4696 ts_tablet_manager.cc:1916] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.538700  4580 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.543905  3916 raft_consensus.cc:2955] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.553664  4695 ts_tablet_manager.cc:1929] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.554250  4695 log.cc:1199] T c1565e90e2094af9b0891393186e41da P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/c1565e90e2094af9b0891393186e41da
I20260709 12:20:33.555187  4696 ts_tablet_manager.cc:1929] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.555706  4696 log.cc:1199] T 271f08ec28384c99b6dd3fb41fb92ebf P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/271f08ec28384c99b6dd3fb41fb92ebf
I20260709 12:20:33.558127  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 271f08ec28384c99b6dd3fb41fb92ebf (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:33.558266  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet c1565e90e2094af9b0891393186e41da (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:33.561452  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet ba989d98d508441a9e56717e49c9004d with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:33.562440  4696 tablet_replica.cc:333] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:33.565454  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83b1a4f620064a52bb4a2fb284f00276 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.575173  3745 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:33.583429  4696 raft_consensus.cc:2243] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.585457  4696 raft_consensus.cc:2272] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.590966  4696 ts_tablet_manager.cc:1916] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.608654  4696 ts_tablet_manager.cc:1929] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.609110  4696 log.cc:1199] T ba989d98d508441a9e56717e49c9004d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/ba989d98d508441a9e56717e49c9004d
I20260709 12:20:33.610875  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet ba989d98d508441a9e56717e49c9004d (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:33.624131  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet 83b1a4f620064a52bb4a2fb284f00276 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:20:33.632007  4697 tablet_replica.cc:333] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:20:33.632975  4697 raft_consensus.cc:2243] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.633708  4697 raft_consensus.cc:2272] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.637266  4697 ts_tablet_manager.cc:1916] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.651824  4697 ts_tablet_manager.cc:1929] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.652182  4697 log.cc:1199] T 83b1a4f620064a52bb4a2fb284f00276 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/83b1a4f620064a52bb4a2fb284f00276
I20260709 12:20:33.653848  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet 83b1a4f620064a52bb4a2fb284f00276 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:34.684177  3991 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:34.692026  3923 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:34.691864  3964 consensus_peers.cc:597] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 108e3004fd4341f78b24caefdf2ef63f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.693619  4699 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.695308  3842 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.696777  4699 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.701290  4664 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.703130  3923 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.718928  3842 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:20:34.737854  3815 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07eac049e3fe41bf98d28d3d572dcb8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.735932  3748 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.738492  3991 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.740597  4677 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.740366  3842 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.742806  3923 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.744930  4672 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.765261  4678 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.768162  3991 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.774163  3923 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.799322  3745 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.819249  3916 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:34.827057  3991 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.829811  3844 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.831765  4673 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:34.834616  4717 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.858268  4716 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.860132  3993 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.862159  3842 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.878734  3916 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:20:34.879746  3890 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bfc9dfe4d724180a29bd9c8bf9e16d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.879627  3745 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.892827  3993 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.894538  3842 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.896097  4673 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:34.898136  4717 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:34.900195  3890 consensus_peers.cc:597] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b32e0bc8a63482a89916840eae42f8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.914270  4717 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.920166  3993 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.922295  3841 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:34.940153  3748 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:35.096529  4725 ts_tablet_manager.cc:933] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:35.098757  4725 tablet_copy_client.cc:323] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:35.100788  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 108e3004fd4341f78b24caefdf2ef63f from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:35.101337  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 108e3004fd4341f78b24caefdf2ef63f from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-108e3004fd4341f78b24caefdf2ef63f
I20260709 12:20:35.109403  4009 tablet_copy_source_session.cc:215] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.112849  4725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108e3004fd4341f78b24caefdf2ef63f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.130601  4725 tablet_copy_client.cc:806] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.131337  4725 tablet_copy_client.cc:670] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.138041  4725 tablet_copy_client.cc:538] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.150807  4725 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:35.171417  4725 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.172220  4725 tablet_bootstrap.cc:492] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:35.172782  4725 ts_tablet_manager.cc:1403] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.008s
I20260709 12:20:35.175101  4725 raft_consensus.cc:359] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.175776  4725 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:35.176316  4725 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.179554  4725 ts_tablet_manager.cc:1434] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:20:35.182178  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-108e3004fd4341f78b24caefdf2ef63f received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:35.182631  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-108e3004fd4341f78b24caefdf2ef63f on tablet 108e3004fd4341f78b24caefdf2ef63f with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:35.203694  4725 ts_tablet_manager.cc:933] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:35.209760  4725 tablet_copy_client.cc:323] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:35.211710  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet 07eac049e3fe41bf98d28d3d572dcb8a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:35.212273  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet 07eac049e3fe41bf98d28d3d572dcb8a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-07eac049e3fe41bf98d28d3d572dcb8a
I20260709 12:20:35.225239  3860 tablet_copy_source_session.cc:215] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.228847  4725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eac049e3fe41bf98d28d3d572dcb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.253250  4725 tablet_copy_client.cc:806] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.253857  4725 tablet_copy_client.cc:670] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.263017  4725 tablet_copy_client.cc:538] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.276456  4725 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:35.297102  4725 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.298132  4725 tablet_bootstrap.cc:492] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:35.298794  4725 ts_tablet_manager.cc:1403] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:20:35.301594  4725 raft_consensus.cc:359] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.302416  4725 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:35.303140  4725 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.305337  4725 ts_tablet_manager.cc:1434] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:20:35.307111  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-07eac049e3fe41bf98d28d3d572dcb8a received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:35.307744  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-07eac049e3fe41bf98d28d3d572dcb8a on tablet 07eac049e3fe41bf98d28d3d572dcb8a with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:35.438766  4725 ts_tablet_manager.cc:933] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:35.444412  4725 tablet_copy_client.cc:323] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:20:35.451856  4734 ts_tablet_manager.cc:933] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:35.453790  4734 tablet_copy_client.cc:323] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:20:35.461134  3935 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:20:35.461793  3935 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-6bfc9dfe4d724180a29bd9c8bf9e16d4
I20260709 12:20:35.463862  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 9b32e0bc8a63482a89916840eae42f8a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:20:35.464565  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 9b32e0bc8a63482a89916840eae42f8a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-9b32e0bc8a63482a89916840eae42f8a
I20260709 12:20:35.477706  3935 tablet_copy_source_session.cc:215] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.482939  4725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.498775  3934 tablet_copy_source_session.cc:215] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.502871  4734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b32e0bc8a63482a89916840eae42f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.521616  4725 tablet_copy_client.cc:806] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.522260  4725 tablet_copy_client.cc:670] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.551977  4725 tablet_copy_client.cc:538] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.561474  4725 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:35.567653  4734 tablet_copy_client.cc:806] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.568351  4734 tablet_copy_client.cc:670] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.572677  4734 tablet_copy_client.cc:538] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.580062  4580 raft_consensus.cc:1217] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:35.583559  4734 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:35.624330  4725 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.625361  4725 tablet_bootstrap.cc:492] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:35.626130  4725 ts_tablet_manager.cc:1403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.005s
I20260709 12:20:35.636185  4725 raft_consensus.cc:359] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.639362  4725 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:35.640084  4725 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.655148  4725 ts_tablet_manager.cc:1434] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:20:35.669020  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-6bfc9dfe4d724180a29bd9c8bf9e16d4 received from {username='slave'} at 127.0.0.1:46046
I20260709 12:20:35.669626  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-6bfc9dfe4d724180a29bd9c8bf9e16d4 on tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:20:35.674252  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90917.3us
I20260709 12:20:35.698194  4734 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.699203  4734 tablet_bootstrap.cc:492] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:35.700053  4734 ts_tablet_manager.cc:1403] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.117s	user 0.050s	sys 0.064s
I20260709 12:20:35.703325  4734 raft_consensus.cc:359] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.704730  4734 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:35.705464  4734 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:35.710433  4734 ts_tablet_manager.cc:1434] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:20:35.713382  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-9b32e0bc8a63482a89916840eae42f8a received from {username='slave'} at 127.0.0.1:46046
I20260709 12:20:35.713852  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-9b32e0bc8a63482a89916840eae42f8a on tablet 9b32e0bc8a63482a89916840eae42f8a with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:35.777338  4580 raft_consensus.cc:1217] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:35.944685  4580 raft_consensus.cc:1217] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:36.051761  4580 raft_consensus.cc:1217] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:36.060426  4664 raft_consensus.cc:1064] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:36.063202  4664 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.072542  4580 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.074956  3842 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.077062  3923 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.080176  4704 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.085470  4737 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.096549  4704 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.152662  4704 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.160203  4580 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.165239  3920 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.174345  3842 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.188048  3747 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:36.243721  3993 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.250144  4678 raft_consensus.cc:1064] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:36.253262  4678 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.260964  3920 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.262770  4580 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.263172  4737 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:36.268499  4737 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:36.272668  4580 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.275039  3993 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.275583  4664 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.279112  4672 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.280226  3920 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.289994  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 108e3004fd4341f78b24caefdf2ef63f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:36.300449  4677 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.299700  4583 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.302691  4677 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:36.292328  3919 raft_consensus.cc:2955] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.309796  3748 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.337044  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 108e3004fd4341f78b24caefdf2ef63f with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:36.357425  4755 tablet_replica.cc:333] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:36.358639  4755 raft_consensus.cc:2243] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:36.359426  4755 raft_consensus.cc:2272] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:36.431671  4755 ts_tablet_manager.cc:1916] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:36.436447  4747 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.511823  3919 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.570181  3748 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.574321  4755 ts_tablet_manager.cc:1929] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:36.613719  4740 raft_consensus.cc:1064] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:36.618078  4758 raft_consensus.cc:1064] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:36.620563  4755 log.cc:1199] T 108e3004fd4341f78b24caefdf2ef63f P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/108e3004fd4341f78b24caefdf2ef63f
I20260709 12:20:36.623368  4740 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.643692  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 108e3004fd4341f78b24caefdf2ef63f (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:36.627146  4758 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.656127  3992 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.664214  3842 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.675137  4583 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.720994  4582 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.722921  4673 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.725574  3920 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.742806  3841 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.744102  4581 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.744935  4757 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.745620  3841 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.747010  4757 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.749831  4673 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.773073  4763 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:36.779107  3999 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.783030  4580 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.790205  4751 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:20:36.806424  4740 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.805887  4677 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.815912  4580 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.838574  3920 raft_consensus.cc:2955] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.840728  3994 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:36.851992  4673 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:36.857344  4673 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.858779  3841 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.858517  4581 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.851720  4757 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.880095  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07eac049e3fe41bf98d28d3d572dcb8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:36.885979  4583 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.892030  3748 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:36.909824  3841 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.913873  3746 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:36.916829  3994 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.937364  3745 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.945658  3917 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.950091  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet 07eac049e3fe41bf98d28d3d572dcb8a with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:20:36.950377  3999 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.975265  4583 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.977126  4758 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:36.989414  3999 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:36.989065  4673 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:36.994714  3917 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:36.999830  4774 tablet_replica.cc:333] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:20:36.998858  4583 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.005810  4758 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:37.013300  3841 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:37.015242  4581 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:37.017668  4716 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:37.018700  4758 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:37.021951  4774 raft_consensus.cc:2243] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.025321  4774 raft_consensus.cc:2272] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.024314  3999 raft_consensus.cc:2955] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.029594  4774 ts_tablet_manager.cc:1916] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.038336  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b32e0bc8a63482a89916840eae42f8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:37.037508  4757 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.044377  3748 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.051268  4583 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.065017  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b32e0bc8a63482a89916840eae42f8a with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:37.066345  4755 tablet_replica.cc:333] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:37.073175  4755 raft_consensus.cc:2243] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.074105  4755 raft_consensus.cc:2272] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.075780  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:37.078049  4755 ts_tablet_manager.cc:1916] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.088577  4774 ts_tablet_manager.cc:1929] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:37.089529  4774 log.cc:1199] T 07eac049e3fe41bf98d28d3d572dcb8a P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/07eac049e3fe41bf98d28d3d572dcb8a
I20260709 12:20:37.091914  3746 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.096630  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet 07eac049e3fe41bf98d28d3d572dcb8a (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:37.046463  3841 raft_consensus.cc:2955] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:37.111552  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:20:37.112911  4774 tablet_replica.cc:333] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:20:37.115303  4774 raft_consensus.cc:2243] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:37.116161  4774 raft_consensus.cc:2272] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:37.105898  4755 ts_tablet_manager.cc:1929] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:37.122157  4755 log.cc:1199] T 9b32e0bc8a63482a89916840eae42f8a P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/9b32e0bc8a63482a89916840eae42f8a
I20260709 12:20:37.120430  4774 ts_tablet_manager.cc:1916] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:37.125262  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 9b32e0bc8a63482a89916840eae42f8a (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:37.146111  4774 ts_tablet_manager.cc:1929] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:37.146598  4774 log.cc:1199] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/6bfc9dfe4d724180a29bd9c8bf9e16d4
I20260709 12:20:37.148432  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet 6bfc9dfe4d724180a29bd9c8bf9e16d4 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:38.214999  3999 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.222162  3841 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:38.223088  3964 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d61667a526f478f888a20a9619a1e2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.223623  4766 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.227278  3920 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.228567  4766 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:38.237859  3841 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.235816  4779 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.248152  3920 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.257923  3999 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.260071  3745 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:38.277664  3964 consensus_peers.cc:597] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 918f90de47bb48d493e4dd0737810b63. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.277909  3923 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.280617  3841 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.282847  4762 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.284219  4779 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:38.295258  4779 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.301132  3920 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.299335  3841 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.322935  3842 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.350961  3746 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.364446  3994 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.370384  4776 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.380545  3920 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:38.379706  3815 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a66f6f6f296148d9b3b0931f1c94d49a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.387588  4792 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.390640  3994 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.390142  4791 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.395751  3920 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.408494  3842 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.411219  3747 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.422444  3994 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.424119  3919 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:38.423964  4776 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:38.426100  4777 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:38.428211  3815 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2900e71c0212466e8be300d30595c609. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.447430  4792 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.449599  3999 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.458405  3919 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.474563  3747 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:38.731380  4799 ts_tablet_manager.cc:933] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:38.733331  4799 tablet_copy_client.cc:323] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:38.735251  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 918f90de47bb48d493e4dd0737810b63 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:38.735929  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 918f90de47bb48d493e4dd0737810b63 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-918f90de47bb48d493e4dd0737810b63
I20260709 12:20:38.742640  4009 tablet_copy_source_session.cc:215] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:38.746284  4799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918f90de47bb48d493e4dd0737810b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.760443  4799 tablet_copy_client.cc:806] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:38.761088  4799 tablet_copy_client.cc:670] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:38.764817  4799 tablet_copy_client.cc:538] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:38.773313  4799 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:38.796303  4799 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:38.798996  4799 tablet_bootstrap.cc:492] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:38.799840  4799 ts_tablet_manager.cc:1403] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:20:38.804114  4799 raft_consensus.cc:359] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.804965  4799 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:38.805657  4799 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:38.809023  4799 ts_tablet_manager.cc:1434] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:38.810696  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-918f90de47bb48d493e4dd0737810b63 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:38.811223  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-918f90de47bb48d493e4dd0737810b63 on tablet 918f90de47bb48d493e4dd0737810b63 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:38.843349  4799 ts_tablet_manager.cc:933] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:38.845126  4799 tablet_copy_client.cc:323] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:38.846695  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 3d61667a526f478f888a20a9619a1e2b from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:38.847278  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 3d61667a526f478f888a20a9619a1e2b from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-3d61667a526f478f888a20a9619a1e2b
I20260709 12:20:38.858153  4009 tablet_copy_source_session.cc:215] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:38.860893  4799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61667a526f478f888a20a9619a1e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.880565  4804 ts_tablet_manager.cc:933] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:38.889154  4806 ts_tablet_manager.cc:933] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:38.893927  4804 tablet_copy_client.cc:323] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:38.896539  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet a66f6f6f296148d9b3b0931f1c94d49a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:38.897094  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet a66f6f6f296148d9b3b0931f1c94d49a from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-a66f6f6f296148d9b3b0931f1c94d49a
I20260709 12:20:38.905154  3860 tablet_copy_source_session.cc:215] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:38.908568  4804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a66f6f6f296148d9b3b0931f1c94d49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.908763  4799 tablet_copy_client.cc:806] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:38.909428  4799 tablet_copy_client.cc:670] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:38.914477  4799 tablet_copy_client.cc:538] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:38.928009  4806 tablet_copy_client.cc:323] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:38.930218  4804 tablet_copy_client.cc:806] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:38.929867  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet 2900e71c0212466e8be300d30595c609 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:38.930841  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet 2900e71c0212466e8be300d30595c609 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-2900e71c0212466e8be300d30595c609
I20260709 12:20:38.934008  4799 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:38.930851  4804 tablet_copy_client.cc:670] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:38.943171  3860 tablet_copy_source_session.cc:215] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:38.946877  4806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2900e71c0212466e8be300d30595c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.947068  4804 tablet_copy_client.cc:538] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:38.956996  4804 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:38.978585  4806 tablet_copy_client.cc:806] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:38.979246  4806 tablet_copy_client.cc:670] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:38.995034  4806 tablet_copy_client.cc:538] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:38.998462  4799 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:38.999707  4799 tablet_bootstrap.cc:492] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:39.001893  4804 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.003769  4804 tablet_bootstrap.cc:492] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:39.004557  4804 ts_tablet_manager.cc:1403] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.019s
I20260709 12:20:39.007689  4804 raft_consensus.cc:359] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.008054  4799 ts_tablet_manager.cc:1403] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.011s
I20260709 12:20:39.008589  4804 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:39.009337  4804 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.013904  4799 raft_consensus.cc:359] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.014801  4799 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:39.015511  4799 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.018254  4799 ts_tablet_manager.cc:1434] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:20:39.019932  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-3d61667a526f478f888a20a9619a1e2b received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:39.020386  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-3d61667a526f478f888a20a9619a1e2b on tablet 3d61667a526f478f888a20a9619a1e2b with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:39.023713  4806 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:39.028887  4804 ts_tablet_manager.cc:1434] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:20:39.030718  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-a66f6f6f296148d9b3b0931f1c94d49a received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:39.031178  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-a66f6f6f296148d9b3b0931f1c94d49a on tablet a66f6f6f296148d9b3b0931f1c94d49a with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:39.051726  4806 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:39.052588  4806 tablet_bootstrap.cc:492] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:39.053336  4806 ts_tablet_manager.cc:1403] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.006s
I20260709 12:20:39.056541  4806 raft_consensus.cc:359] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.057399  4806 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:39.058194  4806 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:39.060561  4806 ts_tablet_manager.cc:1434] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 12:20:39.064538  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2900e71c0212466e8be300d30595c609 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:39.065006  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2900e71c0212466e8be300d30595c609 on tablet 2900e71c0212466e8be300d30595c609 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:39.125458  4583 raft_consensus.cc:1217] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:39.289307  4581 raft_consensus.cc:1217] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:39.443638  4581 raft_consensus.cc:1217] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:39.461912  4581 raft_consensus.cc:1217] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:39.539469  4762 raft_consensus.cc:1064] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:39.542254  4762 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:39.556298  4583 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.556718  3920 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.556718  3841 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.558187  4762 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.559099  4812 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.559887  4779 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.573978  4812 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.577476  4583 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.581626  3920 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.590641  3841 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.598901  3745 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.635301  3999 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:39.642362  4583 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:39.644091  4762 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:39.647032  3919 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:39.651602  4762 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:39.654322  4812 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.659304  4583 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.662320  3919 raft_consensus.cc:2955] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.676332  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 918f90de47bb48d493e4dd0737810b63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:39.680765  3747 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.700184  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 918f90de47bb48d493e4dd0737810b63 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:39.716943  4821 tablet_replica.cc:333] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:39.718403  4821 raft_consensus.cc:2243] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.719369  4821 raft_consensus.cc:2272] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.723307  4821 ts_tablet_manager.cc:1916] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:39.741957  4821 ts_tablet_manager.cc:1929] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:39.742410  4821 log.cc:1199] T 918f90de47bb48d493e4dd0737810b63 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/918f90de47bb48d493e4dd0737810b63
I20260709 12:20:39.743985  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 918f90de47bb48d493e4dd0737810b63 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:39.827330  4762 raft_consensus.cc:1064] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:39.829229  4762 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:39.835405  4581 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.835461  3920 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.837397  3841 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.837253  4762 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:39.839998  4779 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.840780  4812 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.860358  4792 raft_consensus.cc:1064] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:39.862993  4792 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:39.873777  4812 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.876677  3842 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.888276  3917 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.896907  4581 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.899525  3920 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.899099  4678 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:39.900187  4583 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.902019  4811 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.906474  3991 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:39.898489  3746 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.911388  4678 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:39.932068  4678 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.935820  3991 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.949031  4581 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:39.959570  3999 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:40.010066  4580 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.022895  4762 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.023881  3747 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.031747  3916 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.038499  4812 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.056041  4581 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.059073  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d61667a526f478f888a20a9619a1e2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:40.064065  3844 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.089128  4779 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.089033  3848 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:40.094954  4832 raft_consensus.cc:1064] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:40.098351  4580 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.097877  4832 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:40.100386  4811 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.108276  3747 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:40.113600  4678 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.120617  4580 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.123054  3994 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.127161  4792 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:40.133489  3994 raft_consensus.cc:2955] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.138150  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d61667a526f478f888a20a9619a1e2b with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:40.132926  3848 raft_consensus.cc:2955] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.154240  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2900e71c0212466e8be300d30595c609 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:40.170640  4581 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:40.172425  4833 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:40.176846  4836 tablet_replica.cc:333] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:40.177018  3994 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:40.178193  4836 raft_consensus.cc:2243] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.178627  4678 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:40.181865  4836 raft_consensus.cc:2272] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.185048  4836 ts_tablet_manager.cc:1916] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:40.195576  3920 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:40.198258  4832 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:40.178823  3746 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.222391  4792 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.227882  3994 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.241734  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 2900e71c0212466e8be300d30595c609 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:40.243225  4836 ts_tablet_manager.cc:1929] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:40.244760  4580 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.254506  4836 log.cc:1199] T 3d61667a526f478f888a20a9619a1e2b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/3d61667a526f478f888a20a9619a1e2b
I20260709 12:20:40.256271  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 3d61667a526f478f888a20a9619a1e2b (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:40.258225  3747 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.260267  3917 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.262274  4836 tablet_replica.cc:333] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:40.263381  4836 raft_consensus.cc:2243] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.264259  4836 raft_consensus.cc:2272] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.267923  4836 ts_tablet_manager.cc:1916] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:40.285689  4836 ts_tablet_manager.cc:1929] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:40.286067  4836 log.cc:1199] T 2900e71c0212466e8be300d30595c609 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/2900e71c0212466e8be300d30595c609
I20260709 12:20:40.287633  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 2900e71c0212466e8be300d30595c609 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:40.304167  3848 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:40.308849  4580 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.309870  3917 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:40.310894  4678 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.311839  4792 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:40.319679  4792 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.321903  3917 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.323328  4580 raft_consensus.cc:2955] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.343029  3747 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:40.360565  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a66f6f6f296148d9b3b0931f1c94d49a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:40.374979  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet a66f6f6f296148d9b3b0931f1c94d49a with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:20:40.377192  4840 tablet_replica.cc:333] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:20:40.383756  4840 raft_consensus.cc:2243] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:40.384894  4840 raft_consensus.cc:2272] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:40.390476  4840 ts_tablet_manager.cc:1916] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:40.403646  4840 ts_tablet_manager.cc:1929] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:40.404151  4840 log.cc:1199] T a66f6f6f296148d9b3b0931f1c94d49a P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/a66f6f6f296148d9b3b0931f1c94d49a
I20260709 12:20:40.406225  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet a66f6f6f296148d9b3b0931f1c94d49a (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:41.440452  3844 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:41.452556  3991 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:41.453130  3815 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 722124affb914f0496100070a9582045. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.454249  3917 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.454327  4833 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.455660  4792 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.470634  4678 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.472446  3920 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.472569  3991 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.488883  3991 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:41.493134  3747 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.503090  3920 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:41.503738  3964 consensus_peers.cc:597] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07eb7068067d45559c8b38061e7c8808. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.504848  4779 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.505244  3844 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.507347  4779 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.517947  4834 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.523528  3844 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.527580  3917 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.547606  3746 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.549974  3917 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:20:41.558970  3890 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63ac059d92404e2aa8792e1c5b02ae88. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.561869  3991 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.562445  3844 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.563774  4841 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.565914  4798 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.586360  4841 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.588934  3991 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.592391  3842 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.618901  3991 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:41.627704  3747 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:20:41.635430  3964 consensus_peers.cc:597] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac719796849e490f935d71c2a43cd7d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:41.638952  3842 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.641042  3917 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:41.642650  4762 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.645116  4834 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:41.654667  4762 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.665196  3848 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.671586  3917 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:41.678016  3748 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.853341  4862 ts_tablet_manager.cc:933] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:41.855639  4862 tablet_copy_client.cc:323] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:41.858112  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet 722124affb914f0496100070a9582045 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:41.858668  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet 722124affb914f0496100070a9582045 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-722124affb914f0496100070a9582045
I20260709 12:20:41.866647  3860 tablet_copy_source_session.cc:215] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:41.873806  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722124affb914f0496100070a9582045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.890117  4862 tablet_copy_client.cc:806] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:41.890686  4862 tablet_copy_client.cc:670] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:41.895313  4862 tablet_copy_client.cc:538] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:41.902346  4864 ts_tablet_manager.cc:933] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:41.904695  4864 tablet_copy_client.cc:323] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:41.906224  4862 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:41.906764  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 07eb7068067d45559c8b38061e7c8808 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:41.907353  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 07eb7068067d45559c8b38061e7c8808 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-07eb7068067d45559c8b38061e7c8808
I20260709 12:20:41.926292  4009 tablet_copy_source_session.cc:215] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:41.931684  4864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07eb7068067d45559c8b38061e7c8808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:41.934561  4862 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:41.935541  4862 tablet_bootstrap.cc:492] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:41.936272  4862 ts_tablet_manager.cc:1403] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:20:41.939419  4862 raft_consensus.cc:359] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:41.940344  4862 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:41.941005  4862 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:41.948378  4862 ts_tablet_manager.cc:1434] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.005s
I20260709 12:20:41.950904  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-722124affb914f0496100070a9582045 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:41.951352  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-722124affb914f0496100070a9582045 on tablet 722124affb914f0496100070a9582045 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:41.957026  4864 tablet_copy_client.cc:806] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:41.959473  4864 tablet_copy_client.cc:670] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:41.963227  4864 tablet_copy_client.cc:538] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:41.976543  4864 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:42.003208  4862 ts_tablet_manager.cc:933] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:42.005220  4864 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:42.006206  4864 tablet_bootstrap.cc:492] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:42.006960  4864 ts_tablet_manager.cc:1403] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 12:20:42.010063  4864 raft_consensus.cc:359] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.010936  4864 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:42.012054  4864 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.016585  4864 ts_tablet_manager.cc:1434] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:20:42.017448  4862 tablet_copy_client.cc:323] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:20:42.018412  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-07eb7068067d45559c8b38061e7c8808 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:42.018864  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-07eb7068067d45559c8b38061e7c8808 on tablet 07eb7068067d45559c8b38061e7c8808 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:42.020031  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 63ac059d92404e2aa8792e1c5b02ae88 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:20:42.020712  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 63ac059d92404e2aa8792e1c5b02ae88 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-63ac059d92404e2aa8792e1c5b02ae88
I20260709 12:20:42.032550  3934 tablet_copy_source_session.cc:215] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:42.035970  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63ac059d92404e2aa8792e1c5b02ae88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:42.037145  4864 ts_tablet_manager.cc:933] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:42.038901  4864 tablet_copy_client.cc:323] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:42.041924  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet ac719796849e490f935d71c2a43cd7d6 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:42.042505  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet ac719796849e490f935d71c2a43cd7d6 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-ac719796849e490f935d71c2a43cd7d6
I20260709 12:20:42.051913  4862 tablet_copy_client.cc:806] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:42.052573  4862 tablet_copy_client.cc:670] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:42.059235  4009 tablet_copy_source_session.cc:215] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:42.059581  4862 tablet_copy_client.cc:538] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:42.066476  4864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac719796849e490f935d71c2a43cd7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:42.073271  4862 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:42.086615  4864 tablet_copy_client.cc:806] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:42.087273  4864 tablet_copy_client.cc:670] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:42.091167  4864 tablet_copy_client.cc:538] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:42.093480  4862 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:42.094424  4862 tablet_bootstrap.cc:492] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:42.095139  4862 ts_tablet_manager.cc:1403] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.006s
I20260709 12:20:42.097446  4862 raft_consensus.cc:359] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.098239  4862 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:42.098788  4862 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.100522  4864 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:42.101246  4862 ts_tablet_manager.cc:1434] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:42.103106  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-63ac059d92404e2aa8792e1c5b02ae88 received from {username='slave'} at 127.0.0.1:46046
I20260709 12:20:42.103554  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-63ac059d92404e2aa8792e1c5b02ae88 on tablet 63ac059d92404e2aa8792e1c5b02ae88 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:42.123997  4864 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:42.124984  4864 tablet_bootstrap.cc:492] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:42.125924  4864 ts_tablet_manager.cc:1403] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:20:42.128387  4864 raft_consensus.cc:359] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.129036  4864 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:42.129560  4864 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:42.131819  4864 ts_tablet_manager.cc:1434] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:20:42.134434  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ac719796849e490f935d71c2a43cd7d6 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:42.134855  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ac719796849e490f935d71c2a43cd7d6 on tablet ac719796849e490f935d71c2a43cd7d6 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:42.288318  4580 raft_consensus.cc:1217] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:42.458842  4580 raft_consensus.cc:1217] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:42.480619  4580 raft_consensus.cc:1217] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:42.543819  4580 raft_consensus.cc:1217] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:42.737984  4852 raft_consensus.cc:1064] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:42.740135  4852 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:42.749730  4580 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:42.752993  3848 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:42.754769  3920 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:42.756433  4852 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.758221  4873 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.759300  4852 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.769426  4860 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.772696  3920 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.784137  3842 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.792263  4580 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.809142  3748 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.860136  3994 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:42.870214  4580 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:42.874070  4852 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:42.875728  3920 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:42.880059  4852 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:42.883790  4860 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.885756  4580 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.903069  3747 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.909473  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07eb7068067d45559c8b38061e7c8808 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:42.909564  3920 raft_consensus.cc:2955] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:42.922400  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 07eb7068067d45559c8b38061e7c8808 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:42.938271  4885 tablet_replica.cc:333] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:42.939515  4885 raft_consensus.cc:2243] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.940477  4885 raft_consensus.cc:2272] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.960690  4885 ts_tablet_manager.cc:1916] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:42.985111  4792 raft_consensus.cc:1064] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:42.987869  4792 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:42.992434  4885 ts_tablet_manager.cc:1929] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:42.994210  4885 log.cc:1199] T 07eb7068067d45559c8b38061e7c8808 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/07eb7068067d45559c8b38061e7c8808
I20260709 12:20:42.996295  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 07eb7068067d45559c8b38061e7c8808 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:43.007782  4580 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.010576  3994 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.010797  4833 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.011667  4798 raft_consensus.cc:1064] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:43.013888  4888 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.015810  4798 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:43.037328  3923 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.041936  4792 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.059841  4580 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.061422  3844 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.066764  4890 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.067358  3994 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.068701  4798 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.072983  4833 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.075680  4891 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:43.089834  4583 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.106689  3747 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.109584  3999 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.114526  3917 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.121454  3848 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:43.135717  4798 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.141433  4580 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.143271  3994 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.157307  4886 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:43.167135  3999 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.166703  3844 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.170161  4873 raft_consensus.cc:1064] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:43.177481  4583 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.178797  4873 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:43.186856  4887 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.187808  4888 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:43.178712  3746 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.194970  4583 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.216838  3999 raft_consensus.cc:2955] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.217897  4580 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.221359  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 722124affb914f0496100070a9582045 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:43.221800  3923 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.223521  4852 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.228094  4879 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.233790  3745 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.236439  3923 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:43.244426  3844 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:43.276629  4860 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.281666  4581 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.283587  4890 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.292708  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 722124affb914f0496100070a9582045 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:43.294864  4891 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.302052  4583 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.319594  4879 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.323545  3842 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.336259  3745 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 1 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.354676  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63ac059d92404e2aa8792e1c5b02ae88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:43.358063  4891 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.361472  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet 63ac059d92404e2aa8792e1c5b02ae88 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:20:43.370507  4583 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.369086  4903 tablet_replica.cc:333] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:43.376799  3917 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.376799  4903 raft_consensus.cc:2243] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.378733  4903 raft_consensus.cc:2272] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.384243  3745 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.405916  3994 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:43.414729  4903 ts_tablet_manager.cc:1916] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:43.417058  4583 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.416124  3842 raft_consensus.cc:2955] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.418377  4852 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.426398  4852 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.435194  4583 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.443300  4905 tablet_replica.cc:333] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:20:43.443713  3924 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:43.450083  3746 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.452836  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac719796849e490f935d71c2a43cd7d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:43.453902  4879 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:43.454536  4905 raft_consensus.cc:2243] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.455595  4905 raft_consensus.cc:2272] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.471177  4903 ts_tablet_manager.cc:1929] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:43.471683  4903 log.cc:1199] T 722124affb914f0496100070a9582045 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/722124affb914f0496100070a9582045
I20260709 12:20:43.473336  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 722124affb914f0496100070a9582045 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:43.477028  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet ac719796849e490f935d71c2a43cd7d6 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:43.478267  4885 tablet_replica.cc:333] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:43.484704  3924 raft_consensus.cc:2955] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:43.497602  4905 ts_tablet_manager.cc:1916] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:43.502386  4885 raft_consensus.cc:2243] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:43.503044  4885 pending_rounds.cc:70] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Trying to abort 1 pending ops.
I20260709 12:20:43.503373  4885 pending_rounds.cc:77] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305624138429734912 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "ac719796849e490f935d71c2a43cd7d6" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } } }
I20260709 12:20:43.506278  4885 raft_consensus.cc:2917] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:20:43.506842  4885 raft_consensus.cc:2889] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:20:43.509303  4885 raft_consensus.cc:2272] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:43.514569  4885 ts_tablet_manager.cc:1916] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:43.526386  4905 ts_tablet_manager.cc:1929] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:43.527159  4905 log.cc:1199] T 63ac059d92404e2aa8792e1c5b02ae88 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/63ac059d92404e2aa8792e1c5b02ae88
I20260709 12:20:43.529328  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet 63ac059d92404e2aa8792e1c5b02ae88 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:43.531224  4885 ts_tablet_manager.cc:1929] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:43.531730  4885 log.cc:1199] T ac719796849e490f935d71c2a43cd7d6 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/ac719796849e490f935d71c2a43cd7d6
I20260709 12:20:43.533001  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet ac719796849e490f935d71c2a43cd7d6 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:44.552857  3994 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:20:44.563807  3964 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58188a85c5c940b2a6a6d9e2640f3b18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.564731  3924 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.565045  3848 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.566058  4906 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.566949  4860 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.579259  4906 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.581248  3842 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.585625  3916 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.601789  3745 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.642438  3848 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:20:44.658914  3815 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff4bdec26d3e4879bd33a92daad5d607. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.660099  3994 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.662215  3916 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.662094  4888 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.664225  4887 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.678593  4887 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.679127  3999 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.679962  3916 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.697999  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.702256  3999 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:44.713532  3842 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.713591  3916 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:44.714913  3964 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d96631b804304cddb7995664610e592d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.715461  4860 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.716347  4917 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.733062  4860 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.734256  3924 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.742317  3842 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.750087  3999 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:44.754205  3747 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.760641  3924 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:44.761090  3964 consensus_peers.cc:597] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7abd4286feba432697849b5bcf582f63. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:44.763875  3842 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:44.765512  4860 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.767161  4917 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:44.778149  4911 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.789391  3920 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.796721  3848 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:20:44.806176  3745 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 2, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:45.018456  4931 ts_tablet_manager.cc:933] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:45.022233  4931 tablet_copy_client.cc:323] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:45.024802  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 58188a85c5c940b2a6a6d9e2640f3b18 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:45.025393  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 58188a85c5c940b2a6a6d9e2640f3b18 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-58188a85c5c940b2a6a6d9e2640f3b18
I20260709 12:20:45.033607  4009 tablet_copy_source_session.cc:215] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:45.036976  4931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58188a85c5c940b2a6a6d9e2640f3b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:45.054394  4931 tablet_copy_client.cc:806] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:45.054986  4931 tablet_copy_client.cc:670] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:45.059042  4931 tablet_copy_client.cc:538] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:45.068624  4931 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:45.089082  4931 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:45.090042  4931 tablet_bootstrap.cc:492] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:45.090714  4931 ts_tablet_manager.cc:1403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:20:45.093717  4931 raft_consensus.cc:359] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.094638  4931 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:45.095301  4931 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.113471  4931 ts_tablet_manager.cc:1434] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.022s	user 0.022s	sys 0.000s
I20260709 12:20:45.120335  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-58188a85c5c940b2a6a6d9e2640f3b18 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:45.120826  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-58188a85c5c940b2a6a6d9e2640f3b18 on tablet 58188a85c5c940b2a6a6d9e2640f3b18 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:45.151124  4931 ts_tablet_manager.cc:933] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:45.152761  4931 tablet_copy_client.cc:323] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:45.154281  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet d96631b804304cddb7995664610e592d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:45.154784  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet d96631b804304cddb7995664610e592d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-d96631b804304cddb7995664610e592d
I20260709 12:20:45.163050  4009 tablet_copy_source_session.cc:215] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:45.166731  4931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96631b804304cddb7995664610e592d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:45.191213  4931 tablet_copy_client.cc:806] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:45.192028  4931 tablet_copy_client.cc:670] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:45.197461  4931 tablet_copy_client.cc:538] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:45.198474  4936 ts_tablet_manager.cc:933] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:20:45.203874  4936 tablet_copy_client.cc:323] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:20:45.205699  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet ff4bdec26d3e4879bd33a92daad5d607 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:20:45.206261  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet ff4bdec26d3e4879bd33a92daad5d607 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-ff4bdec26d3e4879bd33a92daad5d607
I20260709 12:20:45.209384  4931 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:45.213955  3860 tablet_copy_source_session.cc:215] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:45.218335  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4bdec26d3e4879bd33a92daad5d607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:45.235836  4931 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:45.236791  4931 tablet_bootstrap.cc:492] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:45.237490  4931 ts_tablet_manager.cc:1403] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.012s
I20260709 12:20:45.240677  4931 raft_consensus.cc:359] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.241494  4931 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:45.242152  4931 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.243961  4936 tablet_copy_client.cc:806] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:45.244848  4936 tablet_copy_client.cc:670] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:45.249780  4931 ts_tablet_manager.cc:1434] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:20:45.251663  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-d96631b804304cddb7995664610e592d received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:45.252091  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-d96631b804304cddb7995664610e592d on tablet d96631b804304cddb7995664610e592d with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:45.253894  4936 tablet_copy_client.cc:538] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:45.264386  4936 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:45.287325  4936 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:45.287716  4931 ts_tablet_manager.cc:933] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:45.288411  4936 tablet_bootstrap.cc:492] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:45.289244  4936 ts_tablet_manager.cc:1403] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 12:20:45.292382  4936 raft_consensus.cc:359] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.293291  4936 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:45.294734  4936 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.301914  4936 ts_tablet_manager.cc:1434] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:20:45.304721  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ff4bdec26d3e4879bd33a92daad5d607 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:20:45.305183  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-ff4bdec26d3e4879bd33a92daad5d607 on tablet ff4bdec26d3e4879bd33a92daad5d607 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:45.310262  4931 tablet_copy_client.cc:323] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:20:45.312337  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 7abd4286feba432697849b5bcf582f63 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:20:45.312901  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 7abd4286feba432697849b5bcf582f63 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-7abd4286feba432697849b5bcf582f63
I20260709 12:20:45.321197  4009 tablet_copy_source_session.cc:215] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:45.324862  4931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abd4286feba432697849b5bcf582f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:45.342356  4931 tablet_copy_client.cc:806] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:45.342916  4931 tablet_copy_client.cc:670] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:45.346875  4931 tablet_copy_client.cc:538] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:45.354312  4931 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:20:45.387975  4931 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:45.389102  4931 tablet_bootstrap.cc:492] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:20:45.389846  4931 ts_tablet_manager.cc:1403] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.008s
I20260709 12:20:45.393388  4931 raft_consensus.cc:359] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.394212  4931 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:20:45.394898  4931 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:45.397114  4931 ts_tablet_manager.cc:1434] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:45.403415  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-7abd4286feba432697849b5bcf582f63 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:20:45.403904  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-7abd4286feba432697849b5bcf582f63 on tablet 7abd4286feba432697849b5bcf582f63 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:45.644626  4583 raft_consensus.cc:1217] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:45.690471  4581 raft_consensus.cc:1217] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:45.749416  4583 raft_consensus.cc:1217] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:45.775292  4583 raft_consensus.cc:1217] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:46.038419  4917 raft_consensus.cc:1064] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:46.041193  4917 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.059312  4581 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.060410  3842 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.062599  3920 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.064102  4860 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.065642  4911 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.067445  4911 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.082394  4911 raft_consensus.cc:1064] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:46.081255  4949 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.086127  4911 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.090104  3920 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.100844  3842 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.115696  3747 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.128563  4581 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.142467  3848 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.144105  4955 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.151775  4583 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.152323  3916 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.158479  4917 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.159976  4950 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.184464  4953 raft_consensus.cc:1064] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:46.185398  4952 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.187675  4580 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.187732  4953 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.205520  3916 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.224145  3745 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.237092  3848 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.241937  4580 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.243781  3920 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.243781  3842 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:46.245399  4911 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.255847  3991 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.257786  4952 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:46.264227  4580 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:46.265659  4950 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:46.275779  3842 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:46.275580  4953 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:46.287854  4911 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:46.291092  4581 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.290279  4949 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.331507  3748 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.337313  3991 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.340713  3842 raft_consensus.cc:2955] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.350478  4580 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:46.351990  4952 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:46.350281  4953 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.360731  3920 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.367764  4955 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.371492  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 58188a85c5c940b2a6a6d9e2640f3b18 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:46.374372  3848 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:46.378592  4888 raft_consensus.cc:1064] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:20:46.377895  4580 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.389847  3842 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.390715  4888 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:46.403749  4950 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
W20260709 12:20:46.530212  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49997.2us
I20260709 12:20:46.541419  4580 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:46.547683  4970 tablet_replica.cc:333] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:48.278880  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58188a85c5c940b2a6a6d9e2640f3b18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:48.292634  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6d40 after lost signal to thread 2680
I20260709 12:20:48.474354  4982 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.484966  4983 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.485319  4982 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.492026  4984 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.493062  4981 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.493345  4984 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.486126  4983 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.489516  4980 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.496824  4984 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.495085  4981 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.497725  4984 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.498648  4984 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.499898  4981 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.501446  4984 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.503105  4981 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.505296  4981 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.505810  4984 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.507808  4984 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.496397  4980 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.510864  4984 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.497314  4982 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.512108  4980 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.516319  4981 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.518339  4985 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.519410  4985 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.524062  4982 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.531970  4984 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.531745  4982 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.533006  4984 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.535043  4982 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.535979  4982 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.537108  4982 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.535915  4981 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.524916  4985 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.539975  4981 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.543262  4981 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.545673  4984 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.545760  4981 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.546446  4984 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.546872  4981 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.547389  4984 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.531664  4983 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.549149  4980 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.559746  4991 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.559765  4980 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.562213  4984 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.559688  4983 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.563956  4983 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.564240  4980 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.570068  4984 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.570914  4984 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.573824  4981 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.571534  4982 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.561889  4991 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.574755  4984 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.580430  4981 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.581800  4989 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.584374  4989 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.587469  4989 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.584619  4980 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.588521  4991 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.590596  4983 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.591624  4988 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.592394  4982 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.593370  4987 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.608493  4982 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.608628  4987 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.610257  4989 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.588657  4980 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.603004  4991 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.611056  4989 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.620306  4985 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.617951  4981 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.621299  4985 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.622622  4989 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.615877  4988 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:48.619221  4949 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.624049  4985 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.623916  4949 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.625808  4988 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.583670  4984 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.628273  4987 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.634997  4983 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.633209  4988 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.636276  4988 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.636026  4983 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.637288  4982 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.638690  4988 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.638461  4991 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.639873  4989 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.641021  4989 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.641597  4991 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.636077  4949 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.635265  4985 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.639168  4983 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.652228  4991 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.667312  4991 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.666765  4983 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.654297  4992 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.698235  4992 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.700563  4989 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.669358  4983 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.702226  4991 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.702852  4991 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.703015  4992 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.703712  4983 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.703755  4991 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.703868  4984 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.705168  4985 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.706161  4980 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.706920  4984 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.706781  4988 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.707669  4988 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.710558  4988 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.710958  4981 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.720439  5000 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.721385  5000 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.726557  4999 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.729564  5000 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.730449  4985 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.733309  4981 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.733870  4984 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.734180  4981 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.734771  4984 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.737196  4984 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.737196  4981 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.738138  4984 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.738581  4981 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.738788  4984 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.739311  4981 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.742697  4985 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.742939  4991 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.743397  4985 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.743911  4984 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.744709  4999 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.745543  4985 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.746838  4986 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.747239  4999 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.747645  4986 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.751554  4986 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.752444  4986 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.753170  4911 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.753147  4986 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.731110  3748 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:48.753881  4911 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.755992  4986 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.756230  4911 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.757266  4985 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.757360  5001 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.758105  4985 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.758167  5001 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.758687  4981 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:48.760531  4985 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.761982  4977 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.763260  4977 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.766260  4977 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.771097  4993 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.770347  4911 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.778448  4911 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.772022  4993 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.787086  4911 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.797140  4911 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.810065  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d96631b804304cddb7995664610e592d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:48.815009  4994 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.815887  4994 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:48.828014  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.420s	user 0.032s	sys 0.046s
I20260709 12:20:48.827844  4977 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.795420  4993 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.911561  5001 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:48.930384  4991 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.856151  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:48.934653  3917 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:48.934466  4991 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.939267  4985 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.937172  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:48.940058  4970 raft_consensus.cc:2243] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:48.940202  4985 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.941515  4970 raft_consensus.cc:2272] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:48.935649  4949 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.943143  4949 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.936687  4995 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.939572  4955 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.910919  4999 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.907829  4952 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:48.882412  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.010003  3918 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:20:49.010838  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.603s	user 0.036s	sys 0.059s
I20260709 12:20:49.011322  4999 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:48.936651  5001 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.944805  4995 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.023361  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.023604  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.024307  3917 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.024654  3925 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.025096  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.025878  3920 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.028762  4955 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.031430  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:48.894264  4994 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:48.911929  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:48.829356  4911 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:48.897935  4997 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:48.854612  4986 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:48.935755  5000 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.032469  3923 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.131428  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.340545  4952 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.402086  4952 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.023627  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.404341  3918 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:48.935400  4977 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.360368  4991 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.157775  5006 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.076754  4993 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.023675  4999 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.163578  5004 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.360208  4970 ts_tablet_manager.cc:1916] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:49.414047  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.415031  3923 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:49.131307  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.380016  4985 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.417404  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.311664  4995 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.138181  4955 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.032204  4949 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.139973  5008 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.422206  3846 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.422340  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.425802  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.426204  5000 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.013602  5001 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.427793  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.434381  4993 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.436465  5006 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.444736  5000 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.445029  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.446122  5006 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.446601  5011 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.448166  4993 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.449343  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.450309  3922 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.452031  5009 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.452688  5009 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.452999  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.454224  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.455117  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.455282  5009 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.460812  4917 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.461580  4917 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.463567  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.464809  5009 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.464258  4917 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.465559  4917 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.447361  5011 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.449390  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.470824  4917 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.466216  4955 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.467226  4990 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.472904  4990 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.467711  4985 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.465415  5009 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.471711  4949 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.491655  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.492565  4917 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.492709  4985 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.503844  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.504873  4911 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.424701  4986 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.505862  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.506783  3994 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.507815  4986 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.508185  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.497906  4997 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.510710  4990 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.493456  4952 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.491655  4860 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.432355  5004 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:20:49.512776  4860 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.498740  5011 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.494535  5009 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.491365  4955 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.534019  4955 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.511560  4949 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.536006  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.536829  3997 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.537734  4949 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.527248  4985 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.512317  4952 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.540370  4952 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.540261  3745 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:49.543416  4860 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.544150  5011 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.544821  5011 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.545524  5012 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.512840  4977 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.510818  4997 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.546353  4999 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.581090  4995 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.587476  4995 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.590052  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.600869  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.601136  5004 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.602660  5001 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.582341  5008 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.604637  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.580639  4991 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.574158  5000 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.546432  5012 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.609875  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.610661  3845 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.610800  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.591202  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.613600  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.613529  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.620747  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.621672  3993 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.608872  5011 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.623298  3848 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:49.626926  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.625005  3842 raft_consensus.cc:2955] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:49.625276  3843 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:49.627954  4993 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.628353  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.628585  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.628717  4993 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.629791  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.627997  4995 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.630465  3992 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.630697  4995 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.631516  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.632095  3994 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.625222  4999 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.633293  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.633962  3991 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.634090  4999 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.634362  4944 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.612687  4991 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.616714  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.637388  4991 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.631295  4995 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.619112  5015 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.634889  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.617439  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.622656  4997 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.629794  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.622766  5000 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.635012  4944 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.645478  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.674948  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.672828  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.666360  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.658653  5008 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.757323  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.764914  3844 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.766335  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.655766  3997 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.688794  4991 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:49.767704  4991 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.768761  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.694764  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:49.769062  4957 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
I20260709 12:20:49.772908  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.717684  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.766753  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.655898  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.708102  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:49.756963  3871 debug-util.cc:398] Leaking SignalData structure 0x7b080019ada0 after lost signal to thread 3782
I20260709 12:20:49.800618  3841 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:49.741932  4999 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.818531  4999 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.727005  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 178) took 1210 ms. Trace:
I20260709 12:20:49.806057  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.821606  3746 rpcz_store.cc:276] 0709 12:20:48.516397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.821578 (+305181us) service_pool.cc:224] Handling call
0709 12:20:49.726723 (+905145us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:20:49.708595  4993 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.830102  4583 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:49.773715  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.833861  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.837030  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.811056  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.691887  5015 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:49.742303  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.846266  5012 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.843365  5000 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.832687  4997 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.889760  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.894166  3995 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:49.850144  3871 debug-util.cc:398] Leaking SignalData structure 0x7b0800293240 after lost signal to thread 3874
I20260709 12:20:49.844082  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.861148  4999 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.842821  5020 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:49.895813  4997 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.896049  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.896287  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.847329  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:49.890787  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.892674  3748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 189) took 1377 ms. Trace:
I20260709 12:20:49.892792  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.894830  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.897536  3916 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:49.899727  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.908488  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:49.908716  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.908792  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.909255  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 99) took 1129 ms. Trace:
I20260709 12:20:49.910007  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.900986  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.901616  4991 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.897472  3748 rpcz_store.cc:276] 0709 12:20:48.515873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.522873 (+  7000us) service_pool.cc:224] Handling call
0709 12:20:49.892580 (+1369707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:48.765867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:48.766895 (+  1028us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:48.766957 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:20:48.766997 (+    40us) tablet.cc:662] Decoding operations
0709 12:20:48.771012 (+  4015us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:48.771132 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:48.771167 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:48.771719 (+   552us) tablet.cc:701] Row locks acquired
0709 12:20:48.771782 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:20:48.772016 (+   234us) write_op.cc:270] Start()
0709 12:20:48.772173 (+   157us) write_op.cc:276] Timestamp: P: 1783599648771934 usec, L: 0
0709 12:20:48.772212 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:20:48.786395 (+ 14183us) log.cc:844] Serialized 594 byte log entry
0709 12:20:49.817424 (+1031029us) op_driver.cc:464] REPLICATION: finished
0709 12:20:49.819534 (+  2110us) write_op.cc:301] APPLY: starting
0709 12:20:49.819643 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:49.819757 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:49.819897 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:49.820337 (+   440us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:49.820650 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:49.820719 (+    69us) write_op.cc:312] APPLY: finished
0709 12:20:49.821163 (+   444us) log.cc:844] Serialized 22 byte log entry
0709 12:20:49.822048 (+   885us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:49.822144 (+    96us) write_op.cc:454] Released schema lock
0709 12:20:49.822196 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:49.823025 (+   829us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:49.823055 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1639,"apply.run_cpu_time_us":2256,"apply.run_wall_time_us":3555,"num_ops":1,"prepare.queue_time_us":8620,"prepare.run_cpu_time_us":4778,"prepare.run_wall_time_us":21025,"replication_time_us":1045024,"thread_start_us":12593,"threads_started":2}]]}
I20260709 12:20:49.903519  3849 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:49.904031  5015 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:49.904325  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:49.906214  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 90440us
I20260709 12:20:49.889916  4970 ts_tablet_manager.cc:1929] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:49.904795  4944 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.906747  4952 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:49.917416  4952 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:49.917976  4952 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:49.909613  3745 rpcz_store.cc:276] 0709 12:20:48.780251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.780543 (+   292us) service_pool.cc:224] Handling call
0709 12:20:49.533518 (+752975us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:49.909195 (+375677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:49.728231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:49.774629 (+ 46398us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:49.774671 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:20:49.774690 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:49.775048 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:49.775113 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:49.775139 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:49.775338 (+   199us) tablet.cc:701] Row locks acquired
0709 12:20:49.775356 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:49.775549 (+   193us) write_op.cc:270] Start()
0709 12:20:49.775667 (+   118us) write_op.cc:276] Timestamp: P: 1783599649775500 usec, L: 0
0709 12:20:49.775696 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:20:49.776362 (+   666us) log.cc:844] Serialized 532 byte log entry
0709 12:20:49.819547 (+ 43185us) op_driver.cc:464] REPLICATION: finished
0709 12:20:49.823393 (+  3846us) write_op.cc:301] APPLY: starting
0709 12:20:49.823489 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:49.823634 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:49.823742 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:49.823966 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:49.824125 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:49.824248 (+   123us) write_op.cc:312] APPLY: finished
0709 12:20:49.824446 (+   198us) log.cc:844] Serialized 22 byte log entry
0709 12:20:49.825227 (+   781us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:49.825315 (+    88us) write_op.cc:454] Released schema lock
0709 12:20:49.825357 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":67221,"reported_tablets":1,"spinlock_wait_cycles":13404032,"child_traces":[["op",{"apply.queue_time_us":3612,"apply.run_cpu_time_us":1639,"apply.run_wall_time_us":2579,"num_ops":1,"prepare.queue_time_us":123771,"prepare.run_cpu_time_us":3569,"prepare.run_wall_time_us":88549,"replication_time_us":43623,"thread_start_us":85986,"threads_started":2}]]}
W20260709 12:20:49.917351  5016 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.262s	user 0.004s	sys 0.000s
W20260709 12:20:49.928004  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08003398a0 after lost signal to thread 3949
W20260709 12:20:49.889124  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44604us
I20260709 12:20:49.895912  5020 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:49.900624  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.914709  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet d96631b804304cddb7995664610e592d with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40552
I20260709 12:20:49.916587  4970 log.cc:1199] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/58188a85c5c940b2a6a6d9e2640f3b18
I20260709 12:20:49.933171  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.932663  5020 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:49.934434  4970 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40552 (request call id 67) took 3563 ms. Trace:
I20260709 12:20:49.935431  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.935843  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.936028  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.936597  3994 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.937685  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.939363  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.939764  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.934908  4970 rpcz_store.cc:276] 0709 12:20:46.371148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.371305 (+   157us) service_pool.cc:224] Handling call
0709 12:20:46.547262 (+175957us) ts_tablet_manager.cc:1151] Deleting tablet 58188a85c5c940b2a6a6d9e2640f3b18
0709 12:20:46.547348 (+    86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:49.695379 (+3148031us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:49.842549 (+147170us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:49.934326 (+ 91777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2363070,"tablet-delete.queue_time_us":175148,"thread_start_us":63180,"threads_started":1}
I20260709 12:20:49.947387  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.948174  3993 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.948855  4970 tablet_replica.cc:333] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:20:49.949329  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.950107  4970 raft_consensus.cc:2243] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:49.950837  4952 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:49.951821  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5d00 after lost signal to thread 4023
W20260709 12:20:49.952991  3871 debug-util.cc:398] Leaking SignalData structure 0x7b080011b060 after lost signal to thread 4608
I20260709 12:20:49.953415  4995 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.955870  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.955878  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.956681  3919 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:49.957706  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.958403  3998 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.964433  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.965225  3999 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.966306  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.966684  4994 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:49.967079  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.968365  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.969616  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.970330  3994 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.972224  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.973877  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.974594  3996 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.975086  3991 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:49.978334  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.979148  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.979677  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:49.980399  4583 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.981117  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.982432  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.983664  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.984441  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.984686  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.985599  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.986219  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:49.986362  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.986898  3993 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:49.987020  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.988086  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:49.989058  4952 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:49.995610  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:49.947789  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 58188a85c5c940b2a6a6d9e2640f3b18 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:49.956351  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:49.996603  3734 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48972.5us
I20260709 12:20:49.997483  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:49.998145  4583 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:50.002944  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.003278  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.003750  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.004415  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.008078  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.011955  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.012841  4580 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:50.015726  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:49.906013  3990 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.017151  4580 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:49.981885  3962 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.020382  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:50.021716  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 43771.8us
I20260709 12:20:50.021850  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:50.023175  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 215758us
I20260709 12:20:50.030869  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.031193  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.033357  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.017892  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.040596  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.041136  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.041532  3917 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:50.042847  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.036588  4582 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.029834  4952 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.044579  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.043589  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.048590  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.049268  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.049983  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.048707  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.052316  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.052930  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.052876  4580 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.038713  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.053617  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.058785  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.059527  4583 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.063716  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 202) took 1055 ms. Trace:
I20260709 12:20:50.055723  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.046109  4952 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:50.064260  3747 rpcz_store.cc:276] 0709 12:20:48.943874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.009746 (+ 65872us) service_pool.cc:224] Handling call
0709 12:20:49.999290 (+989544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1778,"reported_tablets":1}
I20260709 12:20:50.069075  4952 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.071331  5015 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.071805  5015 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.072214  5015 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.070187  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.054509  5011 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:20:50.084295  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.085217  4579 raft_consensus.cc:1813] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Handling vote request from an unknown peer 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:50.086112  4579 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:50.077401  4977 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.092072  4977 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:50.092607  4977 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.096879  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.098204  4995 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.098709  4995 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.099174  4995 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.102062  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.066252  4970 raft_consensus.cc:2272] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:50.075672  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.117527  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.119980  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.121134  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:50.122140  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46543us
I20260709 12:20:50.124967  4991 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.132727  4970 ts_tablet_manager.cc:1916] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:50.120694  5006 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.134338  5006 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.134745  5006 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.129184  5003 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.135861  5003 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:50.136251  5003 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.138958  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.131295  4991 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.140157  4991 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.140280  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.145375  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.146145  4583 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.146281  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.147990  5020 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.148999  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.149348  4952 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.151858  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.162225  4952 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.162474  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.168844  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.175006  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.172010  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.178469  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.180200  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:50.181325  4999 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.181895  4999 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:50.182101  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.182422  4999 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.183295  5000 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.183794  5000 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.184193  5000 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.190492  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.194911  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.196457  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.197063  4583 raft_consensus.cc:1813] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Handling vote request from an unknown peer 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:50.197659  4583 raft_consensus.cc:2410] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:50.199934  4546 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.200994  5019 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:50.176734  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46127.7us
I20260709 12:20:50.202232  4999 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.203513  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.204594  5019 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.204916  4999 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.206450  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.208967  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:50.210569  4999 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.185353  5015 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.215369  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.214258  5015 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.217677  4580 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.218278  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.223369  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.225905  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:50.223723  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43642.1us
I20260709 12:20:50.227180  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.226253  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.229866  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.230266  4977 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.230726  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.231118  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.225817  4999 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.232362  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.232648  4977 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.233477  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.234068  3999 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:50.234038  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.235634  5020 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.236042  5020 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.236426  5020 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.236807  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.234819  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.239187  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.234351  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.244158  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.244477  3997 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:50.244926  3996 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:50.246707  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.247080  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.247337  4580 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:50.248432  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.249130  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.249760  3843 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.266141  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.267041  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.268882  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:50.243705  5017 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.277665  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.260490  4977 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:50.285991  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.294998  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.295562  5006 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.296048  5017 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.296502  5017 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.296883  5017 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.297057  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.297905  5006 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.295928  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.270730  4994 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.280800  4977 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:50.239734  5000 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.306972  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.307349  4991 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.310110  5021 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.306905  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.312580  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.322167  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.325398  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.328963  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.316056  4995 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.313095  4977 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:50.329066  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 92342.8us
I20260709 12:20:50.332307  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.333586  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:50.336447  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.338332  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.319672  5020 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.340687  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:50.342147  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45278.2us
I20260709 12:20:50.330148  4576 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.330153  3990 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:50.342926  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.338747  5021 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:50.360852  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 88007us
I20260709 12:20:50.340481  4944 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.363389  5029 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.364178  5029 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.364722  5029 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.369975  5020 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.370738  5020 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.371150  5020 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.346510  5017 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.372030  5027 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.372608  4577 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.375876  4578 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.376521  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.390261  5000 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.391813  4991 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.394361  4995 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.401221  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.403415  5017 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.403889  5027 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.373937  5003 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.367650  4944 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.406139  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.411854  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.412741  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.414984  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.423133  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.421559  3848 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.400126  5020 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.425866  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:50.434229  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 91445.7us
I20260709 12:20:50.421526  4944 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.435927  3890 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:50.419951  5027 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.438941  3890 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.442062  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:50.454692  5001 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:50.454995  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:50.456027  5001 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:50.456449  5001 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:50.457461  5001 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.458846  5001 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:50.459858  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 117358us
I20260709 12:20:50.460320  3890 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.460695  3889 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.464504  3890 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.465191  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.444550  5017 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.473155  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.474164  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:50.474681  5033 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.466651  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:50.467600  5021 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.485023  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.467996  5017 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:20:50.482012  3890 raft_consensus.cc:2686] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:50.485718  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:50.493104  5032 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.493595  5032 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.493976  5032 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.493754  3843 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:50.491802  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.486477  5033 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.487423  5003 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.487735  5021 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.488724  5017 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.501822  5031 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:50.503998  5031 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.504443  5031 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.504855  5031 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.507906  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.509790  3890 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.501053  5021 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:50.512351  3890 raft_consensus.cc:2686] T 58188a85c5c940b2a6a6d9e2640f3b18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:50.521593  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:50.524856  5030 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.525414  5030 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.527418  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:50.532684  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48958.5us
I20260709 12:20:50.533543  5003 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.534214  5003 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.534780  5003 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.535862  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.544641  5009 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.545070  5009 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.545439  5009 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.545724  4970 ts_tablet_manager.cc:1929] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:50.526466  5030 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.550776  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.525987  5033 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.549288  4970 log.cc:1199] T d96631b804304cddb7995664610e592d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/d96631b804304cddb7995664610e592d
W20260709 12:20:50.557878  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83287.6us
W20260709 12:20:50.555140  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70194us
I20260709 12:20:50.554203  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.559078  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.563889  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:20:50.568261  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46717.1us
I20260709 12:20:50.568964  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.571789  3962 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:50.572233  5037 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:20:50.575210  4860 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.575630  4860 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.575964  4860 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.557463  4977 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.570533  4952 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.573498  5037 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.573953  5033 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.571738  5003 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.581872  4952 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.591331  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet d96631b804304cddb7995664610e592d (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:20:50.612593  4977 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.596019  4952 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.622279  3847 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.623806  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.629408  5030 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.634569  5020 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.637104  5003 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.636991  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.638713  5017 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:50.643163  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89080.5us
I20260709 12:20:50.645543  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.646330  5034 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:50.639555  5035 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.647787  4944 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.649720  4977 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.655385  4977 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.655493  5038 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:50.655928  4977 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.656188  5038 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:50.650116  5034 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:50.655356  5035 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.663959  5034 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.665817  5035 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.657369  5038 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.662175  5021 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.653851  5029 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.657728  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.666859  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.673187  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.676808  5020 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.648818  5030 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.668344  5028 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:20:50.679275  5028 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:50.679694  5028 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:50.670014  5017 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.670856  4944 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.680831  5028 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.681949  5003 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.683045  5003 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.683467  5003 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.683599  5028 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.655364  5009 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.671159  5027 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.686349  4860 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.687988  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.693019  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.694656  5004 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.695190  5004 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.695967  5004 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.699775  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.700048  4860 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.725754  5039 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.726280  5039 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.726691  5039 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.681162  4952 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:50.735175  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 164433us
I20260709 12:20:50.736582  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.733722  5040 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.738793  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.739346  5037 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.740605  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.740924  5037 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.741217  5030 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.741454  5037 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.741689  5030 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.742137  5030 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.740314  3889 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.740513  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.743897  5036 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.749514  5021 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.749899  3847 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.756649  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.745178  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.746027  5027 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.734773  5038 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.752489  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.685120  5031 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:50.758445  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 189538us
I20260709 12:20:50.765928  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.767187  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.767966  4581 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:50.767812  5021 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.768432  5021 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.768887  5021 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.769870  4952 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.734169  5032 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.775493  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.775756  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.738354  4977 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.772601  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.753966  5036 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:20:50.773932  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74273.3us
I20260709 12:20:50.785084  5037 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.786646  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.787578  4944 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.788267  5042 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:50.790776  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.790674  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.796627  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.799297  5020 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.799249  4578 raft_consensus.cc:2393] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:50.799860  5020 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.800446  5020 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.802333  5003 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.774436  5029 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.803897  5029 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.804323  5029 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.804734  5029 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.805106  5003 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.799232  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.807401  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.808218  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.808923  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.792734  5032 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.808118  5039 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.811381  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.811887  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.813393  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.813572  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.814433  3925 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.771601  5027 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:20:50.789752  5036 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.816431  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.817520  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.781845  5017 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.823330  4860 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.826380  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.809535  5042 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.827816  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.829164  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.836544  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.825790  5033 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:50.842025  4860 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.844024  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:50.842881  5009 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.851776  5041 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.854508  5021 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.856773  4997 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:50.860847  4977 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.820112  4944 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.834004  5017 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.863394  4944 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.864089  5043 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:50.864589  5043 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:50.866252  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.866292  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.867733  5037 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.868316  5021 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.835065  5042 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.872653  4860 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.873090  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.839968  4952 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.865003  5043 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:50.874976  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73192.3us
I20260709 12:20:50.859078  5030 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.878121  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.878389  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.879824  5031 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:50.881495  5039 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.884353  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.884730  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:50.876861  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.584s (SENT) [suppressed 4 similar messages]
I20260709 12:20:50.874881  5032 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:50.871146  5033 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.892402  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.893970  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.895126  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.896440  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:50.907893  4860 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.887128  5032 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:50.895619  4952 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.895668  5001 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.925251  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:50.926680  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49846.5us
I20260709 12:20:50.913182  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.897549  5039 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.926395  4860 consensus_queue.cc:1059] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:50.887367  5035 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.897099  4977 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.932497  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:50.938868  4860 raft_consensus.cc:3055] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:50.939280  4860 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:50.940362  3924 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.941852  3917 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.943923  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.946714  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:50.948655  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:50.949052  3921 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.950729  4860 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:50.952204  4860 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.952103  5029 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.954555  5029 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.956311  3918 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.957051  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:50.950732  5004 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:50.960592  5006 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.934458  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:50.961481  5004 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:50.934998  5040 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:50.978993  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:50.975378  3924 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:50.964773  3747 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 2, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:50.992288  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.000519  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.004750  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:50.968964  4994 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.016577  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:51.021214  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88804.9us
I20260709 12:20:51.032200  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:50.978473  5017 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:50.979485  5029 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:20:51.035831  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.006644  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.099103  3916 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.006038  5033 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:51.099439  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 124611us
I20260709 12:20:51.099303  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:51.078617  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 74143.6us
I20260709 12:20:51.105031  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.111784  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.034693  5031 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:51.050765  3921 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.112130  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.115881  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.116112  3998 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:51.121281  5031 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.051255  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.128027  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.126602  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.127359  4952 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.125206  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:51.033820  5020 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.101763  5030 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.130755  4860 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.131969  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.136436  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:50.997309  5032 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.051857  5029 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.142884  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.146236  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.154043  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.155866  3991 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:51.128885  3990 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.157612  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.158938  3916 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.164640  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:20:51.168697  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63771.3us
I20260709 12:20:51.170034  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.156975  5040 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.168685  4860 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:51.158938  4952 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.156751  5049 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.165418  5012 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:51.171573  3814 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.160094  5048 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:20:51.174974  4860 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.178936  4860 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:51.181710  3924 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.187994  5057 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.189831  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.190631  5057 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.175020  5035 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:51.191538  5057 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:51.139385  5043 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.191948  5057 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:51.192341  5057 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.192544  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.193938  5043 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:51.195263  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.216624  5057 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.222986  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.223788  5049 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.224496  5049 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:51.224519  3921 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.224880  5049 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:51.225297  5005 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:20:51.225682  5012 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.227298  5005 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.227659  5005 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:20:51.232913  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61443.8us
I20260709 12:20:51.236784  5056 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.236680  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.240864  4860 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.168926  5051 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.246304  5020 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.246904  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.247526  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.257632  3925 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.258329  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.225353  5049 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.264603  3992 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.253867  4952 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.278757  3994 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.248437  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.286124  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.283658  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.289486  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.264679  5031 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.281205  4952 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:51.269250  5057 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.275964  5052 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:20:51.297328  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.298540  4993 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.298966  4993 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.299870  4993 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.301151  4993 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.296705  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:51.303032  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68501.1us
I20260709 12:20:51.280702  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:51.305434  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.304157  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.288093  5029 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.313127  4952 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.314482  4952 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:51.320075  5050 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:20:51.302228  5005 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.308861  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.322186  5005 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:51.323694  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.307207  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:51.308174  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.327291  5062 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.309933  5006 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.327562  3814 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.290303  5036 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.374514  3920 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.376547  5036 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:51.378715  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:51.382483  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 89740.3us
W20260709 12:20:51.385491  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.385610  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.386500  4977 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.386977  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.387903  4977 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:51.396224  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 201044us
I20260709 12:20:51.397356  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.399914  5059 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:51.400594  5059 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:51.401122  5059 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.401935  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.403398  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.404511  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.398984  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.319020  5042 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:51.406818  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 79333.4us
I20260709 12:20:51.407382  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.410384  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.411078  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.413216  5063 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.413736  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.414533  3922 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.418360  3916 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:51.417513  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.420694  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.409570  5057 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.425357  5057 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.426353  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.427392  3918 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:51.420073  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.434563  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:51.441007  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.443079  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 226011us
I20260709 12:20:51.443975  5063 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.441227  5058 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:51.448618  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.459518  3814 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:51.464565  5054 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.466063  5042 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.467857  3925 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.469194  5032 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.454366  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.478648  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.481086  3992 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.483007  5056 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:51.483573  5056 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.484440  5056 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.492472  5063 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:51.496340  5061 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.497426  5061 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.497773  5061 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.498602  5061 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.493040  5063 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.503093  4860 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.508809  5063 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:51.517799  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.521373  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.544109  3992 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.518309  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:51.542232  3922 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.547340  5012 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:51.547400  5062 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.552110  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:20:51.553026  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.554690  3922 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:51.527403  4578 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:51.560084  5051 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:20:51.571133  5062 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.572732  4997 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.573341  4997 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:20:51.574256  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.564432  5052 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.575366  5052 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.581028  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.574479  4997 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.557327  5061 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.582558  5066 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.586333  5051 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.586458  3995 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.591379  3843 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.592415  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.565236  5012 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.598456  5012 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.599397  5012 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.603708  5062 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.604454  5012 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.606808  3920 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.604882  5062 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.609571  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:51.610387  3918 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:51.608619  5062 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.614485  3918 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:51.615736  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:51.596997  5051 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.620283  3917 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:51.600607  5049 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.627986  4576 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.614787  5062 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.649080  5003 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:51.649919  5062 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.656919  5058 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.657434  5058 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.576613  5052 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.623607  4997 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.661798  3918 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.662189  5059 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.658411  5058 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.663400  3920 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:51.666877  5058 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.667433  5059 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:51.672709  4581 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.628283  5005 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:20:51.704391  5005 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.704922  5005 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:51.706032  5005 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.714334  5051 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.729249  5049 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:51.736435  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.715911  5042 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:51.743806  5032 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:51.744854  5032 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:51.746629  5005 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.748736  5032 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:51.750581  5032 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.745764  5051 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.749410  5052 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.763888  3889 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.768725  3990 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:51.784973  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.787498  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.795796  5036 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.799583  5042 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.828846  5048 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.831385  5042 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:51.855753  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 445403us
I20260709 12:20:51.857873  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.860067  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:20:51.860931  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 253165us
I20260709 12:20:51.864501  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.870023  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.872917  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.875186  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:51.876020  4581 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.876202  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.877723  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.879199  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:51.880089  4583 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:51.882208  5042 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.885782  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.875190  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:51.887856  3999 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:51.889348  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.892908  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.869858  5049 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.870314  5054 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.870236  5059 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.856256  5048 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.896252  5042 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.900701  5057 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.898195  5058 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:51.900758  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:51.943383  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.945204  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:20:51.947223  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 54418.5us
I20260709 12:20:51.947263  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:51.904217  5001 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:20:51.956512  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 83677.5us
I20260709 12:20:51.964133  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:51.967739  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.972276  4581 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:51.949931  5061 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:51.936390  5058 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:51.958132  5036 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:51.997512  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.875379  3998 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:52.047101  5058 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.056216  5048 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.045614  3990 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.011302  5056 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:20:52.058409  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.014885  4582 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.067221  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:51.974756  5062 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:20:52.072341  3992 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.013983  5036 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.075416  4581 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:20:52.060279  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 173581us
I20260709 12:20:52.122192  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:20:52.069149  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 109569us
I20260709 12:20:52.058919  5032 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.105060  3994 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.135663  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.138890  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.151468  4576 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:52.118634  3999 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:20:52.119571  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 152045us
I20260709 12:20:52.155467  3995 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.155781  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:52.113509  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.161633  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.120823  5073 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.163014  5073 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.163527  4581 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.164647  5080 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.165681  5080 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.166594  5080 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.166903  5080 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.167622  5052 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.168030  5052 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.168896  5052 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.170053  5052 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.159916  5001 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.174081  5001 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.174446  5001 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.178045  5034 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:52.179344  5034 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.179733  5034 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:52.180598  5034 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.181921  5034 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.184898  5083 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.163544  5073 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:20:52.187238  5073 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.190888  5032 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:52.194149  5067 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:52.195399  5080 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.196980  5051 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.197337  5080 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.194801  5032 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.204167  5032 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:52.205119  5032 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.206562  5032 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:52.212675  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.215555  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.224215  4576 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.229805  5006 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:52.232107  3999 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.235185  5068 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.235723  5068 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.236758  5068 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.238116  5068 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.197374  5051 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.195299  5067 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.241876  5051 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:52.251612  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.248747  5067 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.254467  5067 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.255694  5067 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.257181  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:52.258177  3846 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:52.273984  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:20:52.285908  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.287422  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 131741us
I20260709 12:20:52.288424  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.291603  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.287124  5032 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.293169  5051 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.293421  5032 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:52.291349  5036 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.294476  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.287376  5078 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.295326  5036 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.295771  5078 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.296288  5036 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.296945  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:52.297937  5083 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.298384  5078 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.298631  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.294540  5032 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.299866  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:52.300143  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.300283  5001 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.300617  3846 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:52.301244  5086 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.301405  3889 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:52.302222  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:52.303108  5084 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.303026  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.300681  5042 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.303831  5086 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.304394  5086 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.304665  5042 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.304786  5086 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.303860  5084 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:52.306385  5084 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.307334  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.309178  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.310309  5083 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.311196  5083 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.312172  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.313356  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.315028  4581 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:52.318287  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:52.319808  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.321412  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.322489  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:52.323678  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51915.2us
W20260709 12:20:52.324503  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51245us
I20260709 12:20:52.323845  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:52.334416  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.336360  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:52.337347  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 96684us
I20260709 12:20:52.342845  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.344162  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.348342  4860 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.348757  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.354918  4581 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.332962  5085 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.338996  5045 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.361774  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:52.366504  3844 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.327698  5062 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:20:52.350492  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.338747  5080 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:20:52.379719  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.384016  5062 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.384608  5062 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.385744  5062 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.353762  4994 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:20:52.390496  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.360663  5066 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:20:52.396343  5062 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.393805  3918 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.352380  5082 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:20:52.404667  5052 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.370059  4997 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:20:52.420213  5052 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.421083  5082 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.421435  5082 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.421363  5052 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.422415  5082 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.413141  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.424047  3844 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:52.424787  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.428298  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:52.431910  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 87470.2us
I20260709 12:20:52.432413  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:52.428898  3842 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.433421  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.435086  5052 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:52.436713  5089 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260709 12:20:52.431985  5032 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.431720  5082 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.441200  5042 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.443243  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.444682  5042 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.431697  5001 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.420240  5080 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.448206  3745 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.449292  5080 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.450276  5080 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.428819  5084 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.459771  4860 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.460417  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.459929  3747 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.464785  4977 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.466569  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:52.466739  5095 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:20:52.470702  5034 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.461621  5086 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.474226  5086 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.474387  3917 raft_consensus.cc:2368] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:20:52.476564  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:52.477303  3846 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.478116  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:52.478749  4580 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.485476  3815 leader_election.cc:400] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:20:52.485891  3815 leader_election.cc:403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:52.486660  5052 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:20:52.493045  5068 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.484033  5080 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.500687  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.508101  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.509806  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.520430  5091 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.527621  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.529464  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.498461  5068 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.512526  4994 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.521070  5045 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.516263  5003 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.531816  5091 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.535678  5001 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.552258  4860 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:52.554050  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.553982  4860 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.512756  5034 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.560760  3917 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:52.561358  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.547544  4994 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:52.564815  5003 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.572800  5006 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.573385  5006 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.565238  5063 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:20:52.576197  3842 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.577549  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.578541  5001 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.562078  5004 consensus_queue.cc:1059] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:52.564059  3745 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.581215  5001 raft_consensus.cc:3055] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.581736  5001 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:52.582098  4580 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:20:52.581987  3748 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.582995  3846 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:20:52.582669  5001 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.584223  5001 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.585983  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:20:52.588987  5086 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.589632  5086 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:52.589855  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.590519  3917 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:52.591161  4977 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.590631  5086 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.591404  5073 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:52.591712  4977 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.593794  4977 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.595786  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:52.588918  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.600353  5067 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:20:52.601496  5006 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:52.576985  4994 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.617308  4580 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:52.612998  5068 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.610517  4977 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.616382  5099 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:20:52.610812  5082 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.624488  5082 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.624900  5082 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.627163  5004 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:52.628346  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.630041  5084 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.632946  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.635998  5084 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.637826  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:52.638526  4581 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.640719  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.641434  4576 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:52.643116  4994 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.643471  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.645088  5084 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.643781  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.645754  3917 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:52.656908  5068 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.659085  4581 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:52.660547  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:52.662317  5003 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:52.660295  4977 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:52.662843  5003 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.675181  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:52.676051  3999 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:52.676131  3991 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.677380  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.678167  3992 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:52.679056  5091 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.695844  5003 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:52.706605  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.700290  5091 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.715050  5091 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.727608  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.731535  3996 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.732632  4582 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:52.734125  5086 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:52.734637  5086 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.736989  5086 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:52.737581  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:52.738327  3846 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:52.739847  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:52.751613  5084 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:52.751832  5075 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:52.752108  5084 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:52.753013  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:52.733165  3748 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.766763  5048 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.776021  5048 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.776678  3995 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.778195  5048 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:52.778460  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:52.776372  3990 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.779579  3996 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:52.780714  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:52.781317  4581 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:52.764652  5032 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.759274  5084 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.791601  4581 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.794639  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.791720  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:52.764575  5081 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.795239  3920 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:52.789418  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.762292  5042 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:20:52.762228  5075 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.803777  5045 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.800834  5032 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:20:52.811257  5004 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:52.809680  5085 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:20:52.824781  5045 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.812837  5081 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.825605  5048 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:52.853214  5086 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:20:52.853847  5045 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:52.865839  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64382.2us
I20260709 12:20:52.851779  5113 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:20:52.870465  5075 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:52.848371  5004 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.927255  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:52.928090  3925 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:52.858759  5048 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.926455  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:52.931344  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.929912  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:52.940297  4860 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.928107  3996 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.946365  5052 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.947037  5052 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.947659  5066 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:52.948132  5066 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:52.948258  4994 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.948562  5066 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.948798  4994 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.951468  5082 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:52.956322  5091 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:52.942010  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:53.000972  5105 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.187s	user 0.004s	sys 0.000s
I20260709 12:20:53.007535  5048 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.008255  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.009009  3842 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:53.011102  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.012356  5081 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.012714  5034 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:53.013130  5034 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.013463  5034 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:53.014251  5108 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:20:53.015563  5083 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.015988  5083 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:53.012717  5004 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.016973  5083 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.019796  3990 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:53.025332  5034 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.026276  4994 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.032073  5073 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:53.034009  5073 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.034976  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:53.035385  5034 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.036420  5073 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.037009  5073 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.037554  5073 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.040216  5045 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.041931  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.042779  3843 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:53.052227  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.066975  5099 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.052120  4977 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52848 (request call id 73) took 2060 ms. Trace:
I20260709 12:20:53.060613  3846 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:53.088320  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.089154  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.089377  3917 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.089800  3920 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.089800  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.092407  3922 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.085988  5099 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:53.099501  5099 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.075240  5084 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.104051  5084 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.107293  3962 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.075965  5091 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:53.114357  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.103015  5073 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.116060  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.112816  5081 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.122378  5082 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.125015  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:53.125767  3921 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.125622  5081 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.127588  5001 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:53.128064  5001 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.128489  5001 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.128575  5081 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.130739  5006 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.122445  3846 raft_consensus.cc:2410] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:53.091408  5075 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.133682  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.131315  5006 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.134943  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.142944  4581 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.143711  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.136452  5006 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.146178  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.147073  3918 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.133275  5075 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.148597  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.148789  3921 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.149535  5075 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.137653  5067 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.152061  5067 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.152426  5067 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.152712  4580 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:53.153484  5083 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.151631  4994 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.157730  4581 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:53.157363  4994 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.159353  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.159595  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:53.160000  4994 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.160349  3921 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.158118  5078 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:20:53.163717  5073 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.167531  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.169401  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.172441  5082 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.173077  5082 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.173559  5082 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.171236  5075 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.181870  5073 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:53.182602  5052 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.187445  5119 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.189070  5119 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.174549  5075 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:53.191414  5119 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.192277  5075 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.194546  5045 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:53.183423  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 244577us
I20260709 12:20:53.201640  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.202481  3920 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.202450  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:53.084826  4977 rpcz_store.cc:276] 0709 12:20:50.987879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.128992 (+141113us) service_pool.cc:224] Handling call
0709 12:20:51.259838 (+130846us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fba0a 00007fdc512fb693 00007fdc512fb631 00007fdc52a2e902 00007fdc52a2e6dd 00007fdc529f9f3f 00007fdc529f96b3 00007fdc529f19fa 00007fdc579b94c9 00007fdc50f35c54
0709 12:20:51.291744 (+ 31906us) log.cc:844] Serialized 494 byte log entry
0709 12:20:53.047013 (+1755269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1711,"raft.run_cpu_time_us":1483,"raft.run_wall_time_us":1483,"spinlock_wait_cycles":11105664,"thread_start_us":52664,"threads_started":1,"wal-append.queue_time_us":55047,"wal-append.run_cpu_time_us":2151,"wal-append.run_wall_time_us":1002244}
I20260709 12:20:53.203096  3924 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.203934  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:53.204201  4578 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:53.204530  4576 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.206574  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:53.207613  3917 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.193710  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.211050  5109 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:20:53.223572  5115 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:53.223672  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:20:53.224514  3990 raft_consensus.cc:606] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:53.224231  5115 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.226627  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.227005  5115 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.227579  3918 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.228122  5003 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.228394  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:53.228679  5003 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.230809  5003 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.229038  4578 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.237000  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:20:53.237751  3990 raft_consensus.cc:606] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Received request to transfer leadership to TS 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:53.238222  3990 raft_consensus.cc:614] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:53.238960  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:53.239625  3925 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.239797  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:53.242009  5107 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.381s	user 0.000s	sys 0.002s
I20260709 12:20:53.241827  4994 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.246043  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:53.246891  3917 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.251823  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:53.252523  3924 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:53.259608  3842 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:53.255306  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:53.270062  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.270200  4860 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:53.273830  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.274005  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.221535  5045 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.274700  3992 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.279009  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.279632  3992 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:53.280411  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.280972  3992 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.274539  3999 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.280807  3844 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:53.275492  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.282451  3991 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.291672  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.291878  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.292946  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.298718  5006 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.183584  5113 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:20:53.260939  5051 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.301911  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.305241  5115 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:53.306036  5115 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:53.307349  5115 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.309461  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.316501  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.317821  5001 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.320477  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.321334  3996 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:53.321508  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:20:53.322042  3998 raft_consensus.cc:606] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Received request to transfer leadership to TS 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:20:53.319605  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:53.319357  5051 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.345562  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:53.323544  5066 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.348434  5066 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.349431  3844 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:53.322654  5001 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.341351  3925 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:53.357817  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:53.370370  3846 raft_consensus.cc:2368] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:53.366055  4994 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.314214  5045 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.409119  5121 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.415792  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:20:53.416286  4576 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:53.416147  5121 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.416764  3997 raft_consensus.cc:606] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:53.412014  4578 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:20:53.418707  5121 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.398340  5080 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:53.419411  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.420086  5080 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.423487  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:20:53.424003  5080 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:53.424171  3997 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:53.408860  5056 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.359668  5085 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:53.424937  5056 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:53.519752  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 159488us
I20260709 12:20:53.557943  5128 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:53.558866  5128 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.562036  5128 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.562721  5123 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.563315  5123 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.566963  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.567888  3850 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:53.577520  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.440987  5056 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.575932  5123 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.596746  5042 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.597666  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:53.587248  3990 raft_consensus.cc:2393] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:53.604274  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:53.523624  5082 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.599855  5042 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:20:53.613830  5056 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.611073  5003 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.615373  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7abd4286feba432697849b5bcf582f63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:53.627707  3843 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:53.595918  5067 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.614408  5001 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:20:53.622973  5006 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.627103  5056 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.653465  5056 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.638202  5129 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.640887  5051 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:53.662421  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 54622.3us
W20260709 12:20:53.663115  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49283.2us
I20260709 12:20:53.634891  5003 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:53.648965  3847 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:53.641242  5080 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.652164  5042 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.646813  5111 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.672122  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:53.676007  5120 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.681406  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.681995  3921 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.682334  3996 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:53.683809  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.686321  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.687077  3997 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.687235  5111 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.693369  5111 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.698742  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.700152  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.700744  3999 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.701578  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:53.704303  3992 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:53.705509  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.706245  3992 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.711620  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.711848  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:53.712360  3993 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:53.715138  5004 raft_consensus.cc:993] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 328b0b7296c545ff8ea6f7c70f93f2c5 to start an election
I20260709 12:20:53.697762  5120 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:53.715677  5004 raft_consensus.cc:1081] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Signalling peer 328b0b7296c545ff8ea6f7c70f93f2c5 to start an election
I20260709 12:20:53.716096  5120 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.674849  5045 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:53.733824  5055 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.490s	user 0.005s	sys 0.005s
I20260709 12:20:53.736817  5067 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.674254  5080 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.773736  5132 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.774462  5132 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.776670  5132 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.777266  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:53.777791  5082 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.778303  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.781970  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.782505  3999 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.783032  3996 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.669560  5129 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.789456  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.791616  4997 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.792228  4997 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.795096  5123 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:53.791324  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.771265  5121 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.794633  4997 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:53.809494  5006 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.810303  5006 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:53.797048  5109 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:53.795138  5075 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.832870  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:53.835208  3999 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:53.839445  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 62294.7us
I20260709 12:20:53.785439  5003 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.828948  5075 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.829994  5066 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.845165  5083 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260709 12:20:53.815692  5121 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.830716  5109 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.841275  4580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18"
dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
 from {username='slave'} at 127.0.0.1:35180
I20260709 12:20:53.861909  4580 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:53.862347  4580 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.844101  5075 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.865115  3996 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.867774  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.851042  5133 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.859277  3997 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.850371  5066 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.883531  3999 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:53.870951  4997 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.892870  4997 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:53.893791  4997 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.895000  5082 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:53.895720  5082 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.892002  5078 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:53.881361  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.876493  5133 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.904657  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:53.859568  5006 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.890151  5086 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.921526  3999 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:53.925956  4580 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.931044  5082 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.931708  5082 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.933715  4580 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.920249  4994 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.921448  5133 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.920282  5051 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:53.935540  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 90218.6us
I20260709 12:20:53.926759  5143 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.919838  5078 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.923578  5067 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.927610  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:53.925935  5086 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.940017  5129 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:53.946880  5051 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:53.923377  5111 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.938803  4994 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.946599  5143 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:53.980767  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.981743  3843 raft_consensus.cc:2410] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:20:53.964184  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:53.991755  5111 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:53.991333  5051 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:53.995582  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:53.996344  3843 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:53.996202  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:53.996935  3848 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.998282  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.002027  5034 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.008033  5066 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:54.006439  5034 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.003377  3845 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.003424  5111 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:54.010588  5122 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.700s	user 0.005s	sys 0.003s
I20260709 12:20:53.989400  5143 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.010963  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:54.009223  4994 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.021631  3921 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:54.014585  5111 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.035849  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.036569  3999 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:54.029253  5111 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.026466  5121 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:54.064849  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:54.065733  3999 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.066190  3999 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:54.068394  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:54.069154  3998 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.070256  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.071077  3994 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:54.042325  5109 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.067065  3999 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.054279  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.036458  5056 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.083909  3999 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.055713  5121 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.075591  5129 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.090610  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:54.091434  3924 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.062994  5147 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:20:54.087157  5124 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 12:20:54.084690  5078 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.103363  3998 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:20:54.119328  3999 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:54.120062  3924 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:54.123682  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:54.124531  4581 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:54.096401  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.090308  5121 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:54.141386  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.096848  5129 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.130625  5034 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:54.140067  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 213361us
W20260709 12:20:54.146147  5146 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260709 12:20:54.139793  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:54.142483  3996 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:54.164409  4994 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.165012  4994 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.139568  5067 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:54.131070  5147 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.185519  5158 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.189522  5075 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.192471  5147 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.193703  5075 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.194343  5075 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.195386  5062 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.197057  5129 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.159384  4997 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.174846  4994 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.269454  5067 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:54.367228  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 216672us
I20260709 12:20:54.433269  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:54.182302  5034 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.197373  5062 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.186327  5158 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.248368  3848 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:20:54.194911  5075 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.200934  5056 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.451141  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1210) took 1258 ms. Trace:
I20260709 12:20:54.451727  3846 rpcz_store.cc:276] 0709 12:20:53.193154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.193319 (+   165us) service_pool.cc:224] Handling call
0709 12:20:54.450822 (+1257503us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400407c54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:54.451025 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264542592}
I20260709 12:20:54.452384  5062 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:54.195333  5157 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:54.435004  3815 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:54.434336  4997 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.449429  5162 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.450237  5034 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.450853  5075 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.462561  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.467510  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 186) took 1410 ms. Trace:
I20260709 12:20:54.468017  3747 rpcz_store.cc:276] 0709 12:20:53.057623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.057764 (+   141us) service_pool.cc:224] Handling call
0709 12:20:53.196123 (+138359us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:54.467399 (+1271276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50851,"reported_tablets":1,"spinlock_wait_cycles":25531136}
I20260709 12:20:54.473554  3748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 194) took 1260 ms. Trace:
I20260709 12:20:54.483808  3748 rpcz_store.cc:276] 0709 12:20:53.213059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.220992 (+  7933us) service_pool.cc:224] Handling call
0709 12:20:54.473452 (+1252460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1210476,"reported_tablets":1}
I20260709 12:20:54.478761  5062 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:54.484967  5075 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.485577  5075 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.478814  5162 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:54.479571  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 209) took 1676 ms. Trace:
I20260709 12:20:54.479660  5056 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:54.464031  5151 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.337s	user 0.004s	sys 0.008s
I20260709 12:20:54.511863  4860 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.512458  4860 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.510557  5056 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.514688  5056 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.515338  4860 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.515383  5080 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.527555  5080 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.527645  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 499) took 1238 ms. Trace:
I20260709 12:20:54.538053  3995 rpcz_store.cc:276] 0709 12:20:53.288946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.316499 (+ 27553us) service_pool.cc:224] Handling call
0709 12:20:53.727554 (+411055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.785226 (+ 57672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.789706 (+  4480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.831657 (+ 41951us) log.cc:844] Serialized 26 byte log entry
0709 12:20:53.884960 (+ 53303us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:53.888618 (+  3658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.888726 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.220871 (+332145us) raft_consensus.cc:1685] finished
0709 12:20:54.220903 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.516433 (+295530us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400414bd0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:54.527548 (+ 11115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4661,"raft.queue_time_us":36907,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":14061,"spinlock_wait_cycles":940219648,"thread_start_us":34646,"threads_started":1,"wal-append.queue_time_us":94211}
I20260709 12:20:54.540791  5062 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.528313  5091 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.541487  5062 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.542003  5091 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.542701  5056 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.528283  5080 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.544327  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 508) took 1294 ms. Trace:
I20260709 12:20:54.544736  3849 rpcz_store.cc:276] 0709 12:20:53.249568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.256062 (+  6494us) service_pool.cc:224] Handling call
0709 12:20:54.543543 (+1287481us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:54.543722 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.543906 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.543942 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:54.543996 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:54.544049 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.544115 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.544234 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20266368}
I20260709 12:20:54.532267  4860 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.549760  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.488204  5162 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.571746  4860 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:54.580978  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 432016us
I20260709 12:20:54.582026  5001 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.534389  5121 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.586982  4860 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.571569  5003 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.488878  3746 rpcz_store.cc:276] 0709 12:20:52.803315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.803738 (+   423us) service_pool.cc:224] Handling call
0709 12:20:54.479498 (+1675760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.241102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.241695 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.241733 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:20:53.241752 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:53.242104 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.242161 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.242188 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:53.242393 (+   205us) tablet.cc:701] Row locks acquired
0709 12:20:53.242410 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:20:53.242552 (+   142us) write_op.cc:270] Start()
0709 12:20:53.242667 (+   115us) write_op.cc:276] Timestamp: P: 1783599653242512 usec, L: 0
0709 12:20:53.242689 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.243344 (+   655us) log.cc:844] Serialized 532 byte log entry
0709 12:20:53.866427 (+623083us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.117178 (+250751us) write_op.cc:301] APPLY: starting
0709 12:20:54.120070 (+  2892us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.129614 (+  9544us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.144258 (+ 14644us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.159141 (+ 14883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.171324 (+ 12183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:54.174469 (+  3145us) write_op.cc:312] APPLY: finished
0709 12:20:54.190565 (+ 16096us) log.cc:844] Serialized 22 byte log entry
0709 12:20:54.224964 (+ 34399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.427222 (+202258us) write_op.cc:454] Released schema lock
0709 12:20:54.432436 (+  5214us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":28786,"reported_tablets":1,"spinlock_wait_cycles":15104,"child_traces":[["op",{"apply.queue_time_us":220824,"apply.run_cpu_time_us":11766,"apply.run_wall_time_us":358225,"num_ops":1,"prepare.queue_time_us":298249,"prepare.run_cpu_time_us":2615,"prepare.run_wall_time_us":20806,"replication_time_us":623564,"thread_start_us":188070,"threads_started":1}]]}
I20260709 12:20:54.582818  5001 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.583660  5062 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.597131  5080 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.600275  5121 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.602654  5158 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.613071  5075 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.615504  5155 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.607304  5003 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.615934  4997 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.616080  5091 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.659364  5160 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.646088  5161 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.649497  5158 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.643750  5121 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.656639  5034 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:54.670641  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:54.676443  3813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.038s
W20260709 12:20:54.680295  3813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.038s
I20260709 12:20:54.681135  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.662920  5155 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:54.681035  5111 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.007s
I20260709 12:20:54.688287  5111 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.689028  5121 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.682991  5075 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.674216  5156 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.691354  5156 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.681517  5034 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.694094  5034 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.694730  5156 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.692375  5111 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.691624  5083 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.669453  5158 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.697202  4578 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:54.675559  3847 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:54.698523  5158 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.698941  5056 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:54.700241  3745 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 1 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:20:54.701848  5083 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.704205  5083 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.695348  5156 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:54.705180  5156 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:20:54.706796  5156 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:54.708973  5159 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.227s	user 0.004s	sys 0.000s
I20260709 12:20:54.710680  5001 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.668469  5161 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.696214  5034 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.671435  5160 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.730062  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.731055  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:20:54.734200  3889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.015s	sys 0.037s
W20260709 12:20:54.734583  3889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.037s
I20260709 12:20:54.691203  5075 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:54.737259  3814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.012s
W20260709 12:20:54.738786  3814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.012s
I20260709 12:20:54.739595  5083 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.740031  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.740213  5083 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.740725  3995 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:54.725345  5068 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.741971  5068 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.742398  5083 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:54.736569  3845 consensus_meta.cc:287] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.716s	user 0.003s	sys 0.010s
I20260709 12:20:54.737071  5062 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.754129  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:54.758893  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:54.759619  3999 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.765786  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.769548  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.770277  3992 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:54.771574  3998 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:54.745424  5083 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.802050  3888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.002s	sys 0.023s
I20260709 12:20:54.745272  5147 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.806097  3888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.003s	sys 0.023s
W20260709 12:20:54.806887  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 801526us
I20260709 12:20:54.807112  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.807752  3992 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:54.816044  3999 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:54.747274  5158 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.805164  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.803813  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.748256  3845 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:54.829330  3848 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:54.831189  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 252783us
W20260709 12:20:54.802305  5133 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.010s
I20260709 12:20:54.833793  3962 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.845355  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.799263  5056 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.864795  3962 leader_election.cc:400] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
W20260709 12:20:54.865177  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 111167us
I20260709 12:20:54.866649  3962 leader_election.cc:403] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.803577  5034 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:20:54.830019  5154 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 12:20:54.867334  5034 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.823473  5001 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:54.825307  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:20:54.827973  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:54.873101  3962 leader_election.cc:400] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:54.876739  3962 leader_election.cc:403] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.772765  5062 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.877689  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:54.822640  5083 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.885241  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:54.891292  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 210228us
I20260709 12:20:54.899940  5156 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.900832  5156 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.901492  5113 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.886540  3996 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.902314  5086 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.902940  5086 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:54.903240  5082 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.903674  5082 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.904055  5082 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.904259  5160 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:54.905414  5166 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:54.905967  5160 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.906371  5160 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.906711  5160 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.906909  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 501) took 1593 ms. Trace:
I20260709 12:20:54.872790  5056 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.868597  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.907307  3991 rpcz_store.cc:276] 0709 12:20:53.313726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.313874 (+   148us) service_pool.cc:224] Handling call
0709 12:20:53.314203 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.345466 (+ 31263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.345505 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.154295 (+808790us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:20:54.154688 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.604317 (+449629us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:54.604376 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.604469 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.906597 (+302128us) raft_consensus.cc:1685] finished
0709 12:20:54.906620 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.906847 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24898,"raft.queue_time_us":34442,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":14506752,"thread_start_us":433582,"threads_started":1,"wal-append.queue_time_us":571657}
I20260709 12:20:54.908960  3847 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:54.877769  5001 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:54.910923  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.912223  3849 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.912626  5155 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.913021  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.913698  5164 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.914032  5001 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:54.914299  5161 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:54.914594  5001 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:54.914278  5164 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.915040  5161 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:54.915278  5001 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:54.822819  5147 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.903028  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.916487  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.872731  5091 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:54.926155  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.965447  3848 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:54.928790  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.966171  3993 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:54.937247  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.844422  5163 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.941618  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.902060  5113 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.870671  5003 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:54.827854  5158 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.952445  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.953500  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.954445  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.872212  5171 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.877084  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.955605  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.956810  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:54.956985  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.918684  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.868654  5170 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.931116  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:54.853736  5133 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:54.888552  5165 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:20:54.974089  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 101124us
I20260709 12:20:54.974880  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:55.025866  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.117377  3844 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:55.117695  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.940841  5178 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:54.955341  5078 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.972901  5052 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.082639  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:55.135349  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 193821us
I20260709 12:20:54.971892  5081 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.123425  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.145805  3842 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:54.956251  4994 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
I20260709 12:20:55.124709  3843 raft_consensus.cc:2368] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:55.022576  3846 raft_consensus.cc:606] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:55.137639  5179 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.151935  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.104698  5163 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.903075  5156 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.137975  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.003059  5169 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.099884  5171 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.016041  5181 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.120591  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 163877us
I20260709 12:20:55.118614  3850 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:54.915660  5161 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.007150  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:54.975858  5086 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.129271  5066 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.178722  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.156554  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:55.160466  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 282916us
I20260709 12:20:54.974454  5155 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.188408  3992 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:55.132678  5170 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:20:55.150058  3997 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:55.144176  5078 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.165613  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.142266  5111 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.136586  3995 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:55.148700  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.143925  5052 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.162909  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.151409  5175 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:55.150207  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:54.977177  5091 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.176441  5188 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.170091  5171 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.151708  3996 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:55.177062  5172 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.169850  5169 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.165036  5034 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.185402  3843 raft_consensus.cc:1813] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Handling vote request from an unknown peer 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:55.188350  5190 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.188901  3889 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:55.189723  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.191030  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:55.192451  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:55.161885  5163 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.195024  4860 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.316404  4860 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.242678  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.318496  3848 raft_consensus.cc:2410] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:55.116459  5165 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.330605  5169 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.272511  5156 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.193627  5067 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.146551  5178 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.198729  4582 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.194880  5083 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.306695  3843 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:55.253973  5066 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:55.265463  5052 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.270853  5195 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.260635  5164 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.274381  5147 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.329250  4860 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.329917  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:55.197587  5155 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.150882  5081 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.197157  5086 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.171729  5179 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.310946  3990 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:55.270413  5111 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.343428  5067 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.362915  3924 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:20:55.366961  5191 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:20:55.372540  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 179614us
I20260709 12:20:55.251053  5181 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.367803  5191 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.379078  5175 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:20:55.360014  5182 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:20:55.401369  3844 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:55.334354  5172 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.413815  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.370154  5067 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.342887  5156 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.344375  5190 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.318050  5188 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.429457  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.432915  4860 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:55.433559  4860 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.410528  5158 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.416525  5164 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.439738  4860 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.440179  5164 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.443228  5164 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.444761  5196 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.412669  5133 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.431324  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.419214  5147 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.415026  5083 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.407768  5194 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.438807  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 250008us
I20260709 12:20:55.438139  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.417094  5113 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.358333  5170 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:55.462522  5082 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.003s
W20260709 12:20:55.477464  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46224.4us
I20260709 12:20:55.445636  5196 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.452759  5165 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.507899  3888 leader_election.cc:400] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:55.509056  3888 leader_election.cc:403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.463912  5129 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.518415  3888 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.520268  4860 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.356771  5195 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.468289  5147 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:55.474807  5161 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.527591  4860 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:55.485276  5203 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.426743  5066 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.514467  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:55.461902  5083 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.464210  5189 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.523702  5129 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.513957  5091 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.532931  5169 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.514658  5082 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.560938  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:20:55.547792  5165 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:55.569007  5186 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:20:55.570663  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.529790  5147 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.560068  5185 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.578665  5181 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.546802  5086 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.592780  5206 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.593490  5208 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.576475  5129 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.594663  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:55.597247  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.614141  3843 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:55.615365  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.617093  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.461711  5194 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.532287  5203 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.608982  5083 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.610369  5155 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:55.611171  5193 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:20:55.537256  5178 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:55.588363  5160 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.006s
I20260709 12:20:55.649739  5160 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.635491  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.638753  5206 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.600116  5111 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.640892  5191 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.590703  5081 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.596837  5147 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.587870  5165 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.644719  3847 raft_consensus.cc:2368] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:55.648113  5190 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.648659  5082 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.633862  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.662798  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.664836  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.689018  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.690339  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.633116  5185 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.692848  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.642239  3921 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:20:55.682783  5206 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.660112  5075 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.697237  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.674140  5165 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.468705  5175 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.732026  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.733592  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.734807  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.735543  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:20:55.645780  5208 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.690883  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.754141  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.757833  5203 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.761262  5208 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:55.587039  5189 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.763885  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 218) took 1636 ms. Trace:
I20260709 12:20:55.695255  5179 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.724031  5156 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:55.772117  5189 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.709717  5172 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.789018  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.789556  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40202 (request call id 0) took 1043 ms. Trace:
I20260709 12:20:55.789953  3846 rpcz_store.cc:276] 0709 12:20:54.746022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.747715 (+  1693us) service_pool.cc:224] Handling call
0709 12:20:55.789328 (+1041613us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54000a5ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529ed853 00007fdc579bb60a 00007fdc50f417d4 00007fdc50f41762 00007fdc50f41691 00007fdc50f4160c 00007fdc50f408c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:55.789437 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306813824}
I20260709 12:20:55.790534  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.792275  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.793292  3847 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:55.767637  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.796362  3843 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:20:55.797634  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:55.764540  4578 rpcz_store.cc:276] 0709 12:20:54.127545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.129378 (+  1833us) service_pool.cc:224] Handling call
0709 12:20:55.763507 (+1634129us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540060fed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:55.763745 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233715584}
I20260709 12:20:55.765117  5207 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.820998  5207 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.821501  5207 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.811097  3843 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:55.791325  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:55.833811  5078 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.836954  5068 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.843147  5160 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.741508  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:55.866109  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:55.866562  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 203861us
W20260709 12:20:55.891993  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 1.81794e+06us
I20260709 12:20:55.864362  5006 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.900364  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102819us
I20260709 12:20:55.905396  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:55.908727  3815 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.523s (SENT) [suppressed 6 similar messages]
W20260709 12:20:55.911405  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 442341us
I20260709 12:20:55.917332  5152 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:55.891516  5196 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.864432  5042 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.923322  3962 leader_election.cc:400] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:55.923741  3962 leader_election.cc:403] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.923062  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:55.899489  5115 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.899983  5113 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.899364  5203 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:55.928900  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:55.930467  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:55.930820  4583 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:55.903528  5189 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.929190  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:55.915019  5206 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.906271  5185 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:55.914582  5051 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.913312  5081 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.906095  5006 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.961166  5204 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.962103  5210 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:55.920429  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1231) took 1169 ms. Trace:
W20260709 12:20:55.958850  4582 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 12:20:55.965412  3962 leader_election.cc:400] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:55.960114  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:55.970295  3962 leader_election.cc:403] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.970641  4581 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:55.899412  5128 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:20:55.933564  5115 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.932300  5111 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.955608  5203 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:55.955240  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:55.959291  5206 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.979167  5170 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.973675  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:55.963476  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 237380us
I20260709 12:20:55.965034  5062 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:55.964988  5051 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.989955  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:56.002918  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:56.004140  3844 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:55.925527  5156 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:20:55.969389  5081 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:55.986550  5203 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:55.958982  5113 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.020188  4860 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.021286  4860 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:55.972581  5210 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:55.980026  5115 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:56.010767  5052 consensus_meta.cc:287] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.002s
I20260709 12:20:55.971597  4582 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:56.010057  5051 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:56.024924  5205 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.987121  5206 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.025907  5062 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:20:56.028554  5211 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:55.987663  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:56.010010  5083 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.969717  5189 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:55.968655  5213 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:56.010490  4578 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:56.044238  4860 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:55.986040  5111 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.098111  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:55.983573  5204 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.078634  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:56.051123  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 221) took 1096 ms. Trace:
I20260709 12:20:56.082425  5062 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.037201  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:56.094064  3850 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:56.051304  5152 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:55.969535  3849 rpcz_store.cc:276] 0709 12:20:54.751050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.752147 (+  1097us) service_pool.cc:224] Handling call
0709 12:20:54.829051 (+ 76904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:54.912641 (+ 83590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.891890 (+979249us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b5400408654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:55.913566 (+ 21676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190347648}
I20260709 12:20:56.031394  5210 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:56.137046  5152 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.148008  4580 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:20:56.034745  5052 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.151417  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:56.135530  5163 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 12:20:56.087239  5205 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.088024  5083 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.132987  5081 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:56.239081  3889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.030s	sys 0.052s
I20260709 12:20:56.222507  3841 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:20:56.551762  3889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.038s	sys 0.066s
W20260709 12:20:56.301954  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 435658us
W20260709 12:20:56.552143  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 1.08541e+06us
I20260709 12:20:56.554098  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:56.554953  3924 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:56.554728  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:56.555516  3991 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:56.556238  3990 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:56.558729  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:56.558881  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:56.239267  5162 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.032s	sys 0.043s
I20260709 12:20:56.565761  3991 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:56.584427  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:56.585913  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:56.228864  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 296527us
W20260709 12:20:56.494645  5207 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.007s
W20260709 12:20:56.353003  5176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.022s	sys 0.029s
W20260709 12:20:56.543087  5165 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
W20260709 12:20:56.331843  4549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.080s	sys 0.105s
W20260709 12:20:56.387717  5169 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.007s
W20260709 12:20:56.381712  5214 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:20:56.674469  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:56.386703  5171 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.076s	user 0.007s	sys 0.004s
W20260709 12:20:56.405194  5147 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.001s
I20260709 12:20:56.142426  5006 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:56.398942  5111 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:56.407837  5152 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:56.222776  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:20:56.869824  3962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.040s	sys 0.075s
W20260709 12:20:57.030719  3962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.048s	sys 0.117s
W20260709 12:20:57.031158  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 973121us
W20260709 12:20:56.613631  5129 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.971s	user 0.015s	sys 0.005s
I20260709 12:20:56.204201  5198 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:56.134720  4582 rpcz_store.cc:276] 0709 12:20:54.940911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.962955 (+ 22044us) service_pool.cc:224] Handling call
0709 12:20:56.036856 (+1073901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:56.625017  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:56.674930  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:57.052745  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 377887us
I20260709 12:20:56.736400  3992 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:56.307593  5003 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:57.056476  5003 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:57.057577  5210 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.006s
I20260709 12:20:57.058038  5210 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.308296  5201 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.059806  5201 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.851626  5052 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:56.255587  5034 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:56.714751  4860 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:20:56.613981  3847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.002s	sys 0.024s
W20260709 12:20:57.061784  3847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.005s	sys 0.031s
I20260709 12:20:57.061596  5034 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.062656  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 531) took 1521 ms. Trace:
I20260709 12:20:57.062981  5215 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:56.397931  5062 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:56.220803  5195 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:56.400511  5113 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:56.563052  5067 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.132s	user 0.016s	sys 0.004s
I20260709 12:20:57.063823  5034 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:56.748317  5203 consensus_meta.cc:287] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 12:20:57.028376  3844 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.064397  5034 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:56.769399  5206 consensus_meta.cc:287] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.005s
I20260709 12:20:57.064729  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1260) took 1050 ms. Trace:
I20260709 12:20:57.064455  5203 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:56.715023  5042 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.065474  5042 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.066339  5152 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:57.066668  5203 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.066871  5152 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:56.972539  5147 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.064110  5067 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.067878  5152 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.068923  5147 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.069103  5067 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:56.970969  5171 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:56.970036  4549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.086s	sys 0.110s
W20260709 12:20:56.938860  5051 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.000s
W20260709 12:20:56.729300  3815 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.041s	sys 0.114s
W20260709 12:20:57.086113  3815 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.071s	sys 0.179s
W20260709 12:20:57.086469  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.17771e+06us
W20260709 12:20:56.970422  5176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.022s	sys 0.041s
I20260709 12:20:56.969465  5169 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:56.971253  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:20:56.605473  5162 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.038s	sys 0.060s
I20260709 12:20:56.330933  5185 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:57.059329  5003 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.091709  4577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 249) took 1162 ms. Trace:
I20260709 12:20:57.065018  5206 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.092247  5185 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.092267  4577 rpcz_store.cc:276] 0709 12:20:55.929151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.932691 (+  3540us) service_pool.cc:224] Handling call
0709 12:20:56.970981 (+1038290us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:57.091624 (+120643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3685248}
W20260709 12:20:57.025148  5213 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.003s
W20260709 12:20:56.952222  5115 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.002s
I20260709 12:20:57.060708  5210 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.061615  4860 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.028764  4580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 248) took 1099 ms. Trace:
I20260709 12:20:56.332647  4997 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:57.065152  3844 rpcz_store.cc:276] 0709 12:20:56.014227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.023172 (+  8945us) service_pool.cc:224] Handling call
0709 12:20:56.969495 (+946323us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:57.027292 (+ 57797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.064449 (+ 37157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.064658 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18064640}
I20260709 12:20:57.028014  5165 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.026165  5207 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:56.166659  4579 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:56.925093  5189 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:56.846892  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:57.082530  3924 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:56.730252  5128 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.248s
I20260709 12:20:56.943730  5204 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:57.073129  5170 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.062s	user 0.009s	sys 0.004s
I20260709 12:20:57.094790  5185 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:56.645550  5163 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.048768  5111 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:57.113894  3842 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
W20260709 12:20:57.039547  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 834322us
I20260709 12:20:57.095870  5198 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.117053  4580 rpcz_store.cc:276] 0709 12:20:55.928835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.930104 (+  1269us) service_pool.cc:224] Handling call
0709 12:20:57.028577 (+1098473us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54005c03d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:57.028696 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491825408}
I20260709 12:20:57.132488  5199 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:57.064944  5034 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.111434  5213 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:57.073431  5129 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.113332  5067 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.086136  5051 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.138958  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.141337  4860 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.117280  5083 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.063645  5215 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.118801  5203 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:57.097114  5206 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.134686  5042 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.169492  5111 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.189653  3848 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:57.182118  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:57.170989  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:57.145838  5210 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:57.219810  5210 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.203433  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:57.221664  3994 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:57.177338  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 145411us
I20260709 12:20:57.206327  5225 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.205828  3999 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:57.131769  4997 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.230029  4997 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.228184  5111 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:57.230787  5218 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:20:57.231431  5228 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.236928  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.237808  3920 raft_consensus.cc:2368] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:57.238179  5111 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.238922  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.240199  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:57.231979  5228 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.146486  5170 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:57.113873  5115 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:57.212834  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 99576.9us
I20260709 12:20:57.203291  5199 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:57.266391  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:20:57.323737  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 57430.8us
I20260709 12:20:57.325130  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:20:57.205811  3924 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:57.327143  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:57.225175  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:57.330824  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 105772us
I20260709 12:20:57.224386  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:57.207403  5067 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.216965  5062 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:57.186411  5198 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.145224  5205 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.226974  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:57.332216  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:57.335431  3841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 524) took 2503 ms (client timeout 2275 ms). Trace:
I20260709 12:20:57.260851  3920 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:57.213383  5203 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:57.474893  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.544430  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 212276us
I20260709 12:20:57.266705  3994 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:20:57.337455  5006 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:57.505515  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 88821.8us
W20260709 12:20:57.546803  3841 rpcz_store.cc:269] 0709 12:20:54.819591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.819730 (+   139us) service_pool.cc:224] Handling call
0709 12:20:54.953367 (+133637us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:57.322759 (+2369392us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400409554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:57.322899 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541844096}
W20260709 12:20:57.545840  3815 connection.cc:256] RPC call timeout handler was delayed by -1.40332364100027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:20:57.561667  3815 connection.cc:256] RPC call timeout handler was delayed by -1.3739645250000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 12:20:57.562831  3815 connection.cc:256] RPC call timeout handler was delayed by -1.2440656780001973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:20:57.563249  3815 connection.cc:256] RPC call timeout handler was delayed by -1.2278165870000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:20:57.397302  3917 raft_consensus.cc:2368] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
W20260709 12:20:57.542200  5233 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:20:57.594913  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.596237  3919 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
W20260709 12:20:57.596653  3815 connection.cc:256] RPC call timeout handler was delayed by -1.2089220850000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:20:57.597432  3815 connection.cc:256] RPC call timeout handler was delayed by -1.1633645250001337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:20:57.348256  5223 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:20:57.607425  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:57.610694  4860 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.575582  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:57.614897  3920 raft_consensus.cc:2368] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:57.351982  5210 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.337805  5213 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:57.561208  5006 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:57.345398  5128 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:57.336035  5081 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:57.616163  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.431928  4576 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:57.611485  4860 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.345918  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:57.608220  3844 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:20:57.354609  5034 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.547842  5194 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.356215  5171 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.345920  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:57.526299  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:57.564945  5231 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:20:57.268318  5225 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:58.362967  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:57.709925  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:57.560462  5185 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:57.870232  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.368837  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:20:57.924894  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 48) took 3030 ms (client timeout 3002 ms). Trace:
I20260709 12:20:57.563674  5206 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:57.641016  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:58.376878  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1210) took 1286 ms. Trace:
I20260709 12:20:58.364799  3923 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
W20260709 12:20:58.365163  3963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.020s
I20260709 12:20:57.923815  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:58.363199  3924 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:58.237735  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68263.8us
W20260709 12:20:57.998543  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.906119  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1185) took 1289 ms. Trace:
I20260709 12:20:57.063060  3847 rpcz_store.cc:276] 0709 12:20:55.540809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.793886 (+253077us) service_pool.cc:224] Handling call
0709 12:20:55.794234 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.794464 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:55.794840 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.062273 (+1267433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.062333 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:57.062383 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.062465 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.062597 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":180,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1592,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1266919,"threads_started":1,"wal-append.queue_time_us":1347135}
I20260709 12:20:58.369647  4580 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:20:58.009948  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:58.373442  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:58.305971  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:58.274923  3842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1244) took 3129 ms (client timeout 2020 ms). Trace:
I20260709 12:20:58.364238  3920 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:58.364598  3916 raft_consensus.cc:2955] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:20:58.562770  4546 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.007s
I20260709 12:20:57.870715  5203 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:58.767377  4546 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.004s	sys 0.016s
I20260709 12:20:58.512827  4574 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:20:58.500689  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.022s	sys 0.039s
W20260709 12:20:58.767939  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 870506us
I20260709 12:20:58.768098  5248 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.768879  3991 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:20:58.767107  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1196) took 1725 ms. Trace:
I20260709 12:20:57.616848  5229 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.773548  4581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 228) took 1443 ms (client timeout 1713 ms). Trace:
I20260709 12:20:58.543346  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1192) took 1518 ms. Trace:
W20260709 12:20:58.369930  3848 rpcz_store.cc:269] 0709 12:20:54.894712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.329668 (+434956us) service_pool.cc:224] Handling call
0709 12:20:57.924601 (+2594933us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54000a55d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:57.924799 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4220304768}
W20260709 12:20:58.766263  3963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.007s	sys 0.043s
I20260709 12:20:58.051163  5152 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:58.772324  3922 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:20:58.773746  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:58.377362  3919 rpcz_store.cc:276] 0709 12:20:57.090446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.617109 (+526663us) service_pool.cc:224] Handling call
0709 12:20:58.376797 (+759688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:58.422164  4583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 229) took 1044 ms. Trace:
I20260709 12:20:58.438829  4860 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:58.770874  4580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 116) took 1446 ms. Trace:
I20260709 12:20:57.621001  5165 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:58.772836  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1373) took 1561 ms (client timeout 1643 ms). Trace:
W20260709 12:20:58.768354  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.024s	sys 0.044s
W20260709 12:20:57.991894  5238 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:20:58.361814  5067 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:59.012599  3922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1194) took 1979 ms (client timeout 1565 ms). Trace:
I20260709 12:20:58.368971  5006 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:59.013351  5067 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:20:57.861018  5056 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.016911  5056 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:59.017827  5056 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:58.274004  4579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 251) took 2318 ms (client timeout 1734 ms). Trace:
W20260709 12:20:58.766031  3842 rpcz_store.cc:269] 0709 12:20:55.145054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.148282 (+  3228us) service_pool.cc:224] Handling call
0709 12:20:58.274654 (+3126372us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540011b2d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:58.274834 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4264236416}
I20260709 12:20:58.984174  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:57.727548  5111 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:58.811383  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:58.993824  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1264) took 1385 ms. Trace:
I20260709 12:20:57.868925  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1186) took 1283 ms. Trace:
I20260709 12:20:58.774343  3921 rpcz_store.cc:276] 0709 12:20:57.025375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.361772 (+1336397us) service_pool.cc:224] Handling call
0709 12:20:58.375729 (+ 13957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.483808 (+108079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.491431 (+  7623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.493839 (+  2408us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:58.502645 (+  8806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.512085 (+  9440us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.543257 (+ 31172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.029338  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 105) took 5022 ms. Trace:
I20260709 12:20:58.770385  3923 rpcz_store.cc:276] 0709 12:20:57.041419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.041602 (+   183us) service_pool.cc:224] Handling call
0709 12:20:57.615995 (+574393us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.766902 (+1150907us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38183680}
I20260709 12:20:58.996152  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.036973  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:58.812145  3920 rpcz_store.cc:269] 0709 12:20:57.211757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.709571 (+497814us) service_pool.cc:224] Handling call
0709 12:20:58.772775 (+1063204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:59.038596  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1368) took 1904 ms (client timeout 1848 ms). Trace:
W20260709 12:20:59.002257  3890 leader_election.cc:336] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Timed out: RequestConsensusVote RPC to 127.2.157.68:38173 timed out after 1.613s (SENT)
I20260709 12:20:59.039779  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:20:59.003618  3889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1200) took 1918 ms. Trace:
I20260709 12:20:58.300653  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1180) took 1746 ms. Trace:
I20260709 12:20:59.040609  3889 rpcz_store.cc:276] 0709 12:20:57.085110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.001901 (+1916791us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:20:59.041421  3889 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items
I20260709 12:20:57.920111  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1434) took 1362 ms. Trace:
W20260709 12:20:58.781771  3991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 64) took 1564 ms (client timeout 1673 ms). Trace:
W20260709 12:20:59.059957  3991 rpcz_store.cc:269] 0709 12:20:57.205812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.218918 (+ 13106us) service_pool.cc:224] Handling call
0709 12:20:57.923597 (+704679us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.769989 (+846392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93869440}
I20260709 12:20:59.008773  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:59.063242  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.063907  3748 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:59.065246  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:58.766119  3917 rpcz_store.cc:276] 0709 12:20:56.582575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.584172 (+  1597us) service_pool.cc:224] Handling call
0709 12:20:57.871298 (+1287126us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540036e7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:57.872148 (+   850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724228992}
I20260709 12:20:59.051255  5052 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:58.924041  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:59.068420  3992 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:58.911094  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:57.920882  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:58.914544  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:59.077811  3997 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:58.902642  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 118) took 1491 ms. Trace:
I20260709 12:20:58.395392  4575 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:59.080175  4575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 117) took 1745 ms (client timeout 1963 ms). Trace:
I20260709 12:20:58.509507  4577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 113) took 1260 ms. Trace:
I20260709 12:20:59.083156  4577 rpcz_store.cc:276] 0709 12:20:57.235263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.236729 (+  1466us) service_pool.cc:224] Handling call
0709 12:20:57.237128 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.237368 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:57.351489 (+114121us) log.cc:844] Serialized 14 byte log entry
0709 12:20:58.369648 (+1018159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.375967 (+  6319us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:58.429768 (+ 53801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.482569 (+ 52801us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.492812 (+ 10243us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622804,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":2412,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":34594,"thread_start_us":346235,"threads_started":2,"wal-append.queue_time_us":555022}
I20260709 12:20:59.085633  5165 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:58.812281  4580 rpcz_store.cc:276] 0709 12:20:57.323989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.324312 (+   323us) service_pool.cc:224] Handling call
0709 12:20:58.368678 (+1044366us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.770810 (+402132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23616384}
I20260709 12:20:59.101872  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:58.811937  4583 rpcz_store.cc:276] 0709 12:20:57.331131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.331266 (+   135us) service_pool.cc:224] Handling call
0709 12:20:58.362811 (+1031545us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.375933 (+ 13122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8170752}
I20260709 12:20:58.919060  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:58.903756  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130102us
I20260709 12:20:59.104863  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:20:57.655575  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 420194us
I20260709 12:20:59.106251  4583 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:58.416947  4576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 111) took 2431 ms (client timeout 1831 ms). Trace:
W20260709 12:20:58.774132  4581 rpcz_store.cc:269] 0709 12:20:57.329714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.329855 (+   141us) service_pool.cc:224] Handling call
0709 12:20:58.009709 (+679854us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.773486 (+763777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11147648}
I20260709 12:20:57.834417  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:59.011206  4997 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:20:59.121981  4582 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
W20260709 12:20:59.122679  4582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 119) took 1522 ms (client timeout 1613 ms). Trace:
I20260709 12:20:59.122303  4997 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:59.123111  4582 rpcz_store.cc:269] 0709 12:20:57.600080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.728033 (+127953us) service_pool.cc:224] Handling call
0709 12:20:59.122594 (+1394561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.124347  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:59.124979  4997 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:57.816898  5051 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.125386  4582 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:20:57.680706  5062 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:58.369354  5081 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:59.127115  4582 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:59.127631  5081 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.639760  5115 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:57.986261  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1257) took 1978 ms. Trace:
I20260709 12:20:58.398648  5128 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:20:59.132507  3845 rpcz_store.cc:276] 0709 12:20:56.004997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.010383 (+  5386us) service_pool.cc:224] Handling call
0709 12:20:57.681021 (+1670638us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:57.745940 (+ 64919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.817804 (+ 71864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.835067 (+ 17263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.872843 (+ 37776us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:57.904449 (+ 31606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.927190 (+ 22741us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.983795 (+ 56605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9862016}
I20260709 12:20:59.136138  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.136586  5128 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:57.770527  5129 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:58.908280  5152 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:59.140872  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:59.142129  3991 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:20:57.661903  5163 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:58.983215  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:59.144099  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:20:58.784456  5170 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.144129  5163 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.145119  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 113361us
I20260709 12:20:59.145388  5163 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:58.977193  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:58.485286  5185 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:20:58.760979  5198 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.415s	user 0.012s	sys 0.002s
I20260709 12:20:59.172158  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:59.173084  5198 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.174808  3993 raft_consensus.cc:2368] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:20:57.996415  5188 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:58.485594  5199 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:59.176193  3964 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.565s (SENT)
I20260709 12:20:58.735332  5201 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:58.907598  5203 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:59.177626  3964 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.583s (SENT)
W20260709 12:20:59.177857  3993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1436) took 2619 ms (client timeout 2206 ms). Trace:
W20260709 12:20:59.178390  3993 rpcz_store.cc:269] 0709 12:20:56.558552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.558670 (+   118us) service_pool.cc:224] Handling call
0709 12:20:59.177514 (+2618844us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400390154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:59.177755 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6013152512}
I20260709 12:20:58.363770  5213 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.179858  5213 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.911514  5215 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:59.183518  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1371) took 1969 ms (client timeout 1872 ms). Trace:
I20260709 12:20:58.982386  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1263) took 1374 ms. Trace:
W20260709 12:20:59.184131  3923 rpcz_store.cc:269] 0709 12:20:57.202337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.161206 (+1958869us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.171287 (+ 10081us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.184289  3846 rpcz_store.cc:276] 0709 12:20:57.607415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.616580 (+  9165us) service_pool.cc:224] Handling call
0709 12:20:58.980619 (+1364039us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:58.981137 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.981712 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.981755 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.981844 (+    89us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:58.981938 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.982029 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.982167 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63301888}
W20260709 12:20:59.185453  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1208) took 2095 ms (client timeout 2020 ms). Trace:
W20260709 12:20:59.185949  3923 rpcz_store.cc:269] 0709 12:20:57.089921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.185235 (+2095314us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.185368 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.186446  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:58.512261  5228 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:58.906132  5225 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:57.617003  5230 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 1.206s
W20260709 12:20:58.498729  5235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.004s	sys 0.011s
W20260709 12:20:59.189881  5235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.006s	sys 0.019s
W20260709 12:20:58.574144  5242 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.522s	user 0.000s	sys 0.000s
I20260709 12:20:59.190680  5198 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:59.019750  4579 rpcz_store.cc:269] 0709 12:20:55.955315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.960632 (+  5317us) service_pool.cc:224] Handling call
0709 12:20:58.273612 (+2312980us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54005ae954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:58.273862 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153409280}
I20260709 12:20:58.768867  5248 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:59.192543  5165 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.191797  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.192919  5185 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.193215  5165 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.194908  5248 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:58.909538  5251 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:59.195637  5165 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.195956  5251 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.021929  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:59.013406  3922 rpcz_store.cc:269] 0709 12:20:57.033088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.033997 (+   909us) service_pool.cc:224] Handling call
0709 12:20:58.305753 (+1271756us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:58.843873 (+538120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24836992}
I20260709 12:20:59.033174  5171 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:20:59.201201  5251 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:59.200989  5171 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.203125  5171 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:20:59.034750  3919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1372) took 1830 ms (client timeout 1775 ms). Trace:
W20260709 12:20:59.039005  3920 rpcz_store.cc:269] 0709 12:20:57.134466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.038243 (+1903777us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.038393 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:20:59.030833  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1378) took 1691 ms (client timeout 1523 ms). Trace:
I20260709 12:20:59.027719  3848 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.014604  5067 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.040886  3925 rpcz_store.cc:276] 0709 12:20:56.553774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.606763 (+ 52989us) service_pool.cc:224] Handling call
0709 12:20:58.299545 (+1692782us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:58.299875 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.300139 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.300181 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.300248 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:58.300295 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.300378 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.300565 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17272064}
I20260709 12:20:59.030943  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 227) took 1701 ms. Trace:
I20260709 12:20:59.067885  5052 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:58.786482  3995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.000s	sys 0.010s
I20260709 12:20:59.067061  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:20:59.080704  4575 rpcz_store.cc:269] 0709 12:20:57.334551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.335603 (+  1052us) service_pool.cc:224] Handling call
0709 12:20:59.079899 (+1744296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.079663  4574 rpcz_store.cc:276] 0709 12:20:57.411412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.525791 (+114379us) service_pool.cc:224] Handling call
0709 12:20:58.830757 (+1304966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.217500  3841 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:59.095180  5056 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.096504  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 7abd4286feba432697849b5bcf582f63 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34144
I20260709 12:20:59.098245  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:59.099428  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 103440us
W20260709 12:20:59.219895  3890 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Timed out: RequestConsensusVote RPC to 127.2.157.68:38173 timed out after 1.831s (SENT)
I20260709 12:20:59.103343  4580 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:20:59.220893  5129 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.028903  3918 rpcz_store.cc:276] 0709 12:20:56.585239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.604249 (+ 19010us) service_pool.cc:224] Handling call
0709 12:20:57.867833 (+1263584us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:57.868137 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.868391 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.868436 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.868502 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:57.868553 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.868642 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.868813 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15909760}
W20260709 12:20:59.107837  4576 rpcz_store.cc:269] 0709 12:20:55.968083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.239906 (+1271823us) service_pool.cc:224] Handling call
0709 12:20:58.398965 (+1159059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.119875  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:59.221768  5129 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:59.222792  4583 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:20:59.120642  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:58.810981  5034 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:20:59.209906  4578 rpcz_store.cc:276] 0709 12:20:57.328947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.333452 (+  4505us) service_pool.cc:224] Handling call
0709 12:20:58.307316 (+973864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.376096 (+ 68780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.394504 (+ 18408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.421708 (+ 27204us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:58.483611 (+ 61903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.491120 (+  7509us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.030434 (+539314us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54005ae950. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:59.030664 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990815616}
I20260709 12:20:59.224170  4581 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:59.121057  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1195) took 2087 ms. Trace:
I20260709 12:20:59.126914  5062 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.028101  3849 rpcz_store.cc:276] 0709 12:20:57.607787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.616465 (+  8678us) service_pool.cc:224] Handling call
0709 12:20:58.987096 (+1370631us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:58.987406 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.993118 (+  5712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.993196 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.993286 (+    90us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:58.993324 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:58.993401 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.993580 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34986368}
I20260709 12:20:59.144523  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:59.145386  5170 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.089854  3990 rpcz_store.cc:276] 0709 12:20:56.557427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.557544 (+   117us) service_pool.cc:224] Handling call
0709 12:20:56.557840 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.062710 (+504870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.062746 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.062789 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:57.062827 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.919680 (+856853us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540016f8d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:57.919765 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.920016 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160592768}
I20260709 12:20:59.041812  3889 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1371)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
I20260709 12:20:59.137506  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.168633  5152 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:59.144518  3843 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.171124  5001 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:59.171159  3917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1209) took 2080 ms (client timeout 1988 ms). Trace:
I20260709 12:20:59.171624  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:20:59.178596  5203 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:57.859282  5207 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:58.812464  5229 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:59.186770  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1199) took 2108 ms (client timeout 2103 ms). Trace:
W20260709 12:20:58.974264  3815 connection.cc:256] RPC call timeout handler was delayed by -1.6280596409999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:20:59.196497  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:59.199775  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 91781.6us
I20260709 12:20:59.200320  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:59.034721  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:59.203745  3919 rpcz_store.cc:269] 0709 12:20:57.203934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.034336 (+1830402us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.034526 (+   190us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.143386  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:20:59.204566  3921 rpcz_store.cc:269] 0709 12:20:57.339025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.030399 (+1691374us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.030592 (+   193us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:20:59.215432  3995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.002s	sys 0.012s
I20260709 12:20:59.093034  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:20:59.411335  3848 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
W20260709 12:20:59.379772  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 281840us
W20260709 12:20:59.420262  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 550) took 1343 ms (client timeout 1664 ms). Trace:
W20260709 12:20:59.379370  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 159569us
I20260709 12:20:59.029884  3745 rpcz_store.cc:276] 0709 12:20:54.007680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.008159 (+   479us) service_pool.cc:224] Handling call
0709 12:20:54.692868 (+684709us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:59.029010 (+4336142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:55.077857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:55.193558 (+115701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:55.199767 (+  6209us) write_op.cc:435] Acquired schema lock
0709 12:20:55.199801 (+    34us) tablet.cc:662] Decoding operations
0709 12:20:55.322857 (+123056us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:55.333233 (+ 10376us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:55.336106 (+  2873us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:55.364968 (+ 28862us) tablet.cc:701] Row locks acquired
0709 12:20:55.370348 (+  5380us) write_op.cc:260] PREPARE: finished
0709 12:20:55.411017 (+ 40669us) write_op.cc:270] Start()
0709 12:20:55.421161 (+ 10144us) write_op.cc:276] Timestamp: P: 1783599655408081 usec, L: 0
0709 12:20:55.422617 (+  1456us) op_driver.cc:348] REPLICATION: starting
0709 12:20:55.514251 (+ 91634us) log.cc:844] Serialized 532 byte log entry
0709 12:20:57.911165 (+2396914us) op_driver.cc:464] REPLICATION: finished
0709 12:20:58.912508 (+1001343us) write_op.cc:301] APPLY: starting
0709 12:20:58.912626 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:58.912758 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:58.912916 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:58.913181 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:58.913391 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:58.913455 (+    64us) write_op.cc:312] APPLY: finished
0709 12:20:58.913717 (+   262us) log.cc:844] Serialized 22 byte log entry
0709 12:20:58.926606 (+ 12889us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.926699 (+    93us) write_op.cc:454] Released schema lock
0709 12:20:58.926740 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:58.927172 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:58.927222 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":148279552,"child_traces":[["op",{"apply.queue_time_us":960527,"apply.run_cpu_time_us":7481,"apply.run_wall_time_us":14631,"num_ops":1,"prepare.queue_time_us":319408,"prepare.run_cpu_time_us":72126,"prepare.run_wall_time_us":2023094,"raft.queue_time_us":494754,"raft.run_cpu_time_us":27045,"raft.run_wall_time_us":737406,"replication_time_us":2393947,"thread_start_us":2354599,"threads_started":6,"wal-append.queue_time_us":1540842,"wal-append.run_cpu_time_us":20620,"wal-append.run_wall_time_us":1557483}]]}
W20260709 12:20:59.424042  3917 rpcz_store.cc:269] 0709 12:20:57.090186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.162019 (+2071833us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.170954 (+  8935us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.267375  3992 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:59.172164  3847 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
W20260709 12:20:59.425870  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 180173us
W20260709 12:20:59.423236  3923 rpcz_store.cc:269] 0709 12:20:57.078169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.186641 (+2108472us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.186729 (+    88us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.421520  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:20:59.420849  3848 rpcz_store.cc:269] 0709 12:20:58.077321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.811075 (+733754us) service_pool.cc:224] Handling call
0709 12:20:59.420155 (+609080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.430475  3997 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:20:59.385969  3964 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.764s (SENT)
I20260709 12:20:59.433627  5171 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.230715  3924 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:59.195950  5163 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.399696  5262 tablet_replica.cc:333] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:20:59.435623  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1269) took 1060 ms. Trace:
I20260709 12:20:59.435348  3842 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:59.419477  3916 rpcz_store.cc:276] 0709 12:20:57.033416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.033560 (+   144us) service_pool.cc:224] Handling call
0709 12:20:58.364090 (+1330530us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:20:58.364282 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.364477 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:59.018613 (+654136us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.111225 (+ 92612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.116700 (+  5475us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:59.120531 (+  3831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.120623 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.120870 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4709,"raft.queue_time_us":29382,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":28137,"spinlock_wait_cycles":64572800,"thread_start_us":62921,"threads_started":1,"wal-append.queue_time_us":238520}
I20260709 12:20:59.380523  5056 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.439733  5171 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:20:59.440562  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1376) took 2179 ms (client timeout 1564 ms). Trace:
I20260709 12:20:59.378959  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.443290  3999 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.444033  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.406744  5081 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:20:59.447825  3924 rpcz_store.cc:269] 0709 12:20:57.261130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.335419 (+ 74289us) service_pool.cc:224] Handling call
0709 12:20:59.440411 (+2104992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.440963  3844 rpcz_store.cc:276] 0709 12:20:58.375678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.034281 (+658603us) service_pool.cc:224] Handling call
0709 12:20:59.435546 (+401265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.202340  3891 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40578 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1382)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1379)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 34)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 38)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 31)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 37)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
I20260709 12:20:59.434968  5001 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.430655  4577 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:59.377491  5129 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:59.436843  3847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 548) took 1360 ms (client timeout 1760 ms). Trace:
I20260709 12:20:59.478559  3994 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:59.486249  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.452968  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:59.224251  5034 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.485301  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:59.489241  3849 raft_consensus.cc:2376] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3. Re-sending same reply.
I20260709 12:20:59.490247  5170 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:59.490394  5034 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:59.492132  3991 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:59.492941  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.386126  5213 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.476392  3850 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:20:59.437043  5052 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.245620  5006 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:59.445420  5056 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:20:59.517242  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40578 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1391)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 34)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 38)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 31)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 37)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
I20260709 12:20:59.503249  3996 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:59.504143  5081 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:59.504379  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:20:59.504741  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1203) took 2416 ms (client timeout 2190 ms). Trace:
I20260709 12:20:59.507540  3888 leader_election.cc:400] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
W20260709 12:20:59.508323  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 122437us
I20260709 12:20:59.508394  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:20:59.533620  3888 leader_election.cc:403] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:59.487129  5067 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.514215  5006 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:20:59.519742  4577 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:59.490432  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.520004  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:20:59.485708  3847 rpcz_store.cc:269] 0709 12:20:58.076732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.976282 (+899550us) service_pool.cc:224] Handling call
0709 12:20:59.434977 (+458695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.520864  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:59.523469  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 549) took 1446 ms. Trace:
I20260709 12:20:59.488618  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:59.532217  3996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1437) took 2972 ms (client timeout 2104 ms). Trace:
W20260709 12:20:59.528869  3921 rpcz_store.cc:269] 0709 12:20:57.088511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.504496 (+2415985us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.504663 (+   167us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.481099  5001 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.509491  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1431) took 2956 ms. Trace:
I20260709 12:20:59.535914  3843 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:20:59.498723  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:20:59.530934  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:59.519874  5185 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.539808  3924 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.539700  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:20:59.540123  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 166363us
I20260709 12:20:59.540648  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:20:59.543309  3919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1377) took 2220 ms (client timeout 2124 ms). Trace:
W20260709 12:20:59.547305  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1382) took 1976 ms (client timeout 1751 ms). Trace:
W20260709 12:20:59.546456  3843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 59) took 1470 ms (client timeout 1774 ms). Trace:
W20260709 12:20:59.547983  3920 rpcz_store.cc:269] 0709 12:20:57.570538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.540821 (+1970283us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.547215 (+  6394us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:20:59.547649  3919 rpcz_store.cc:269] 0709 12:20:57.322811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.537860 (+2215049us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.543237 (+  5377us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.549880  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.533721  5056 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:59.542761  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1367) took 2427 ms (client timeout 2373 ms). Trace:
I20260709 12:20:59.553599  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:20:59.554839  3925 rpcz_store.cc:269] 0709 12:20:57.115856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.536353 (+2420497us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.542631 (+  6278us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.553356  3917 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:59.558692  3845 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:20:59.559340  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.560370  3848 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:20:59.561352  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:20:59.561995  3848 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.563648  5185 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:20:59.538012  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:20:59.565377  4576 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:20:59.566236  5185 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:20:59.564046  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 82077.6us
I20260709 12:20:59.586638  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:59.587718  3925 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:20:59.587754  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:20:59.588418  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1393) took 1302 ms (client timeout 1705 ms). Trace:
W20260709 12:20:59.588822  3925 rpcz_store.cc:269] 0709 12:20:58.285670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.557365 (+1271695us) service_pool.cc:224] Handling call
0709 12:20:59.588301 (+ 30936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.589711  3990 raft_consensus.cc:2368] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:20:59.590025  5165 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:59.541038  5203 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:59.569466  3917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1379) took 2057 ms (client timeout 2111 ms). Trace:
W20260709 12:20:59.591353  3917 rpcz_store.cc:269] 0709 12:20:57.500058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.531129 (+2031071us) service_pool.cc:224] Handling call
0709 12:20:59.557226 (+ 26097us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:59.574126  3918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1206) took 2484 ms (client timeout 2363 ms). Trace:
I20260709 12:20:59.592399  5229 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:20:59.592556  3918 rpcz_store.cc:269] 0709 12:20:57.089360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.571605 (+2482245us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:59.574044 (+  2439us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.574136  5207 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.575112  3924 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:59.575667  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:59.545754  3995 rpcz_store.cc:276] 0709 12:20:56.553488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.553613 (+   125us) service_pool.cc:224] Handling call
0709 12:20:56.553941 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.112637 (+558696us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:20:57.217839 (+105202us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.479182 (+2261343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.483786 (+  4604us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:59.483919 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.509044 (+ 25125us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54002972d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:20:59.509127 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.509367 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220712,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5016,"raft.queue_time_us":782957,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":34472,"spinlock_wait_cycles":1244928384,"thread_start_us":2219135,"threads_started":3,"wal-append.queue_time_us":337409,"wal-append.run_cpu_time_us":1345,"wal-append.run_wall_time_us":1014337}
I20260709 12:20:59.584031  5062 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.585247  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:20:59.566087  3922 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:20:59.590708  5165 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:20:59.544008  3996 rpcz_store.cc:269] 0709 12:20:56.607467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.711942 (+104475us) service_pool.cc:224] Handling call
0709 12:20:57.920709 (+1208767us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:20:59.531108 (+1610399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20224256}
W20260709 12:20:59.596413  3916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1202) took 2468 ms (client timeout 2496 ms). Trace:
W20260709 12:20:59.608656  3916 rpcz_store.cc:269] 0709 12:20:57.088247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.480894 (+2392647us) service_pool.cc:224] Handling call
0709 12:20:59.556666 (+ 75772us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:59.596457  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1385) took 1825 ms (client timeout 1872 ms). Trace:
I20260709 12:20:59.568794  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.521968  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 576) took 1323 ms. Trace:
I20260709 12:21:00.522385  3847 rpcz_store.cc:276] 0709 12:20:59.198880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.568407 (+369527us) service_pool.cc:224] Handling call
0709 12:21:00.521891 (+953484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.588008  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40578 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 34)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 38)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 31)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 37)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
W20260709 12:20:59.615754  3922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1384) took 1942 ms (client timeout 1550 ms). Trace:
W20260709 12:21:00.530112  3922 rpcz_store.cc:269] 0709 12:20:57.659018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.199938 (+1540920us) service_pool.cc:224] Handling call
0709 12:20:59.601316 (+401378us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:59.609797  3924 rpcz_store.cc:269] 0709 12:20:57.771252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.497142 (+1725890us) service_pool.cc:224] Handling call
0709 12:20:59.596375 (+ 99233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:59.799819  5265 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:20:59.714541  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:20:59.808017  5171 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:20:59.838179  5001 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:00.532945  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1401) took 1721 ms (client timeout 1523 ms). Trace:
W20260709 12:21:00.533170  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 934077us
W20260709 12:21:00.533360  3924 rpcz_store.cc:269] 0709 12:20:58.811808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.532752 (+1720944us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.532887 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:00.533968  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:00.534348  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.535915  5257 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:59.833098  5213 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:20:59.730523  5254 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.537366  5254 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.832669  5165 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:00.539300  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:00.531333  3922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1213) took 3440 ms (client timeout 3166 ms). Trace:
W20260709 12:21:00.541540  3922 rpcz_store.cc:269] 0709 12:20:57.091221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.531117 (+3439896us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.531267 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:59.889609  3842 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:00.563603  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 566) took 1592 ms. Trace:
I20260709 12:21:00.563974  3842 rpcz_store.cc:276] 0709 12:20:58.971067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.544964 (+573897us) service_pool.cc:224] Handling call
0709 12:21:00.563538 (+1018574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.564854  3888 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:00.565215  3888 leader_election.cc:403] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:21:00.565093  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.565840  3842 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:00.566337  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 570) took 1471 ms. Trace:
I20260709 12:20:59.543813  3850 rpcz_store.cc:276] 0709 12:20:58.077014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.036529 (+959515us) service_pool.cc:224] Handling call
0709 12:20:59.523245 (+486716us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400408154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:20:59.523374 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958414080}
I20260709 12:21:00.566849  3888 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:00.567596  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.566648  3842 rpcz_store.cc:276] 0709 12:20:59.094577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.564795 (+1470218us) service_pool.cc:224] Handling call
0709 12:21:00.566284 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.568255  3850 raft_consensus.cc:2376] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4. Re-sending same reply.
I20260709 12:21:00.568841  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 64) took 1044 ms. Trace:
I20260709 12:20:59.902449  5056 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:00.264429  5275 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:20:59.548435  3843 rpcz_store.cc:269] 0709 12:20:58.076110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.982605 (+906495us) service_pool.cc:224] Handling call
0709 12:20:59.546389 (+563784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.374306  5276 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:00.375315  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1388) took 2497 ms (client timeout 2151 ms). Trace:
W20260709 12:21:00.417541  3918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1390) took 2433 ms (client timeout 2243 ms). Trace:
I20260709 12:21:00.423552  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.431262  3748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 195) took 5857 ms. Trace:
W20260709 12:21:00.446851  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1383) took 2830 ms (client timeout 1638 ms). Trace:
I20260709 12:20:59.616389  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:00.463989  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.464112  3848 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.016s
W20260709 12:21:00.477669  3814 connection.cc:256] RPC call timeout handler was delayed by -1.0399859749998086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 12:20:59.881626  5207 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:00.720559  5207 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:00.721223  5207 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:20:59.872730  3962 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:00.727043  3962 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:59.720505  3964 leader_election.cc:336] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.883s (SENT)
I20260709 12:21:00.729336  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:00.730541  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.12973e+06us
I20260709 12:21:00.003762  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1459) took 1075 ms. Trace:
W20260709 12:21:00.733522  3889 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items [suppressed 3 similar messages]
I20260709 12:20:59.810213  3994 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:00.764922  3994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1460) took 1836 ms (client timeout 1616 ms). Trace:
W20260709 12:21:00.765329  3994 rpcz_store.cc:269] 0709 12:20:58.928634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.148417 (+219783us) service_pool.cc:224] Handling call
0709 12:21:00.764804 (+1616387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.844473  3999 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:00.771369  3999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1456) took 1844 ms (client timeout 1863 ms). Trace:
W20260709 12:21:00.771819  3999 rpcz_store.cc:269] 0709 12:20:58.927316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.144022 (+216706us) service_pool.cc:224] Handling call
0709 12:21:00.771305 (+1627283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.396556  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1445) took 1481 ms. Trace:
I20260709 12:21:00.773149  3998 rpcz_store.cc:276] 0709 12:20:58.915381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.915538 (+   157us) service_pool.cc:224] Handling call
0709 12:20:58.915992 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:59.484273 (+568281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:59.487682 (+  3409us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:59.511853 (+ 24171us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.675239 (+163386us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:59.675299 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.396054 (+720755us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002f8fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:00.396094 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.396158 (+    64us) raft_consensus.cc:1685] finished
0709 12:21:00.396166 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.396390 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":528,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":25792,"spinlock_wait_cycles":1305021184,"thread_start_us":162823,"threads_started":1,"wal-append.queue_time_us":297148}
I20260709 12:20:59.720165  3920 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:21:00.775355  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1392) took 2521 ms (client timeout 1503 ms). Trace:
W20260709 12:21:00.775986  3920 rpcz_store.cc:269] 0709 12:20:58.254295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.558035 (+1303740us) service_pool.cc:224] Handling call
0709 12:21:00.775286 (+1217251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.777199  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.777846  3920 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:00.778348  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399) took 2007 ms (client timeout 2061 ms). Trace:
W20260709 12:21:00.778695  3920 rpcz_store.cc:269] 0709 12:20:58.770420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.776816 (+2006396us) service_pool.cc:224] Handling call
0709 12:21:00.778268 (+  1452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.701324  3919 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:00.779745  3919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1381) took 3230 ms (client timeout 2193 ms). Trace:
W20260709 12:21:00.780090  3919 rpcz_store.cc:269] 0709 12:20:57.549026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.557414 (+2008388us) service_pool.cc:224] Handling call
0709 12:21:00.779678 (+1222264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.781016  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.781687  3919 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:21:00.782156  3919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398) took 2012 ms (client timeout 2230 ms). Trace:
W20260709 12:21:00.782462  3919 rpcz_store.cc:269] 0709 12:20:58.770101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.780701 (+2010600us) service_pool.cc:224] Handling call
0709 12:21:00.782107 (+  1406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:59.715595  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.783748  3916 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.550786  3849 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
W20260709 12:21:00.788017  3849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 569) took 1693 ms (client timeout 1760 ms). Trace:
W20260709 12:21:00.788435  3849 rpcz_store.cc:269] 0709 12:20:59.094232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.490139 (+395907us) service_pool.cc:224] Handling call
0709 12:21:00.787878 (+1297739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.789562  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.790421  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1294) took 1215 ms. Trace:
I20260709 12:21:00.790870  3849 rpcz_store.cc:276] 0709 12:20:59.574560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.789258 (+1214698us) service_pool.cc:224] Handling call
0709 12:21:00.790358 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.535151  3924 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:21:00.791767  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1400) took 2011 ms (client timeout 1908 ms). Trace:
W20260709 12:21:00.792191  3924 rpcz_store.cc:269] 0709 12:20:58.780674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.534067 (+1753393us) service_pool.cc:224] Handling call
0709 12:21:00.791665 (+257598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.793155  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.793746  3924 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:00.794183  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1411) took 1287 ms (client timeout 1523 ms). Trace:
W20260709 12:21:00.794495  3924 rpcz_store.cc:269] 0709 12:20:59.506492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.792872 (+1286380us) service_pool.cc:224] Handling call
0709 12:21:00.794132 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.540764  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 575) took 1342 ms. Trace:
I20260709 12:21:00.796059  3847 rpcz_store.cc:276] 0709 12:20:59.198527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.538838 (+1340311us) service_pool.cc:224] Handling call
0709 12:21:00.540673 (+  1835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.797158  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.797989  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 67) took 1264 ms. Trace:
I20260709 12:21:00.798313  3847 rpcz_store.cc:276] 0709 12:20:59.533248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.796851 (+1263603us) service_pool.cc:224] Handling call
0709 12:21:00.797910 (+  1059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.561900  3746 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.562882  5278 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:00.799777  5278 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:00.800257  5278 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.549011  5001 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:00.542781  5254 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:00.520455  5262 raft_consensus.cc:2243] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:00.795357  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.607997  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.813084  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 65) took 1287 ms. Trace:
I20260709 12:21:00.813426  3843 rpcz_store.cc:276] 0709 12:20:59.525600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.607596 (+1081996us) service_pool.cc:224] Handling call
0709 12:21:00.813019 (+205423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.814414  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.815093  3843 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.609216  3921 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:00.610857  5276 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:00.815831  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1391) took 2828 ms (client timeout 1706 ms). Trace:
W20260709 12:21:00.816200  3921 rpcz_store.cc:269] 0709 12:20:57.987142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.551740 (+1564598us) service_pool.cc:224] Handling call
0709 12:21:00.815738 (+1263998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.817149  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:00.611654  3918 rpcz_store.cc:269] 0709 12:20:57.984643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.417260 (+2432617us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.417455 (+   195us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:00.817799  3921 raft_consensus.cc:2376] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:00.612219  5275 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:00.818312  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1413) took 1311 ms (client timeout 1564 ms). Trace:
W20260709 12:21:00.818758  3921 rpcz_store.cc:269] 0709 12:20:59.507258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.816872 (+1309614us) service_pool.cc:224] Handling call
0709 12:21:00.818255 (+  1383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.612277  3748 rpcz_store.cc:276] 0709 12:20:54.573869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.574055 (+   186us) service_pool.cc:224] Handling call
0709 12:21:00.431178 (+5857123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:59.128490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:59.130048 (+  1558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:59.130127 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:20:59.130173 (+    46us) tablet.cc:662] Decoding operations
0709 12:20:59.130746 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:59.130873 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:59.130918 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:59.131383 (+   465us) tablet.cc:701] Row locks acquired
0709 12:20:59.134526 (+  3143us) write_op.cc:260] PREPARE: finished
0709 12:20:59.187269 (+ 52743us) write_op.cc:270] Start()
0709 12:20:59.187506 (+   237us) write_op.cc:276] Timestamp: P: 1783599659187201 usec, L: 0
0709 12:20:59.187566 (+    60us) op_driver.cc:348] REPLICATION: starting
0709 12:20:59.188672 (+  1106us) log.cc:844] Serialized 538 byte log entry
0709 12:20:59.429892 (+241220us) op_driver.cc:464] REPLICATION: finished
0709 12:20:59.899580 (+469688us) write_op.cc:301] APPLY: starting
0709 12:20:59.899729 (+   149us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:59.899867 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:59.900030 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:59.900457 (+   427us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:59.900838 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:59.900892 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:59.901200 (+   308us) log.cc:844] Serialized 23 byte log entry
0709 12:20:59.982065 (+ 80865us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.982167 (+   102us) write_op.cc:454] Released schema lock
0709 12:20:59.982230 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:59.982742 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.982774 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36990,"reported_tablets":2,"spinlock_wait_cycles":11520,"child_traces":[["op",{"apply.queue_time_us":451218,"apply.run_cpu_time_us":2576,"apply.run_wall_time_us":97715,"mutex_wait_us":12681,"num_ops":1,"prepare.queue_time_us":43993,"prepare.run_cpu_time_us":4706,"prepare.run_wall_time_us":60673,"replication_time_us":242121,"thread_start_us":135200,"threads_started":2}]]}
I20260709 12:21:00.615499  3848 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
W20260709 12:21:00.820459  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 563) took 1851 ms (client timeout 2234 ms). Trace:
W20260709 12:21:00.820833  3848 rpcz_store.cc:269] 0709 12:20:58.969491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.561018 (+591527us) service_pool.cc:224] Handling call
0709 12:21:00.820397 (+1259379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.821772  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.822501  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1290) took 1249 ms. Trace:
I20260709 12:21:00.822781  3848 rpcz_store.cc:276] 0709 12:20:59.573310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.821501 (+1248191us) service_pool.cc:224] Handling call
0709 12:21:00.822423 (+   922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.616362  3845 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:00.824421  3845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 560) took 1856 ms (client timeout 2275 ms). Trace:
W20260709 12:21:00.824806  3845 rpcz_store.cc:269] 0709 12:20:58.967911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.423114 (+1455203us) service_pool.cc:224] Handling call
0709 12:21:00.824346 (+401232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.825845  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.826889  3845 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:00.592104  3815 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.020s	sys 0.017s
W20260709 12:21:00.827924  3815 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.021s	sys 0.017s
W20260709 12:21:00.828296  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.39448e+06us
W20260709 12:21:00.830618  3815 connection.cc:256] RPC call timeout handler was delayed by -1.4473515649997353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:21:00.616813  3923 rpcz_store.cc:269] 0709 12:20:57.616921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.446598 (+2829677us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.446773 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:00.832089  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.832666  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.569181  3850 rpcz_store.cc:276] 0709 12:20:59.524969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.567309 (+1042340us) service_pool.cc:224] Handling call
0709 12:21:00.568781 (+  1472us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.617324  3925 rpcz_store.cc:269] 0709 12:20:57.878019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.375130 (+2497111us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.375262 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:00.835229  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:20:59.542220  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 555) took 1460 ms. Trace:
I20260709 12:21:00.836014  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.836164  3846 rpcz_store.cc:276] 0709 12:20:58.078696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.196834 (+1118138us) service_pool.cc:224] Handling call
0709 12:20:59.538929 (+342095us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.836826  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 30) took 1715 ms (client timeout 2022 ms). Trace:
W20260709 12:21:00.837181  3925 rpcz_store.cc:269] 0709 12:20:59.121777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.835742 (+1713965us) service_pool.cc:224] Handling call
0709 12:21:00.836770 (+  1028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.838165  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.838266  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:00.569149  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.572777  5257 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:00.839473  3842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 561) took 1871 ms (client timeout 2377 ms). Trace:
W20260709 12:21:00.839895  3842 rpcz_store.cc:269] 0709 12:20:58.968450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.568865 (+1600415us) service_pool.cc:224] Handling call
0709 12:21:00.839393 (+270528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.840377  5257 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:00.661249  3890 leader_election.cc:336] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Timed out: RequestConsensusVote RPC to 127.2.157.68:38173 timed out after 1.963s (SENT)
W20260709 12:21:00.663478  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 96696.3us
I20260709 12:21:00.842986  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:00.665941  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:00.844101  3844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 573) took 1748 ms (client timeout 1891 ms). Trace:
I20260709 12:21:00.844449  5275 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:00.844528  3844 rpcz_store.cc:269] 0709 12:20:59.095475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.512103 (+416628us) service_pool.cc:224] Handling call
0709 12:21:00.665750 (+1153647us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:00.844040 (+178290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14530304}
W20260709 12:21:00.662109  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52288.9us
I20260709 12:21:00.836014  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1293) took 1261 ms. Trace:
I20260709 12:21:00.845903  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.845980  3850 rpcz_store.cc:276] 0709 12:20:59.574267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.834978 (+1260711us) service_pool.cc:224] Handling call
0709 12:21:00.835950 (+   972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.846627  3844 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.675657  5280 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.733980  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 34)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 38)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1411)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 31)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1413)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 37)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1412)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1414)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
I20260709 12:21:00.839159  5277 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:00.849443  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.849644  5277 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:00.850298  3848 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:00.850730  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1277) took 1885 ms. Trace:
I20260709 12:21:00.850677  5277 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:00.838689  3925 raft_consensus.cc:2376] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
W20260709 12:21:00.844103  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 182964us
W20260709 12:21:00.852026  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1414) took 1344 ms (client timeout 1643 ms). Trace:
I20260709 12:21:00.827314  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 63) took 1838 ms. Trace:
W20260709 12:21:00.852401  3890 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Timed out: RequestConsensusVote RPC to 127.2.157.68:38173 timed out after 2.019s (SENT)
I20260709 12:21:00.852751  3845 rpcz_store.cc:276] 0709 12:20:58.988740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.825509 (+1836769us) service_pool.cc:224] Handling call
0709 12:21:00.827261 (+  1752us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.853087  3890 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Timed out: RequestConsensusVote RPC to 127.2.157.68:38173 timed out after 2.183s (SENT)
I20260709 12:21:00.853551  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:00.854017  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.851358  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 39)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
I20260709 12:21:00.854780  3845 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:00.818248  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:00.856949  3814 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.104s (SENT)
I20260709 12:21:00.855639  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 39)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
I20260709 12:21:00.861670  5280 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
W20260709 12:21:00.852419  3925 rpcz_store.cc:269] 0709 12:20:59.515706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.837895 (+1322189us) service_pool.cc:224] Handling call
0709 12:21:00.851960 (+ 14065us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.739912  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 867344us
I20260709 12:21:00.864014  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:00.864956  3815 connection.cc:256] RPC call timeout handler was delayed by -1.1692515649997404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:21:00.865427  3815 connection.cc:256] RPC call timeout handler was delayed by -1.0774515649998193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:21:00.733873  3991 rpcz_store.cc:276] 0709 12:20:58.928335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.593900 (+665565us) service_pool.cc:224] Handling call
0709 12:20:59.599469 (+  5569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:59.808945 (+209476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:59.808979 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:59.832043 (+ 23064us) log.cc:844] Serialized 26 byte log entry
0709 12:20:59.879496 (+ 47453us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:59.879538 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.879606 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.003096 (+123490us) raft_consensus.cc:1685] finished
0709 12:21:00.003335 (+   239us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.003669 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112970,"raft.queue_time_us":95073,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":5999,"thread_start_us":46017,"threads_started":1,"wal-append.queue_time_us":63404}
I20260709 12:21:00.740664  5207 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:00.864842  3925 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:00.867656  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:00.868626  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1405) took 1874 ms (client timeout 2206 ms). Trace:
W20260709 12:21:00.869107  3925 rpcz_store.cc:269] 0709 12:20:58.994256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.863650 (+1869394us) service_pool.cc:224] Handling call
0709 12:21:00.868546 (+  4896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.851181  3848 rpcz_store.cc:276] 0709 12:20:58.965737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.849183 (+1883446us) service_pool.cc:224] Handling call
0709 12:21:00.850674 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.870085  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:00.870366  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1409) took 1364 ms (client timeout 1597 ms). Trace:
I20260709 12:21:00.758718  5213 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:00.761848  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 227973us
I20260709 12:21:00.800678  3746 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:00.802022  5251 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:00.802932  5282 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.799299  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.783313  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.808944  5262 raft_consensus.cc:2272] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:00.572526  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.810616  5278 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:00.900789  3841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 557) took 2123 ms (client timeout 2026 ms). Trace:
I20260709 12:21:00.812225  3916 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:00.817306  5276 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:00.611466  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:00.901571  3916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1394) took 2588 ms (client timeout 1931 ms). Trace:
I20260709 12:21:00.833916  3924 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.901947  3922 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.833282  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.903684  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:00.903927  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 34) took 1703 ms (client timeout 1774 ms). Trace:
W20260709 12:21:00.904341  3920 rpcz_store.cc:269] 0709 12:20:59.200448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.779292 (+1578844us) service_pool.cc:224] Handling call
0709 12:21:00.903868 (+124576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.905323  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.906179  3920 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:00.834187  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:00.642616  3917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1387) took 2782 ms (client timeout 2241 ms). Trace:
I20260709 12:21:00.840821  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.907027  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 574) took 1811 ms. Trace:
I20260709 12:21:00.837196  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.907554  3849 rpcz_store.cc:276] 0709 12:20:59.095839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.807828 (+1711989us) service_pool.cc:224] Handling call
0709 12:21:00.906936 (+ 99108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.908349  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1286) took 1938 ms. Trace:
I20260709 12:21:00.732414  5283 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:00.908733  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.908989  5283 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:00.909528  3849 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.909796  3924 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:21:00.910377  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 31) took 1727 ms (client timeout 1861 ms). Trace:
W20260709 12:21:00.910781  3924 rpcz_store.cc:269] 0709 12:20:59.182708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.795098 (+1612390us) service_pool.cc:224] Handling call
0709 12:21:00.910311 (+115213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.912218  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.855649  5165 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.912873  3924 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.871134  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.867872  5207 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:00.907467  3842 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:00.913654  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1291) took 1340 ms. Trace:
I20260709 12:21:00.913602  5207 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:00.914474  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.847088  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:00.870805  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 39)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
I20260709 12:21:00.915899  5207 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:00.916481  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:00.906762  3917 rpcz_store.cc:269] 0709 12:20:57.860591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.642374 (+2781783us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:00.642540 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:00.908744  3846 rpcz_store.cc:276] 0709 12:20:58.970445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.836933 (+1866488us) service_pool.cc:224] Handling call
0709 12:21:00.908288 (+ 71355us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.918339  3916 rpcz_store.cc:269] 0709 12:20:58.313596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.609615 (+1296019us) service_pool.cc:224] Handling call
0709 12:21:00.901504 (+1291889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.882881  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:00.916507  3919 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:21:00.917207  3889 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1226)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 39)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
I20260709 12:21:00.874840  3923 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:00.875993  3844 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
W20260709 12:21:00.906530  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 32) took 1723 ms (client timeout 2057 ms). Trace:
I20260709 12:21:00.758848  5056 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:00.883472  3921 rpcz_store.cc:269] 0709 12:20:59.505824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.819422 (+1313598us) service_pool.cc:224] Handling call
0709 12:21:00.870308 (+ 50886us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.751116  3964 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.054s (SENT)
I20260709 12:21:00.892858  3843 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
W20260709 12:21:00.922999  3920 rpcz_store.cc:269] 0709 12:20:59.183164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.905027 (+1721863us) service_pool.cc:224] Handling call
0709 12:21:00.906478 (+  1451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.924506  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1288) took 1727 ms. Trace:
I20260709 12:21:00.924916  3843 rpcz_store.cc:276] 0709 12:20:59.197467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.814126 (+1616659us) service_pool.cc:224] Handling call
0709 12:21:00.924445 (+110319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.901266  3841 rpcz_store.cc:269] 0709 12:20:58.776943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.491798 (+714855us) service_pool.cc:224] Handling call
0709 12:21:00.572324 (+1080526us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:00.900686 (+328362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14868224}
I20260709 12:21:00.870873  3925 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
W20260709 12:21:00.925943  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 33) took 1742 ms (client timeout 2020 ms). Trace:
I20260709 12:21:00.922452  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:00.922765  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 564) took 1952 ms. Trace:
I20260709 12:21:00.876905  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:00.872494  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:00.923324  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1412) took 1416 ms (client timeout 1610 ms). Trace:
W20260709 12:21:00.929298  3923 rpcz_store.cc:269] 0709 12:20:59.506815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.831761 (+1324946us) service_pool.cc:224] Handling call
0709 12:21:00.923265 (+ 91504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23424}
I20260709 12:21:00.926831  3844 rpcz_store.cc:276] 0709 12:20:58.969997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.845628 (+1875631us) service_pool.cc:224] Handling call
0709 12:21:00.922704 (+ 77076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.914179  3848 rpcz_store.cc:276] 0709 12:20:59.573669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.870861 (+1297192us) service_pool.cc:224] Handling call
0709 12:21:00.913590 (+ 42729us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.926303  3925 rpcz_store.cc:269] 0709 12:20:59.197763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.869818 (+1672055us) service_pool.cc:224] Handling call
0709 12:21:00.925883 (+ 56065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.931604  4581 raft_consensus.cc:1813] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Handling vote request from an unknown peer bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:00.931903  4580 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.932771  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:00.933535  3842 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:00.933535  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:00.934967  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 183886us
W20260709 12:21:00.935830  3964 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.706s (SENT)
I20260709 12:21:00.936251  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:00.937645  3923 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.940053  5262 ts_tablet_manager.cc:1916] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:00.921833  3746 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:00.939328  3919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 38) took 1737 ms (client timeout 1805 ms). Trace:
I20260709 12:21:00.941253  4581 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:21:00.941526  3919 rpcz_store.cc:269] 0709 12:20:59.201723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.783050 (+1581327us) service_pool.cc:224] Handling call
0709 12:21:00.939171 (+156121us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5400244ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:00.939267 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44771712}
I20260709 12:21:00.920284  5280 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.936753  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1276) took 1972 ms. Trace:
I20260709 12:21:00.912539  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:00.942487  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.954684  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1267) took 2587 ms. Trace:
I20260709 12:21:00.924196  3918 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
W20260709 12:21:00.954546  3888 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Timed out: RequestConsensusVote RPC to 127.2.157.65:37307 timed out after 2.275s (SENT)
I20260709 12:21:00.923810  4577 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.943948  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.963303  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.955600  3841 rpcz_store.cc:276] 0709 12:20:58.365203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.940692 (+2575489us) service_pool.cc:224] Handling call
0709 12:21:00.943563 (+  2871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.951830 (+  8267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.951859 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.951909 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:00.951938 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.952016 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.952141 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.965590  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1419) took 1378 ms. Trace:
I20260709 12:21:00.965978  5278 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:00.966461  3841 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:00.952183  3847 rpcz_store.cc:276] 0709 12:20:58.964923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.799023 (+1834100us) service_pool.cc:224] Handling call
0709 12:21:00.936686 (+137663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.967232  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1270) took 2452 ms. Trace:
W20260709 12:21:00.954974  3917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 35) took 1754 ms (client timeout 2072 ms). Trace:
I20260709 12:21:00.943673  5213 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.967576  3845 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:21:00.955466  4576 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:21:00.968343  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55992.3us
I20260709 12:21:00.967587  3841 rpcz_store.cc:276] 0709 12:20:58.514791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.965937 (+2451146us) service_pool.cc:224] Handling call
0709 12:21:00.966294 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.966954 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.967151 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.969825  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1273) took 2280 ms. Trace:
I20260709 12:21:00.970055  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:00.967725  3917 rpcz_store.cc:269] 0709 12:20:59.200819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.927906 (+1727087us) service_pool.cc:224] Handling call
0709 12:21:00.954917 (+ 27011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.971946  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:00.972652  3917 raft_consensus.cc:2376] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:00.972766  5282 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.973333  5282 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:00.973440  3918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 37) took 1772 ms (client timeout 1871 ms). Trace:
I20260709 12:21:00.973713  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:00.973964  3918 rpcz_store.cc:269] 0709 12:20:59.201422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.817913 (+1616491us) service_pool.cc:224] Handling call
0709 12:21:00.973239 (+155326us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54001405d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:00.973372 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147368320}
I20260709 12:21:00.958060  3922 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:00.967760  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.911315  5283 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:00.976378  3922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1404) took 1982 ms (client timeout 1795 ms). Trace:
W20260709 12:21:00.976873  3922 rpcz_store.cc:269] 0709 12:20:58.993855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.611101 (+1617246us) service_pool.cc:224] Handling call
0709 12:21:00.976312 (+365211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.977300  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47094.1us
I20260709 12:21:00.959865  3843 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:00.970343  3845 rpcz_store.cc:276] 0709 12:20:58.689954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.968627 (+2278673us) service_pool.cc:224] Handling call
0709 12:21:00.969055 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.969311 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.969344 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.969411 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:00.969454 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.969546 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.969736 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.979580  3888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.65:37307 timed out after 2.377s (SENT) [suppressed 81 similar messages]
I20260709 12:21:00.979830  3921 raft_consensus.cc:2376] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:00.981182  3919 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:21:00.981762  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1415) took 1465 ms (client timeout 1769 ms). Trace:
I20260709 12:21:00.981990  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:00.982224  3921 rpcz_store.cc:269] 0709 12:20:59.516127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.928802 (+1412675us) service_pool.cc:224] Handling call
0709 12:21:00.981683 (+ 52881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.964054  3849 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:00.966024  3920 rpcz_store.cc:276] 0709 12:20:59.586828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.945518 (+1358690us) service_pool.cc:224] Handling call
0709 12:21:00.965527 (+ 20009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:00.984357  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48563.7us
I20260709 12:21:00.982971  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 553) took 2900 ms. Trace:
I20260709 12:21:00.978401  3962 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:00.981841  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1408) took 1476 ms. Trace:
I20260709 12:21:00.989082  3924 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:00.984429  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:00.995180  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:00.999625  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1410) took 1493 ms (client timeout 1753 ms). Trace:
I20260709 12:21:00.986315  3922 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:00.985946  4546 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:00.985045  3843 rpcz_store.cc:276] 0709 12:20:58.078154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.942649 (+2864495us) service_pool.cc:224] Handling call
0709 12:21:00.959694 (+ 17045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.977943 (+ 18249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.978223 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.999857  3919 rpcz_store.cc:276] 0709 12:20:59.505458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.967418 (+1461960us) service_pool.cc:224] Handling call
0709 12:21:00.981782 (+ 14364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:01.000075  3924 rpcz_store.cc:269] 0709 12:20:59.506151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.911916 (+1405765us) service_pool.cc:224] Handling call
0709 12:21:00.999544 (+ 87628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.986459  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:00.995270  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 60) took 2918 ms. Trace:
I20260709 12:21:00.967768  3847 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.032025  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1271) took 2488 ms. Trace:
I20260709 12:21:01.032526  3847 rpcz_store.cc:276] 0709 12:20:58.543645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.967154 (+2423509us) service_pool.cc:224] Handling call
0709 12:21:00.967587 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.031679 (+ 64092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.031931 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.034789  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1285) took 2064 ms. Trace:
I20260709 12:21:01.036156  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.037122  3920 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:01.038086  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.038813  3920 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:01.040969  3846 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:01.041551  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.042222  3916 raft_consensus.cc:2376] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
W20260709 12:21:01.042721  3916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1417) took 1490 ms (client timeout 1848 ms). Trace:
W20260709 12:21:01.043077  3916 rpcz_store.cc:269] 0709 12:20:59.552739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.041311 (+1488572us) service_pool.cc:224] Handling call
0709 12:21:01.042665 (+  1354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.043787  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 554) took 2965 ms. Trace:
I20260709 12:21:01.044179  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.044775  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.007707  5278 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.045923  5278 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:01.046205  5001 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.046495  5278 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.046868  5001 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.048017  5001 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.008471  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.052525  3922 raft_consensus.cc:2368] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.052881  5185 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:01.053725  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.054541  3922 raft_consensus.cc:2376] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:01.010133  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1279) took 2043 ms. Trace:
I20260709 12:21:01.055578  3850 rpcz_store.cc:276] 0709 12:20:58.966881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.983020 (+2016139us) service_pool.cc:224] Handling call
0709 12:21:00.984590 (+  1570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.009755 (+ 25165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.009785 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.009836 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.009866 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.009925 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.010042 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.002692  3848 rpcz_store.cc:276] 0709 12:20:58.076434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.938765 (+2862331us) service_pool.cc:224] Handling call
0709 12:21:00.982444 (+ 43679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.994876 (+ 12432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.994921 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.994977 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:00.995012 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.995074 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.995208 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.011598  3925 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.978035  5257 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.985358  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:01.013688  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1280) took 2046 ms. Trace:
I20260709 12:21:01.014284  5213 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.015923  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1278) took 2049 ms. Trace:
I20260709 12:21:01.017791  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.017863  5254 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.019899  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1281) took 2052 ms. Trace:
I20260709 12:21:01.022653  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.024056  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1275) took 2252 ms. Trace:
I20260709 12:21:01.078583  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.002007  5251 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.024362  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:00.985826  5277 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:01.025444  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 172378us
I20260709 12:21:01.026659  4575 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.028255  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.028312  3814 leader_election.cc:400] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:01.089897  3814 leader_election.cc:403] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.030485  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.041703  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 61) took 2054 ms. Trace:
I20260709 12:21:01.045034  3916 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:01.004129  3923 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:01.092610  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1421) took 1505 ms (client timeout 1863 ms). Trace:
W20260709 12:21:01.093044  3923 rpcz_store.cc:269] 0709 12:20:59.587551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.933299 (+1345748us) service_pool.cc:224] Handling call
0709 12:21:01.092538 (+159239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.094005  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.044176  3842 rpcz_store.cc:276] 0709 12:20:58.078435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.940742 (+2862307us) service_pool.cc:224] Handling call
0709 12:21:00.976847 (+ 36105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.983207 (+  6360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.983236 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.983292 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:00.983324 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.983391 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.043593 (+ 60202us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400343fd0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:01.043705 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23949568}
W20260709 12:21:01.011139  3815 connection.cc:256] RPC call timeout handler was delayed by -1.8747529800000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 12:21:01.057850  3843 rpcz_store.cc:276] 0709 12:20:58.967383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.012805 (+2045422us) service_pool.cc:224] Handling call
0709 12:21:01.013145 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.013353 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.013378 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.013420 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.013450 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.013506 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.013608 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.058036  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:01.066006  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 88138.6us
I20260709 12:21:01.066310  3844 rpcz_store.cc:276] 0709 12:20:58.966357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.981227 (+2014870us) service_pool.cc:224] Handling call
0709 12:21:00.981565 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.015553 (+ 33988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.015584 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.015642 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.015674 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.015742 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.015861 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.067230  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.068069  3850 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:01.097854  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1289) took 1886 ms. Trace:
I20260709 12:21:01.069890  3921 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
W20260709 12:21:01.098665  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70578.3us
I20260709 12:21:01.078541  3841 rpcz_store.cc:276] 0709 12:20:58.772005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.969736 (+2197731us) service_pool.cc:224] Handling call
0709 12:21:00.970121 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.023573 (+ 53452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.023606 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.023671 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.023729 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.023832 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.023984 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.982169  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.078073  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 106675us
I20260709 12:21:01.084444  3848 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.101253  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 66) took 1575 ms. Trace:
I20260709 12:21:01.072955  3889 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40578 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 39)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1430)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1429)
W20260709 12:21:01.089255  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:01.096271  3815 connection.cc:256] RPC call timeout handler was delayed by -1.8531529800000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 12:21:01.081187  5251 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.082929  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.087634  5277 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:01.107887  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.101625  3848 rpcz_store.cc:276] 0709 12:20:59.525989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.077149 (+1551160us) service_pool.cc:224] Handling call
0709 12:21:01.084237 (+  7088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.100998 (+ 16761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.101195 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.107829  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.109392  3919 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.086746  5275 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.097122  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.102217  5276 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:01.106916  4580 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:01.102897  3922 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.111819  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.113669  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.098326  3850 rpcz_store.cc:276] 0709 12:20:59.211371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.056949 (+1845578us) service_pool.cc:224] Handling call
0709 12:21:01.057413 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.097542 (+ 40129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.097792 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.088459  4574 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:01.116199  3850 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:01.117645  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.118441  3916 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.120428  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1292) took 1546 ms. Trace:
I20260709 12:21:01.123677  3920 raft_consensus.cc:2368] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.124171  3922 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:01.100513  4582 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:01.035359  3847 rpcz_store.cc:276] 0709 12:20:58.970075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.033619 (+2063544us) service_pool.cc:224] Handling call
0709 12:21:01.034029 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.034293 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.034340 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.034408 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:01.034464 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.034552 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.034712 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.138695  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.139068  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.139791  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:01.140089  5287 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:01.140564  5287 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.140697  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.141057  5287 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.141479  3922 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.141762  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.142431  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.142699  5207 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.143225  5207 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:01.143132  3922 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.138751  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.102409  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1284) took 2130 ms. Trace:
I20260709 12:21:01.145026  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.138752  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.145370  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.140750  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.150224  3921 raft_consensus.cc:1813] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Handling vote request from an unknown peer bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.123847  3842 rpcz_store.cc:276] 0709 12:20:59.573979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.102950 (+1528971us) service_pool.cc:224] Handling call
0709 12:21:01.103267 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.109372 (+  6105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.109404 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.120048 (+ 10644us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.120110 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.120200 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.120349 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.144311  5207 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.108604  5251 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.151417  3921 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:21:01.150357  3815 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.523s (SENT)
I20260709 12:21:01.153200  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.116393  5275 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.154102  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.159641  3924 raft_consensus.cc:2376] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:01.160015  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.110251  5277 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.160683  3916 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:01.156903  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.153803  3923 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.105957  3918 raft_consensus.cc:2376] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:01.125519  5283 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.170138  5165 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:01.095285  3846 rpcz_store.cc:276] 0709 12:20:58.987834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.040357 (+2052523us) service_pool.cc:224] Handling call
0709 12:21:01.040761 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.041426 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.041640 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.145443  5280 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.172588  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1295) took 1597 ms. Trace:
I20260709 12:21:01.200887  3843 rpcz_store.cc:276] 0709 12:21:00.497166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.107580 (+610414us) service_pool.cc:224] Handling call
0709 12:21:01.149749 (+ 42169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.172245 (+ 22496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.172276 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.172327 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.172357 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.172417 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.172530 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.172737  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:01.202023  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.173915  5282 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.202898  4579 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:01.204645  5282 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:01.175166  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.205281  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.148645  3849 rpcz_store.cc:276] 0709 12:20:58.969630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.029310 (+2059680us) service_pool.cc:224] Handling call
0709 12:21:01.029740 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.030313 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.030345 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.030922 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.080102 (+ 49180us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.082177 (+  2075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.083867 (+  1690us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.088327 (+  4460us) raft_consensus.cc:1685] finished
0709 12:21:01.088348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.100378 (+ 12030us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":41787,"threads_started":1,"wal-append.queue_time_us":40184}
I20260709 12:21:01.177127  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.206036  4578 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:01.206812  3923 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
W20260709 12:21:01.207691  5292 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 12:21:01.177248  5278 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.208134  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.208873  3918 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:01.209805  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.210626  5278 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:01.177932  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.178443  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.163596  5275 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.180119  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.218353  3924 raft_consensus.cc:2376] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
W20260709 12:21:01.218459  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 67515.8us
I20260709 12:21:01.180418  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.182418  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.220369  4580 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.076761  3845 rpcz_store.cc:276] 0709 12:20:58.967911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.018656 (+2050745us) service_pool.cc:224] Handling call
0709 12:21:01.019075 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.019377 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.019411 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.019548 (+   137us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.019589 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.019680 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.019829 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.185986  3922 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:01.187909  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:01.189263  3841 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.138103  5257 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:01.193735  3925 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:01.230614  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46046 (request call id 36) took 2029 ms. Trace:
I20260709 12:21:01.230031  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.230933  3925 rpcz_store.cc:276] 0709 12:20:59.201132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.979279 (+1778147us) service_pool.cc:224] Handling call
0709 12:21:01.230544 (+251265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.195582  5283 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.183772  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:01.146721  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:01.196667  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50388.9us
I20260709 12:21:01.198028  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.198825  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 82606.8us
I20260709 12:21:01.213133  3917 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:01.216281  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.221978  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.241818  4580 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:01.223071  3920 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.223671  3921 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.210318  3918 raft_consensus.cc:2376] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:01.164124  4577 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:01.244092  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.227336  4575 raft_consensus.cc:2393] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:01.251982  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.254467  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.240892  3842 raft_consensus.cc:2376] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3. Re-sending same reply.
I20260709 12:21:01.252774  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.264665  4581 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.265089  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.255235  3921 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:01.266511  3815 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.564s (SENT)
I20260709 12:21:01.266520  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.266013  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 189237us
I20260709 12:21:01.268239  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.268916  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.269894  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.270486  3925 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.269061  4580 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:01.267987  3923 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:01.273854  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.264673  4582 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.275861  5257 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.276544  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.277845  3919 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.279659  3924 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:01.279874  3920 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.280603  5001 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.252604  5283 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.281019  5001 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.282213  5001 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:01.283095  3815 leader_election.cc:336] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.643s (SENT)
I20260709 12:21:01.286041  3849 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.286775  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:01.281178  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.291872  3917 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.308424  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.309067  3917 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.309993  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.310681  3917 raft_consensus.cc:1813] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Handling vote request from an unknown peer bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.311394  3917 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:21:01.292438  3921 raft_consensus.cc:2368] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:01.301942  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.283250  5001 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.306066  3922 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:01.326911  3964 connection.cc:256] RPC call timeout handler was delayed by -1.4984893789999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
I20260709 12:21:01.328861  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:01.328866  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.270654  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 155049us
I20260709 12:21:01.349828  3923 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:01.352360  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.347994  3964 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.290s (SENT)
W20260709 12:21:01.355966  3964 connection.cc:256] RPC call timeout handler was delayed by -1.2860087740000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.263s for a response
I20260709 12:21:01.357808  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:01.358907  3991 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:21:01.360355  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.361840  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:01.363914  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:01.365622  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:01.366489  3994 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:01.368038  3997 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:01.369668  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:01.377362  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:01.378162  3990 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.381999  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:01.389278  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:01.390342  3991 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:01.393528  3990 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:01.401475  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.404664  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 210) took 6532 ms. Trace:
I20260709 12:21:01.405943  3745 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.402024  3920 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.410573  5313 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.308297  5213 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.429857  3921 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:01.414719  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:21:01.416131  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89875.1us
I20260709 12:21:01.432080  3890 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:01.432375  3924 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
W20260709 12:21:01.422930  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 123576us
I20260709 12:21:01.420534  3745 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:01.433290  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1201) took 4343 ms. Trace:
I20260709 12:21:01.433766  3917 rpcz_store.cc:276] 0709 12:20:57.085302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.347398 (+4262096us) service_pool.cc:224] Handling call
0709 12:21:01.422950 (+ 75552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.428070 (+  5120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.428131 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.428206 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.428255 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.428349 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.428523 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.434810  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1198) took 4356 ms. Trace:
I20260709 12:21:01.435269  3921 rpcz_store.cc:276] 0709 12:20:57.074635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.325385 (+4250750us) service_pool.cc:224] Handling call
0709 12:21:01.415947 (+ 90562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.430516 (+ 14569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.430719 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.413631  3998 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:01.439023  3923 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.439745  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1212) took 4348 ms. Trace:
I20260709 12:21:01.440150  3923 rpcz_store.cc:276] 0709 12:20:57.090939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.350883 (+4259944us) service_pool.cc:224] Handling call
0709 12:21:01.438852 (+ 87969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.439435 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.439675 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.416258  5280 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.442255  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.446760  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1369) took 4303 ms. Trace:
I20260709 12:21:01.447135  3924 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:01.454763  5275 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.448553  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1370) took 4298 ms. Trace:
I20260709 12:21:01.449874  3917 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.469679  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1380) took 3948 ms. Trace:
I20260709 12:21:01.470167  3917 rpcz_store.cc:276] 0709 12:20:57.521630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.449211 (+3927581us) service_pool.cc:224] Handling call
0709 12:21:01.449535 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.469315 (+ 19780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.469604 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:01.451869  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 374109us
I20260709 12:21:01.451884  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1205) took 4362 ms. Trace:
I20260709 12:21:01.472702  3922 rpcz_store.cc:276] 0709 12:20:57.089102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.346995 (+4257893us) service_pool.cc:224] Handling call
0709 12:21:01.430162 (+ 83167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.451536 (+ 21374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.451577 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.451622 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.451650 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.451712 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.451826 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.452755  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1375) took 4227 ms. Trace:
I20260709 12:21:01.452891  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.455214  5313 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.457865  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1374) took 4239 ms. Trace:
W20260709 12:21:01.447247  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 164205us
I20260709 12:21:01.457491  3920 rpcz_store.cc:276] 0709 12:20:57.143773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.421256 (+4277483us) service_pool.cc:224] Handling call
0709 12:21:01.446140 (+ 24884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.446362 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.446400 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.446448 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.446481 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.446544 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.446674 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.484900  3921 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:01.484630  3924 rpcz_store.cc:276] 0709 12:20:57.218915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.433075 (+4214160us) service_pool.cc:224] Handling call
0709 12:21:01.446952 (+ 13877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.457626 (+ 10674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.457814 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.474103  3923 rpcz_store.cc:276] 0709 12:20:57.225226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.441015 (+4215789us) service_pool.cc:224] Handling call
0709 12:21:01.452219 (+ 11204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.452388 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.452416 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.452457 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:01.452497 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.452576 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.452677 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.489039  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.490046  5301 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:01.491204  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1386) took 3683 ms. Trace:
I20260709 12:21:01.491663  3917 rpcz_store.cc:276] 0709 12:20:57.808071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.471117 (+3663046us) service_pool.cc:224] Handling call
0709 12:21:01.490673 (+ 19556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.490856 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.490879 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.490918 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.490964 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.491013 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.491147 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.459313  5280 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.494143  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.498229  3922 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
W20260709 12:21:01.499188  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46385.7us
I20260709 12:21:01.461467  5293 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:01.499276  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.502626  3922 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:01.500001  3925 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:01.495471  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 63467.5us
I20260709 12:21:01.495332  5316 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:01.506475  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 314809us
I20260709 12:21:01.504205  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:01.419059  3746 rpcz_store.cc:276] 0709 12:20:54.872769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.872990 (+   221us) service_pool.cc:224] Handling call
0709 12:21:01.404575 (+6531585us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:01.183876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:01.188297 (+  4421us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:01.188344 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:21:01.188372 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:01.189346 (+   974us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:01.189425 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:01.189468 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:01.190135 (+   667us) tablet.cc:701] Row locks acquired
0709 12:21:01.195334 (+  5199us) write_op.cc:260] PREPARE: finished
0709 12:21:01.195524 (+   190us) write_op.cc:270] Start()
0709 12:21:01.195653 (+   129us) write_op.cc:276] Timestamp: P: 1783599661195471 usec, L: 0
0709 12:21:01.195678 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:21:01.232011 (+ 36333us) log.cc:844] Serialized 1298 byte log entry
0709 12:21:01.348308 (+116297us) op_driver.cc:464] REPLICATION: finished
0709 12:21:01.369183 (+ 20875us) write_op.cc:301] APPLY: starting
0709 12:21:01.369285 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:01.369428 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:01.369561 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:01.370167 (+   606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:01.370376 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:01.370424 (+    48us) write_op.cc:312] APPLY: finished
0709 12:21:01.370657 (+   233us) log.cc:844] Serialized 35 byte log entry
0709 12:21:01.370838 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.370933 (+    95us) write_op.cc:454] Released schema lock
0709 12:21:01.370970 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:01.371349 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.371376 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":20567,"apply.run_cpu_time_us":2144,"apply.run_wall_time_us":2150,"num_ops":3,"prepare.queue_time_us":191309,"prepare.run_cpu_time_us":6285,"prepare.run_wall_time_us":77695,"raft.queue_time_us":85330,"raft.run_cpu_time_us":10934,"raft.run_wall_time_us":20954,"replication_time_us":152471,"thread_start_us":214359,"threads_started":4,"wal-append.queue_time_us":28480}]]}
I20260709 12:21:01.512643  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.512499  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.513346  3841 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:21:01.510586  3815 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.769s (SENT)
I20260709 12:21:01.513641  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.469013  3918 rpcz_store.cc:276] 0709 12:20:57.150004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.431361 (+4281357us) service_pool.cc:224] Handling call
0709 12:21:01.447965 (+ 16604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.448206 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.448233 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.448280 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.448312 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.448368 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.448491 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.519659  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.520416  3918 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.522083  3918 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.522773  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1389) took 3610 ms. Trace:
I20260709 12:21:01.523577  5288 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:01.524693  3921 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.523177  3918 rpcz_store.cc:276] 0709 12:20:57.912572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.521258 (+3608686us) service_pool.cc:224] Handling call
0709 12:21:01.521677 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.522471 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.522689 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.525234  3841 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:01.526858  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1396) took 3174 ms. Trace:
I20260709 12:21:01.514411  3917 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.528667  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.512423  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.502426  5293 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.504240  5316 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.498772  5207 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:01.543013  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.543975  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1402) took 2538 ms. Trace:
I20260709 12:21:01.552057  3924 rpcz_store.cc:276] 0709 12:20:58.992955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.529949 (+2536994us) service_pool.cc:224] Handling call
0709 12:21:01.530318 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.530535 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.530585 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.530647 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:01.530690 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.530762 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.530887 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.540490  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:01.562474  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56316.7us
I20260709 12:21:01.571661  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1214) took 4461 ms. Trace:
I20260709 12:21:01.572180  3925 rpcz_store.cc:276] 0709 12:20:57.097411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.355099 (+4257688us) service_pool.cc:224] Handling call
0709 12:21:01.355722 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.503562 (+147840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.552290 (+ 48728us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540036e7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:01.552479 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331314048}
I20260709 12:21:01.573717  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.500411  5277 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.579245  3917 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.575691  5207 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.580215  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1397) took 3210 ms. Trace:
I20260709 12:21:01.580328  5207 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.580988  3964 leader_election.cc:400] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:01.577240  3923 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.580680  3917 rpcz_store.cc:276] 0709 12:20:58.369406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.528962 (+3159556us) service_pool.cc:224] Handling call
0709 12:21:01.574585 (+ 45623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.579804 (+  5219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.580038 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939328}
W20260709 12:21:01.594295  3815 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.775s (SENT)
I20260709 12:21:01.540248  5165 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.550892  5293 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:01.602392  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62403.2us
I20260709 12:21:01.561431  5299 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.510413  5287 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.560813  5316 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.606020  4583 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:01.607967  3920 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.531939  5257 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:21:01.611652  5316 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.608618  3919 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:01.594666  5301 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:01.602877  5213 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.602994  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:01.617302  5318 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:01.595285  5254 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:01.609022  5299 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:01.610221  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1403) took 2616 ms. Trace:
I20260709 12:21:01.628481  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1418) took 2042 ms. Trace:
I20260709 12:21:01.637192  3920 rpcz_store.cc:276] 0709 12:20:58.993407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.576982 (+2583575us) service_pool.cc:224] Handling call
0709 12:21:01.604181 (+ 27199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.609960 (+  5779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.610165 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:01.610371  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 311130us
I20260709 12:21:01.527362  3918 rpcz_store.cc:276] 0709 12:20:58.352448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.525581 (+3173133us) service_pool.cc:224] Handling call
0709 12:21:01.526001 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.526220 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.526323 (+   103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.526513 (+   190us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.526554 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.526649 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.526793 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.637249  3917 rpcz_store.cc:276] 0709 12:20:59.586375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.583740 (+1997365us) service_pool.cc:224] Handling call
0709 12:21:01.587193 (+  3453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.619544 (+ 32351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.628170 (+  8626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.628218 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.628248 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.628311 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.628420 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26867,"raft.queue_time_us":22901,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":19397}
I20260709 12:21:01.639248  5001 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:01.641430  5313 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.643679  5207 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.644308  5318 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:01.644783  5318 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:01.645678  5318 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.646944  5318 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.648576  5277 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:01.649127  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117970us
I20260709 12:21:01.649312  5277 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:01.649430  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.649924  5277 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:01.649827  5251 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:01.606091  3946 debug-util.cc:398] Leaking SignalData structure 0x7b0800168ee0 after lost signal to thread 2680
I20260709 12:21:01.651510  5299 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:01.652380  3946 debug-util.cc:398] Leaking SignalData structure 0x7b08001665c0 after lost signal to thread 3782
W20260709 12:21:01.653666  3946 debug-util.cc:398] Leaking SignalData structure 0x7b080022c940 after lost signal to thread 3874
W20260709 12:21:01.655007  3946 debug-util.cc:398] Leaking SignalData structure 0x7b080024f1a0 after lost signal to thread 3949
I20260709 12:21:01.636955  5254 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:01.655866  5254 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:01.656734  3815 connection.cc:256] RPC call timeout handler was delayed by -1.63715298000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 12:21:01.659245  5282 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.659796  5282 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:01.660127  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.661168  5282 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.662679  5282 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.665835  3921 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.666785  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1395) took 3314 ms. Trace:
I20260709 12:21:01.667254  3921 rpcz_store.cc:276] 0709 12:20:58.351997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.524252 (+3172255us) service_pool.cc:224] Handling call
0709 12:21:01.524582 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.666404 (+141822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.666697 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:01.670243  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.632588  5275 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:01.677899  3815 connection.cc:256] RPC call timeout handler was delayed by -1.5138529799999105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:21:01.678288  3919 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.630460  5304 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.681865  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1423) took 1154 ms. Trace:
I20260709 12:21:01.682008  5001 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:01.662592  5207 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:01.683398  3919 rpcz_store.cc:276] 0709 12:21:00.527024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.633050 (+1106026us) service_pool.cc:224] Handling call
0709 12:21:01.674141 (+ 41091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.681386 (+  7245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.681770 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:01.682883  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78501us
I20260709 12:21:01.689342  3888 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.686430  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:01.693146  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.698346  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.699867  5326 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.687209  5001 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.701087  5001 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.702334  5001 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.703749  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:01.704087  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:01.704447  3919 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.705442  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:01.678087  5283 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.707319  3921 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.716923  3919 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:01.677917  5165 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:01.693908  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:01.764662  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 124926us
I20260709 12:21:01.767794  3916 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:01.716620  3946 debug-util.cc:398] Leaking SignalData structure 0x7b0800262e20 after lost signal to thread 4023
I20260709 12:21:01.671136  5277 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:01.777091  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59633.1us
I20260709 12:21:01.775581  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1407) took 2330 ms. Trace:
I20260709 12:21:01.778760  3923 rpcz_store.cc:276] 0709 12:20:59.444783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.581874 (+2137091us) service_pool.cc:224] Handling call
0709 12:21:01.582276 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.775094 (+192818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.775141 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.775203 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:01.775233 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.775299 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.775498 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49823,"raft.queue_time_us":80884,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9500,"thread_start_us":139186,"threads_started":1}
I20260709 12:21:01.771240  4578 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.793592  3841 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:01.699883  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.796036  5283 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:01.797493  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.776209  5056 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.813905  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:01.815990  4583 raft_consensus.cc:1240] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:01.785969  5251 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:01.774286  5262 ts_tablet_manager.cc:1929] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:01.822279  3841 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:01.822783  3841 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:01.825845  5322 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.821511  5276 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.830114  5322 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.830437  5276 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.830855  5322 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.832490  5327 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:01.833179  5327 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:01.833516  5328 consensus_queue.cc:1059] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:01.834801  5288 raft_consensus.cc:3055] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:01.834259  5327 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.835215  5288 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:01.836175  5308 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.836288  5288 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.837846  5288 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.837869  5308 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:01.830976  5276 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.818830  5257 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.812009  5275 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:01.843611  5262 log.cc:1199] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/7abd4286feba432697849b5bcf582f63
I20260709 12:21:01.845065  5262 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34144 (request call id 72) took 2787 ms. Trace:
I20260709 12:21:01.845136  3849 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:01.845752  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:01.846650  3922 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
W20260709 12:21:01.849817  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 124863us
I20260709 12:21:01.819181  5316 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.855240  5278 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:01.857059  3920 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:01.857245  5316 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:01.845487  5262 rpcz_store.cc:276] 0709 12:20:59.095840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.096102 (+   262us) service_pool.cc:224] Handling call
0709 12:20:59.398864 (+302762us) ts_tablet_manager.cc:1151] Deleting tablet 7abd4286feba432697849b5bcf582f63
0709 12:20:59.398988 (+   124us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:01.288162 (+1889174us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:01.767659 (+479497us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:01.844984 (+ 77325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1071348,"tablet-delete.queue_time_us":179744,"thread_start_us":206395,"threads_started":1}
W20260709 12:21:01.819926  3946 debug-util.cc:398] Leaking SignalData structure 0x7b080034b0a0 after lost signal to thread 4608
W20260709 12:21:01.864190  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 81138.9us
I20260709 12:21:01.819692  5287 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:01.869347  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:01.875988  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55109us
W20260709 12:21:01.858533  3946 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff2a0 after lost signal to thread 4609
I20260709 12:21:01.879627  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:01.882592  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 114111us
I20260709 12:21:01.853466  5185 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:01.883656  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:01.858662  5275 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:01.857322  5307 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:01.847680  5308 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.860252  5304 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:01.858845  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:01.886920  5185 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.895304  5277 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:01.895879  5277 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:01.895743  5185 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.891112  5307 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.897125  5185 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.896898  5277 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.897403  5307 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.898746  5307 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.891906  5275 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.881209  5280 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:01.886566  5299 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.900863  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.906111  5056 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:01.920737  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:01.922217  3921 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:01.922379  5056 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:01.922935  5056 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.924286  5299 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:01.925963  5314 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.299s	user 0.000s	sys 0.003s
I20260709 12:21:01.926241  5254 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.907429  5304 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:01.929129  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46092.2us
I20260709 12:21:01.932516  5300 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.932967  5300 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:01.933211  5280 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:01.933911  5300 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.936616  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:01.937628  5306 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:21:01.936671  3841 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.939103  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:01.939561  3841 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.935233  5275 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:01.940200  5278 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.935222  5300 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.927310  5340 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:21:01.918015  5293 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:01.950850  5293 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:01.958271  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 106) took 1497 ms. Trace:
I20260709 12:21:01.958788  3745 rpcz_store.cc:276] 0709 12:21:00.460589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.460790 (+   201us) service_pool.cc:224] Handling call
0709 12:21:01.958149 (+1497359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:01.444319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:01.459968 (+ 15649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:01.460006 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:21:01.460032 (+    26us) tablet.cc:662] Decoding operations
0709 12:21:01.460523 (+   491us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:01.460578 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:01.460610 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:21:01.484454 (+ 23844us) tablet.cc:701] Row locks acquired
0709 12:21:01.484481 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:21:01.500034 (+ 15553us) write_op.cc:270] Start()
0709 12:21:01.625571 (+125537us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b54003d46a8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc58daf9e1 00007fdc58dae64c 00007fdc5643e624 00007fdc56429286 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901 00007fdc5642cb2d 0000000000388634
0709 12:21:01.663773 (+ 38202us) write_op.cc:276] Timestamp: P: 1783599661497461 usec, L: 0
0709 12:21:01.663810 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:21:01.698062 (+ 34252us) log.cc:844] Serialized 913 byte log entry
0709 12:21:01.703044 (+  4982us) op_driver.cc:464] REPLICATION: finished
0709 12:21:01.703714 (+   670us) write_op.cc:301] APPLY: starting
0709 12:21:01.703811 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:01.703947 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:01.703972 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:01.704352 (+   380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:01.704522 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:21:01.704573 (+    51us) write_op.cc:312] APPLY: finished
0709 12:21:01.704806 (+   233us) log.cc:844] Serialized 29 byte log entry
0709 12:21:01.704994 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.705101 (+   107us) write_op.cc:454] Released schema lock
0709 12:21:01.705140 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:01.705514 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:01.705542 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12301,"reported_tablets":6,"spinlock_wait_cycles":11520,"child_traces":[["op",{"apply.queue_time_us":422,"apply.run_cpu_time_us":1746,"apply.run_wall_time_us":1746,"num_ops":2,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":7150,"prepare.run_wall_time_us":254057,"replication_time_us":32768,"spinlock_wait_cycles":4934016}]]}
I20260709 12:21:01.963874  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:01.965106  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.958947  5254 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:01.968565  3850 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.971494  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 7abd4286feba432697849b5bcf582f63 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:21:01.977936  5278 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:01.959239  5295 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.987639  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.002355  3919 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:02.008575  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 77302.2us
I20260709 12:21:01.980322  3847 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:01.994630  5295 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:02.024737  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 106158us
W20260709 12:21:02.032768  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.036177  4583 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.040349  5338 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:21:02.007860  5056 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:02.062830  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.063237  3844 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:02.030812  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.031764  5313 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.065497  3841 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:02.042065  5338 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:02.045919  4578 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:02.084321  3841 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:21:02.087432  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74156.3us
I20260709 12:21:02.091197  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.089836  3747 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.109699  3747 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.080325  5295 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.116295  5295 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.069624  5313 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.112771  3747 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.080547  5277 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:21:02.120424  5276 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.103379  5171 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.143117  5171 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.142998  5322 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.143632  5171 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.144248  5276 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.145356  5322 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.120098  5311 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:21:02.146422  3964 leader_election.cc:336] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items
I20260709 12:21:02.146864  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:02.148576  3964 leader_election.cc:336] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40568 dropped due to backpressure: service queue is full with 50 items
I20260709 12:21:02.149766  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.150141  5300 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:02.150609  5330 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.136032  3747 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:02.153796  3747 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.155077  3849 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.151162  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:02.120138  5056 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:02.160620  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 72245.8us
I20260709 12:21:02.164397  3964 leader_election.cc:400] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:02.164958  5301 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:02.158897  3747 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:02.168758  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.168958  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.173157  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.174501  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.181296  5308 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.182093  5308 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.182617  5308 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.188123  3964 leader_election.cc:400] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:02.189285  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.190140  5301 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.190583  3964 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3.
I20260709 12:21:02.190558  5301 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.171301  5322 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:02.191217  5301 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.195824  5322 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.196449  5322 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.200837  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.202188  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.204954  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.175470  5056 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:02.209513  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.216569  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.208393  5213 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.206233  5311 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.207764  5276 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:02.221942  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:02.223249  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.222782  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:02.224376  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68507.3us
I20260709 12:21:02.214563  5056 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:02.218140  5307 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:02.226842  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.220976  5213 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.221333  5276 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.221143  5311 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.229292  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.224481  5330 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:02.234517  5325 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.234978  5325 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.235402  5325 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:02.236340  5343 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:21:02.237993  5345 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.238422  5345 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.238797  5345 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.232290  5311 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:02.119014  5275 consensus_queue.cc:1175] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:02.232276  5276 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.244585  5171 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.252432  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.253589  5056 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.256886  5301 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.247526  5171 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.258857  5333 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.259305  5333 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.260226  5333 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.230298  5300 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.231294  5213 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.233031  5330 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.264336  5330 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.262152  3815 leader_election.cc:400] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:02.266288  3815 leader_election.cc:403] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.269955  5308 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.262439  5307 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:02.277474  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:02.280238  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51003.3us
I20260709 12:21:02.262605  5300 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.294857  5307 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:21:02.294826  5276 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.272222  5308 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.288008  5304 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:02.288959  5171 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:02.305019  5311 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.309808  5311 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:02.310479  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.317206  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55439.2us
I20260709 12:21:02.318529  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.321520  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.301071  5300 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.323745  3842 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.296860  5301 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.339433  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.345415  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:02.349089  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.349469  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.320037  5304 raft_consensus.cc:697] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:02.343664  5308 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.360651  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.333844  5325 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.368620  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.369871  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.356351  5185 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.354250  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:02.371462  5334 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.371954  5334 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.372509  5334 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.371886  5304 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.358186  5308 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.379058  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.367805  5301 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:02.392112  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.360810  5323 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:21:02.377571  5254 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.393965  5315 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:02.395807  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.398425  5276 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.399123  5276 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.399509  5276 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:02.399884  5276 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.393347  5301 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.404443  5301 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.405051  3920 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:02.410673  3919 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:02.410682  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.384518  5308 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.375872  5185 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:02.418870  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58282us
I20260709 12:21:02.420676  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.422088  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:02.431387  3842 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:02.407660  5254 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:02.464037  5359 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:21:02.465152  5254 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.418259  5185 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.433566  5251 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.409373  3846 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:02.434376  5335 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:02.468493  3814 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.616s (SENT)
I20260709 12:21:02.417531  5329 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.481248  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.482098  3993 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:02.483098  5276 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.484189  3919 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:21:02.476447  5358 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:21:02.474614  5297 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:02.495126  3998 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:02.495004  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.498487  3993 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:02.475535  5335 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:02.472381  5251 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.470443  5338 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:21:02.489348  5311 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.498721  5278 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:02.506533  5325 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.509298  5345 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.509502  5311 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.510963  5329 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.511540  5311 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:02.511580  5329 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.514387  5329 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.522222  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.522573  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.523109  3991 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:02.523494  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.523792  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.524091  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.524613  3990 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:02.524874  3994 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:02.524983  5329 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:02.525760  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.526343  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.526899  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.523833  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.523109  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.527824  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.528313  5307 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:02.528584  3997 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:02.528827  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.528702  5307 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:02.529589  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.529949  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.530709  3992 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:02.530083  3850 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.497373  5297 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:02.530051  5307 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.532032  5315 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.531929  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:02.532546  5315 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.532335  5297 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.533071  3850 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:02.534065  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:02.534785  3850 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:02.534653  5001 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:02.531929  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.539381  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.540282  5330 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.542548  5001 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:02.532583  3849 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.487852  5322 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.528201  3843 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.544021  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.532608  5307 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.503154  5335 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.545728  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.543315  5338 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.547809  5338 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.548391  5213 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.548931  3843 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:02.551644  3842 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.550927  5288 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:02.551909  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.552848  3996 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:02.554654  5338 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:02.543006  5001 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:02.554031  5185 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.555064  5300 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.556002  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:02.560804  5278 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:02.561780  5277 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:02.564113  3997 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:02.527086  3995 raft_consensus.cc:2368] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:02.556671  5276 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.565145  5300 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.567343  3998 raft_consensus.cc:2368] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 4.
I20260709 12:21:02.533142  5315 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.570344  5185 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.572407  5301 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.576050  3992 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.554376  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:02.577917  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:02.584656  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 85028.8us
I20260709 12:21:02.542966  5330 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.503357  5251 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.600193  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.609537  3996 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:02.551378  5213 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:02.600764  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.612541  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.596361  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.574843  5301 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.613973  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.619697  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.619872  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.614068  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.593616  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:02.625138  3814 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.753s (SENT)
I20260709 12:21:02.632853  3992 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:02.539302  5334 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.643301  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.625944  5288 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:02.693415  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48535.4us
I20260709 12:21:02.623373  5330 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:21:02.696508  5276 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:02.703096  5313 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.735652  5056 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:02.703198  4578 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.626961  5001 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.705034  5345 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.705834  5251 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.641714  5213 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.640035  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.630225  5329 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:02.707846  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.708823  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.710186  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.771667  3999 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:02.710965  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.711692  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.773154  3994 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.610879  5171 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:02.781831  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.782773  3997 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:02.718041  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.785290  3992 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.729072  5333 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:02.730487  5364 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:02.730584  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.733316  5276 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:02.734264  5293 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:02.735064  5312 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:02.738353  5297 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:02.775565  3814 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.863s (SENT)
W20260709 12:21:02.797571  3814 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.892s (SENT)
I20260709 12:21:02.776332  3991 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:02.788079  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 168290us
W20260709 12:21:02.791633  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61140.9us
I20260709 12:21:02.770884  5329 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.794878  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.769747  5213 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.643374  5365 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.140s
I20260709 12:21:02.802804  3999 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.802949  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.800233  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.800570  3850 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:02.804098  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:02.792016  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.804797  3998 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
W20260709 12:21:02.807029  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52707.1us
I20260709 12:21:02.807297  3996 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.806875  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.811722  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.812557  3991 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:02.813074  5369 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:21:02.813453  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.814638  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.815815  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.816594  5251 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.816990  5334 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.817346  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.817813  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:02.818449  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.819595  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.820119  3997 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:02.820293  3815 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:02.820696  5335 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.821343  5310 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:02.822073  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.822882  3992 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:02.824417  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.825060  3992 raft_consensus.cc:2368] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:02.825747  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.826432  3992 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.827854  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.828627  3996 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.829367  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.830054  5322 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:02.815363  3991 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:02.830727  5330 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:02.831631  3991 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.832655  3995 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:02.830075  3996 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:02.820999  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.794909  5056 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:02.821043  3815 raft_consensus.cc:2686] T 7abd4286feba432697849b5bcf582f63 P bd47d64594f743eba2922d79251c1c5c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:02.834658  3997 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.836161  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.793232  5293 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:02.827239  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.836774  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.835474  3991 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:02.838615  3992 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:02.803479  5329 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.831012  5315 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.838474  3991 pending_rounds.cc:85] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 1
I20260709 12:21:02.803218  5213 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.839601  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:02.841995  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:02.833559  5185 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:21:02.842689  3991 pending_rounds.cc:107] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:02.847172  3991 raft_consensus.cc:2889] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.848809  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.798681  5254 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.851150  5185 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:21:02.851460  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.851626  5185 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:02.852636  5185 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.855682  3990 raft_consensus.cc:2410] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:21:02.856801  5367 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:21:02.869068  5315 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.809348  5311 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:02.871531  5056 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.872267  5311 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:02.872669  5311 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:02.872500  5293 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.873660  5311 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.875329  5254 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:02.878104  3994 raft_consensus.cc:2368] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
W20260709 12:21:02.888504  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.894706  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.895767  3992 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:02.896806  3997 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:02.904201  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.839891  5365 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:21:02.899555  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.901047  5345 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:02.905903  5345 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:02.906900  5345 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.901497  5311 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.918237  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:02.935745  3814 leader_election.cc:336] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.062s (SENT)
W20260709 12:21:02.930086  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80880us
I20260709 12:21:02.936343  3997 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:02.936302  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:02.954457  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.957948  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 115984us
I20260709 12:21:02.962746  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.968145  3994 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:02.975126  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.975821  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.978344  5325 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:02.978174  5377 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:02.979044  5325 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:02.979728  5377 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:02.980417  5377 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:02.980083  5325 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.969522  5056 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:02.981559  5377 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.982637  5301 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:02.983508  5377 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.976917  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:02.979635  5293 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.975865  3842 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.990614  4583 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:02.917564  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.944762  5185 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.988647  5001 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.988902  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.988902  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:03.003804  4581 raft_consensus.cc:2393] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:02.989256  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:02.903244  5308 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:02.944067  5365 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.983835  5301 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:02.993800  5330 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.000943  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.029294  3921 raft_consensus.cc:2376] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:03.004743  3919 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:02.960673  5282 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:03.009436  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.010125  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.011924  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:03.012005  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.014086  5308 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.014611  5365 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:03.015167  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.019763  5305 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:03.020285  5278 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.044665  5278 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:02.976480  3845 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:03.008876  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:03.047832  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.048679  3924 raft_consensus.cc:2368] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:03.049082  3996 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:03.050019  5251 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:03.050290  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.031265  3925 raft_consensus.cc:2376] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:03.051077  5300 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:03.031314  3916 raft_consensus.cc:2376] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:03.033460  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.034339  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:02.990731  5335 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:03.035084  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.042819  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.085925  3994 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:03.051334  3996 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:03.053300  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.061738  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.088976  3997 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:03.079495  3991 raft_consensus.cc:2368] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 4.
I20260709 12:21:03.074903  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:03.028986  5301 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:03.026877  5333 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.093078  3924 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:03.051488  5300 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:03.096431  3919 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:03.060412  3918 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.053602  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:03.107182  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.112362  3998 raft_consensus.cc:606] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:03.114013  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:03.114476  3814 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.249s (SENT)
I20260709 12:21:03.114717  3925 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 1.
I20260709 12:21:03.115648  3850 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:03.119055  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.121538  3919 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.109308  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:03.109880  4575 raft_consensus.cc:2410] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:03.091284  5327 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.135787  5327 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.136130  5300 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.137447  5300 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.138780  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 187) took 2639 ms. Trace:
I20260709 12:21:03.101161  5278 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.107569  3991 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:03.132732  5335 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:03.138357  5327 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.103861  5315 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.127135  5301 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.039095  5330 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.140316  3745 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 4, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 4 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.156957  3745 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.158846  3745 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.160429  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.139340  3747 rpcz_store.cc:276] 0709 12:21:00.499336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.499526 (+   190us) service_pool.cc:224] Handling call
0709 12:21:03.138684 (+2639158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:02.362523 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:02.472272 (+109749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:02.475015 (+  2743us) write_op.cc:435] Acquired schema lock
0709 12:21:02.478194 (+  3179us) tablet.cc:662] Decoding operations
0709 12:21:02.483656 (+  5462us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:02.483740 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:02.483769 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:21:02.484323 (+   554us) tablet.cc:701] Row locks acquired
0709 12:21:02.484340 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:21:02.484485 (+   145us) write_op.cc:270] Start()
0709 12:21:02.484613 (+   128us) write_op.cc:276] Timestamp: P: 1783599662484439 usec, L: 0
0709 12:21:02.484636 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:02.501822 (+ 17186us) log.cc:844] Serialized 2464 byte log entry
0709 12:21:02.756688 (+254866us) op_driver.cc:464] REPLICATION: finished
0709 12:21:02.948216 (+191528us) write_op.cc:301] APPLY: starting
0709 12:21:02.948345 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:02.948642 (+   297us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:02.948849 (+   207us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:02.949964 (+  1115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:02.950455 (+   491us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:21:02.950530 (+    75us) write_op.cc:312] APPLY: finished
0709 12:21:02.950922 (+   392us) log.cc:844] Serialized 53 byte log entry
0709 12:21:02.952277 (+  1355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:02.952454 (+   177us) write_op.cc:454] Released schema lock
0709 12:21:02.952531 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:03.004402 (+ 51871us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:03.008631 (+  4229us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":81280,"child_traces":[["op",{"apply.queue_time_us":191215,"apply.run_cpu_time_us":4006,"apply.run_wall_time_us":40301,"num_ops":6,"prepare.queue_time_us":136142,"prepare.run_cpu_time_us":4707,"prepare.run_wall_time_us":148065,"replication_time_us":271902,"thread_start_us":161994,"threads_started":2}]]}
I20260709 12:21:03.161098  5307 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:03.160569  3745 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 4, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 4 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.128268  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.161538  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.162094  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.148639  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.162200  5315 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.163046  3925 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:03.162925  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.163327  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.163700  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.164258  3916 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.164403  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.165009  3991 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:03.166256  5312 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:03.166882  5312 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:03.108877  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.167891  5312 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.167989  3924 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.169855  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.171279  3991 raft_consensus.cc:2368] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:03.172554  5301 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.173840  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.175222  3991 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:03.146994  5376 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:21:03.161012  3922 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.176230  3745 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 4, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 4 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:03.177543  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.169328  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.179801  3923 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.171659  3920 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.149019  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.148285  3842 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:03.152102  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.162274  3917 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.041814  5282 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.150309  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:03.252563  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.301693  3998 raft_consensus.cc:2376] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5. Re-sending same reply.
W20260709 12:21:03.301796  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 151590us
I20260709 12:21:03.302317  3992 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:03.202447  3991 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:03.303205  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.303478  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.303934  3992 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:03.304124  3991 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:03.304728  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:03.185983  3814 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.634s (SENT)
I20260709 12:21:03.305042  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.305408  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:03.305768  3998 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:03.161612  5307 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:03.307745  5307 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.303314  3925 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:03.309059  5307 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.310170  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.311033  3992 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:03.184912  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.311882  3996 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:03.312300  3992 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:03.312651  3992 pending_rounds.cc:85] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 1
I20260709 12:21:03.312872  3992 pending_rounds.cc:107] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:03.313020  3996 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:03.313130  3992 raft_consensus.cc:2889] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:03.191278  3919 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.256255  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.184511  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.314419  3999 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:03.315107  3997 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:03.315764  5254 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:03.316123  3995 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:03.251238  3923 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.294478  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.238158  3922 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.229211  3924 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.266969  5294 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:03.332792  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 146838us
I20260709 12:21:03.189163  3916 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.203231  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.330392  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:03.335713  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.341238  3923 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:03.341212  3921 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.304996  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:03.347607  5329 consensus_meta.cc:287] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.000s
I20260709 12:21:03.352154  3991 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:03.353147  3917 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.354257  3917 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:03.355238  3920 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:03.358269  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.306623  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.361816  3993 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:03.316398  5254 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.144524  5213 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:03.316424  5368 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:03.375016  3923 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:03.393711  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.394297  3923 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.345007  5308 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:03.416971  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.352103  5294 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.477854  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:03.477631  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 172645us
I20260709 12:21:03.452773  3997 raft_consensus.cc:2368] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:03.474392  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:03.495436  3925 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.504066  3991 raft_consensus.cc:2368] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
W20260709 12:21:03.505306  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.429003  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.505903  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.506232  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.506702  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.436800  5382 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:21:03.420038  3921 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.483816  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:03.518894  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.522092  3923 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:03.535811  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.538306  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.506636  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:03.554725  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49521.3us
I20260709 12:21:03.559381  3815 leader_election.cc:400] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:03.564316  3844 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:03.564857  3850 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:03.576529  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:03.411790  5315 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:03.579836  3814 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.543s (SENT)
I20260709 12:21:03.413036  5368 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:03.581493  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.463579  5001 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:03.578539  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.601881  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.588196  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.536190  5334 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:03.417265  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115835us
I20260709 12:21:03.362982  5329 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.558858  5185 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:03.604077  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:03.607075  5377 consensus_meta.cc:287] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.623s	user 0.018s	sys 0.001s
I20260709 12:21:03.601029  5322 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:03.585207  5368 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.584640  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.621014  3993 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:03.628356  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.635921  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:03.647679  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:03.653803  3925 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:03.631351  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.729959  3814 leader_election.cc:336] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.570s (SENT)
W20260709 12:21:03.665818  5389 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:03.666365  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.743110  3993 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.673617  5365 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.679042  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.744727  3848 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:03.687237  5300 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.549s	user 0.001s	sys 0.015s
I20260709 12:21:03.682682  3998 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:03.683303  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.692000  5254 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:03.693239  5315 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:03.696635  5294 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.631063  5185 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:03.697496  5282 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:03.717935  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.718333  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.788657  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:03.787242  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 250703us
I20260709 12:21:03.719833  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.650867  5322 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:03.603488  5001 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.741856  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.803244  3997 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.681416  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:03.804381  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.616606  5334 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.663781  5325 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:03.784210  3889 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.530s (SENT)
I20260709 12:21:03.789321  3992 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.718019  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.811709  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:03.806666  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:03.746594  5301 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.006s
I20260709 12:21:03.789507  3925 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:03.790239  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.822309  3993 raft_consensus.cc:2376] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:03.644565  5377 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 12:21:03.789973  3996 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:03.729725  5330 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:03.763461  5308 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:03.825474  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.794921  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:03.799373  5322 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:03.801630  5385 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.265s	user 0.003s	sys 0.000s
I20260709 12:21:03.822902  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.835711  3992 raft_consensus.cc:2368] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4.
I20260709 12:21:03.829394  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.837136  3997 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.827018  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:03.838585  3996 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.832095  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:03.833321  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:03.759938  5338 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:03.862663  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:03.863497  3993 raft_consensus.cc:2376] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:03.818463  5213 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:03.833989  3995 raft_consensus.cc:2368] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:03.824378  5278 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.009395  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 316567us
I20260709 12:21:03.875052  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.297808  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.298416  3992 raft_consensus.cc:2368] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4.
I20260709 12:21:03.871093  5338 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:04.302022  5368 consensus_meta.cc:287] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
W20260709 12:21:04.297155  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 512958us
I20260709 12:21:04.302470  5368 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:03.948077  3999 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:03.927960  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.305272  5368 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:03.864506  5277 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.306233  5277 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.306931  5278 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.308992  5277 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:04.310118  5278 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:03.861699  5288 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:04.310588  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.002s
I20260709 12:21:03.953611  5399 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.310958  3816 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.025s	sys 0.065s
W20260709 12:21:04.321244  3816 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.026s	sys 0.065s
I20260709 12:21:03.989847  5185 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:04.006376  5293 consensus_meta.cc:287] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.000s
I20260709 12:21:04.200373  5282 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:03.905980  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.861747  5305 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.303426  5338 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.332301  3991 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:04.333568  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.334154  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.318322  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 199431us
W20260709 12:21:04.082912  5398 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:21:04.093637  3918 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.004s
W20260709 12:21:03.938751  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.324047  3814 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.059s (SENT)
I20260709 12:21:04.000659  3997 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:03.831519  5308 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:04.326205  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.000s	sys 0.002s
W20260709 12:21:04.327171  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.340101  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.220335  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.326232  5399 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.336776  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:04.340342  3814 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.123s (SENT)
W20260709 12:21:04.342231  3814 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.155s (SENT)
I20260709 12:21:04.342664  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:04.343156  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.345400  3997 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.048560  5329 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.325448  5334 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:04.353456  3889 leader_election.cc:336] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.533s (SENT)
I20260709 12:21:04.357868  3991 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:04.332652  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 243) took 1279 ms. Trace:
I20260709 12:21:04.359148  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:04.360059  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 712453us
I20260709 12:21:04.361014  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1477) took 1025 ms. Trace:
I20260709 12:21:04.362833  3916 rpcz_store.cc:276] 0709 12:21:03.335361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.340130 (+  4769us) service_pool.cc:224] Handling call
0709 12:21:03.340587 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.367169 (+ 26582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.367239 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.419045 (+ 51806us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.634237 (+215192us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:03.684643 (+ 50406us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b480021c258. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:21:03.752619 (+ 67976us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.761073 (+  8454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.761179 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.360727 (+599548us) raft_consensus.cc:1685] finished
0709 12:21:04.360822 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.360954 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39007,"prepare.queue_time_us":121488,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":52170,"raft.run_cpu_time_us":3802,"raft.run_wall_time_us":270503,"spinlock_wait_cycles":12869888,"thread_start_us":155169,"threads_started":1,"wal-append.queue_time_us":382143}
I20260709 12:21:04.364068  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.341099  5308 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.365271  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.368922  3991 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:04.369197  3997 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:04.369429  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.342628  3918 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.355261  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:04.382939  3991 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:04.333457  5282 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.347747  3990 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:04.359788  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:04.353655  5413 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:04.394716  3889 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.542s (SENT)
W20260709 12:21:04.399267  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.409139  3991 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:04.369052  5368 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:04.413009  3889 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.554s (SENT)
I20260709 12:21:04.381042  5056 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.378455  5305 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.415961  4575 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:04.393158  5322 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.362550  4578 rpcz_store.cc:276] 0709 12:21:03.051891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.052130 (+   239us) service_pool.cc:224] Handling call
0709 12:21:03.052953 (+   823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:03.053740 (+   787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.053781 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:03.171110 (+117329us) log.cc:844] Serialized 520 byte log entry
0709 12:21:03.391560 (+220450us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:03.416998 (+ 25438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.434003 (+ 17005us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.964825 (+530822us) raft_consensus.cc:1685] finished
0709 12:21:03.978258 (+ 13433us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.330914 (+352656us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":186255,"threads_started":1,"wal-append.queue_time_us":332519}
W20260709 12:21:04.412834  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.424567  3994 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:04.419867  5368 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.425726  5368 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.412285  5392 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.421981  3889 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.554s (SENT)
I20260709 12:21:04.396878  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1457) took 1386 ms. Trace:
W20260709 12:21:04.422767  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53428.4us
I20260709 12:21:04.369623  5377 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:21:04.429740  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.430114  3848 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:04.431051  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:04.432019  3997 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:04.431672  5392 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.434274  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.422648  5056 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.445674  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.447907  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:04.450385  5001 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.453166  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:04.515883  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 93932.3us
W20260709 12:21:04.516054  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63002.1us
W20260709 12:21:04.517040  3889 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.560s (SENT)
I20260709 12:21:04.517186  5304 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.517520  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.517865  5418 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.450439  5399 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:04.518841  3889 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.581s (SENT)
I20260709 12:21:04.519105  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:04.517807  5304 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.519661  5305 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.519841  3916 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:21:04.521364  5304 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:04.521797  5282 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.436034  5322 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.432999  3918 rpcz_store.cc:276] 0709 12:21:03.008063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.008269 (+   206us) service_pool.cc:224] Handling call
0709 12:21:04.394298 (+1386029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:04.519325  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.527865  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.529121  3999 raft_consensus.cc:2376] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:04.530015  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.529579  5322 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:04.523908  3990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 566) took 1606 ms (client timeout 1554 ms). Trace:
W20260709 12:21:04.531613  3990 rpcz_store.cc:269] 0709 12:21:02.917001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.917239 (+   238us) service_pool.cc:224] Handling call
0709 12:21:04.523719 (+1606480us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400209754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:04.523830 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3096627072}
W20260709 12:21:04.532402  3814 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.689s (SENT)
I20260709 12:21:04.532706  5282 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.532948  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.533336  5254 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:04.533849  5254 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:04.538430  5407 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:21:04.515538  5413 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:04.541385  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.542500  5392 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:04.546105  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.543061  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1481) took 1183 ms. Trace:
I20260709 12:21:04.546753  3996 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.546651  3921 rpcz_store.cc:276] 0709 12:21:03.359971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.508852 (+148881us) service_pool.cc:224] Handling call
0709 12:21:03.509290 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.559169 (+ 49879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.559200 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.580736 (+ 21536us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.992092 (+411356us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:04.320070 (+327978us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.321436 (+  1366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.321529 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.541064 (+219535us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b180015d480. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:04.542794 (+  1730us) raft_consensus.cc:1685] finished
0709 12:21:04.542894 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.543006 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54409,"prepare.queue_time_us":327767,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":55736,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":15565,"spinlock_wait_cycles":7712512,"thread_start_us":371316,"threads_started":1,"wal-append.queue_time_us":718227}
I20260709 12:21:04.549162  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.549784  3997 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.550632  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.551235  5282 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:04.442193  5374 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 12:21:04.551800  5282 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.552570  3993 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:04.552863  5385 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:21:04.553992  3889 leader_election.cc:336] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.638s (SENT)
I20260709 12:21:04.554708  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.445029  5288 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.515853  3994 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.532899  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:04.517045  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.525096  5056 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.553534  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.539423  3999 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.580901  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:04.556299  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:04.578020  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45644.4us
W20260709 12:21:04.600782  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46817.1us
I20260709 12:21:04.572386  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:04.562604  5377 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.605372  5392 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:04.601550  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1485) took 1237 ms. Trace:
W20260709 12:21:04.580232  5325 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 12:21:04.605845  5392 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.606529  5392 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.602192  3994 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:04.605274  5377 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.605996  3920 rpcz_store.cc:276] 0709 12:21:03.364196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.670794 (+306598us) service_pool.cc:224] Handling call
0709 12:21:03.671186 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.671630 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.671664 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.672195 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.022281 (+350086us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:04.022322 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.022392 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.537639 (+515247us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:04.601121 (+ 63482us) raft_consensus.cc:1685] finished
0709 12:21:04.601152 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.601417 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12339,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":22929280,"thread_start_us":349689,"threads_started":1,"wal-append.queue_time_us":693461}
I20260709 12:21:04.566018  5213 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:04.556926  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.603996  3921 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:04.570063  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1484) took 1209 ms. Trace:
I20260709 12:21:04.607318  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:04.577677  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60723.1us
I20260709 12:21:04.572911  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.610795  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.515600  3850 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:04.611891  5411 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.610013  3923 rpcz_store.cc:276] 0709 12:21:03.360854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.524656 (+163802us) service_pool.cc:224] Handling call
0709 12:21:03.524891 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.588446 (+ 63555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.588496 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.602131 (+ 13635us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.698585 (+ 96454us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b480021c258. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:21:04.326209 (+627624us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:04.366346 (+ 40137us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.569265 (+202919us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18003b99e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc525a9d70 00007fdc5259d293 00007fdc52592cea 00007fdc5259323a 00007fdc529fda2a 00007fdc52a0d0bf 00007fdc52a0d038
0709 12:21:04.569603 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.569712 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.569770 (+    58us) raft_consensus.cc:1685] finished
0709 12:21:04.569790 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.569980 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180041,"prepare.queue_time_us":41398,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":26514,"raft.run_cpu_time_us":1320,"raft.run_wall_time_us":114264,"spinlock_wait_cycles":16354944,"thread_start_us":405635,"threads_started":1,"wal-append.queue_time_us":739582}
W20260709 12:21:04.604875  3889 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.644s (SENT)
I20260709 12:21:04.612886  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:04.614020  3889 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.645s (SENT)
I20260709 12:21:04.614346  5411 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:04.614936  3889 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.649s (SENT)
I20260709 12:21:04.615423  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.603996  3996 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.614890  5411 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.616434  5418 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.616782  5421 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.617391  5411 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.617843  5418 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.618775  5421 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:04.619334  5421 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.616458  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.620296  5421 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.609198  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:04.623050  3848 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:21:04.624599  3814 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.916s (SENT)
I20260709 12:21:04.625164  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:04.497360  4547 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.557s (SENT)
I20260709 12:21:04.626996  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:04.628290  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 131016us
I20260709 12:21:04.452333  3998 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:04.454672  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:04.636987  3889 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.663s (SENT)
I20260709 12:21:04.639089  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.640273  3991 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.641443  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.644855  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:04.576113  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.600961  5282 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.606518  5325 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.648461  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.646756  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:04.654080  3889 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.664s (SENT)
I20260709 12:21:04.634430  5399 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.658700  3999 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.685609  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.686686  3999 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.659140  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.640689  5288 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.682686  3991 raft_consensus.cc:2368] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:04.682134  3994 raft_consensus.cc:2376] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4. Re-sending same reply.
I20260709 12:21:04.636039  5304 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.691848  3999 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:04.691830  3992 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.694211  3997 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:04.684980  5338 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.688968  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:04.640909  5213 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.697916  5213 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:04.698205  3990 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.659580  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:04.701030  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55071us
I20260709 12:21:04.701148  5393 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:04.702244  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48186.9us
W20260709 12:21:04.702837  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 78271.7us
I20260709 12:21:04.705432  3991 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:04.707598  3998 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.711042  4583 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:04.701614  5393 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.651568  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:04.655884  5413 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.717444  5377 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:04.718173  5325 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.576067  5254 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.718911  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:04.719475  5254 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.719772  3850 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
W20260709 12:21:04.713482  3889 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.685s (SENT)
I20260709 12:21:04.720582  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.720978  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.723682  3993 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.725678  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.728080  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:04.728411  3889 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.694s (SENT)
I20260709 12:21:04.728881  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.729740  5288 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:04.729924  3889 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.760s (SENT)
I20260709 12:21:04.714762  5393 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:04.734370  3814 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.026s (SENT)
I20260709 12:21:04.731863  3994 raft_consensus.cc:2376] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
W20260709 12:21:04.732931  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.741135  3889 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.827s (SENT)
I20260709 12:21:04.742004  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.741261  3994 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:04.734074  5304 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:04.753032  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.730213  3849 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:04.732299  3995 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:04.756202  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:04.761543  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:04.767638  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.775784  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 165054us
I20260709 12:21:04.776664  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.754921  5297 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:04.782124  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45079.6us
W20260709 12:21:04.786327  3889 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.832s (SENT)
I20260709 12:21:04.786922  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.779719  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.771476  5282 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:04.795573  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:04.798756  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.800490  5304 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:04.802888  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.781510  5377 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:04.807296  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.717453  5413 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:04.817062  4547 leader_election.cc:336] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.871s (SENT)
W20260709 12:21:04.817632  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.817571  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:04.802016  5322 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.796964  5282 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:04.786207  5308 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.806049  5425 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.827114  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.830623  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:04.831346  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45064.9us
W20260709 12:21:04.832103  3889 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.891s (SENT)
I20260709 12:21:04.832494  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:04.834672  5304 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.835628  5322 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.835970  5308 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:04.824429  5368 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:04.836704  5322 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.837231  5368 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.838122  5368 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.839920  5425 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.835719  3843 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:04.842303  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.842173  5425 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:04.842868  3993 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:04.824728  5282 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.845165  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.845268  3999 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:04.841118  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 91504.4us
W20260709 12:21:04.859614  3889 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.916s (SENT)
I20260709 12:21:04.859697  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:04.845906  5308 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:04.846503  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.861840  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:04.864028  3889 leader_election.cc:336] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.935s (SENT)
I20260709 12:21:04.879499  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:04.882627  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.845763  3993 raft_consensus.cc:2376] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:04.868130  5431 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:04.870092  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.887804  3994 raft_consensus.cc:2376] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
W20260709 12:21:04.899567  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.864539  5278 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.870806  5308 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.889531  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.907176  3889 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.019s (SENT)
I20260709 12:21:04.887530  5431 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.909772  3814 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.053s (SENT)
I20260709 12:21:04.912871  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:04.891695  5304 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:04.917111  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:04.919318  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:04.934832  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.920929  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:04.908705  5308 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.926522  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:04.939878  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80271.4us
I20260709 12:21:04.946765  3991 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:04.952898  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.953512  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.953567  3997 raft_consensus.cc:2376] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:04.954151  3991 raft_consensus.cc:2376] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:04.910509  5377 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:04.920248  5432 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.914710  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.958266  3995 raft_consensus.cc:2376] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:04.952114  5305 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:04.928788  5411 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:04.921782  5419 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.300s	user 0.005s	sys 0.000s
I20260709 12:21:04.916731  5431 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.972683  5282 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:04.959312  5305 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.994892  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:04.996269  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:04.998034  4583 raft_consensus.cc:1217] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 12:21:04.998592  4583 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:04.998657  3920 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:04.998819  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:04.999300  5282 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:05.000028  5427 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:21:05.000274  4575 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:21:05.000682  4575 pending_rounds.cc:85] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 4
I20260709 12:21:05.000928  4575 pending_rounds.cc:107] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:21:05.001391  4575 raft_consensus.cc:2889] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.001776  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:05.003782  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.005982  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:05.015399  4547 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.982s (SENT)
I20260709 12:21:05.017464  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:05.019107  3889 leader_election.cc:336] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.848s (SENT)
I20260709 12:21:05.021306  3848 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:05.023896  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.025163  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:05.022336  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 112624us
I20260709 12:21:04.922881  5393 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.037599  3919 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.039745  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:05.040822  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47134.7us
I20260709 12:21:05.047649  3923 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.007648  5305 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.053201  3920 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:21:05.053406  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 178017us
I20260709 12:21:05.055903  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.056746  3916 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.058096  5393 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:05.058936  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.059589  5436 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.060070  3918 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.019861  5392 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.060977  5377 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.062211  4578 raft_consensus.cc:2368] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:05.063205  5392 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:05.045475  5432 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:05.063882  5432 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:05.064821  5432 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.068413  5282 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.069048  5282 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.075129  5282 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:05.076419  5431 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.078258  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 107) took 2596 ms. Trace:
I20260709 12:21:05.078616  5431 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:05.078714  5308 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.081025  5308 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:05.081935  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:05.082263  4547 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.020s (SENT)
W20260709 12:21:05.083841  4547 leader_election.cc:336] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.022s (SENT)
I20260709 12:21:05.083770  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:05.084329  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:05.084848  5433 raft_consensus.cc:2764] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:21:05.019387  5275 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:04.991532  5213 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:21:05.098253  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.103668  3920 raft_consensus.cc:2410] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:05.100889  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.100201  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.107262  3921 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.120312  3923 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:05.125687  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.129094  3924 raft_consensus.cc:1217] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 12:21:05.129654  3924 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:05.130815  3924 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.131735  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.087890  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.132350  3917 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.132895  3922 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.088501  5277 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:05.135033  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.078796  3745 rpcz_store.cc:276] 0709 12:21:02.481412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.481608 (+   196us) service_pool.cc:224] Handling call
0709 12:21:05.078168 (+2596560us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:03.440864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:03.441620 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:03.441668 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:21:03.441694 (+    26us) tablet.cc:662] Decoding operations
0709 12:21:03.442571 (+   877us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:03.442664 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:03.442701 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:03.615720 (+173019us) tablet.cc:701] Row locks acquired
0709 12:21:03.618832 (+  3112us) write_op.cc:260] PREPARE: finished
0709 12:21:03.629430 (+ 10598us) write_op.cc:270] Start()
0709 12:21:03.645987 (+ 16557us) write_op.cc:276] Timestamp: P: 1783599663625909 usec, L: 0
0709 12:21:03.652284 (+  6297us) op_driver.cc:348] REPLICATION: starting
0709 12:21:03.704837 (+ 52553us) log.cc:844] Serialized 2054 byte log entry
0709 12:21:03.706917 (+  2080us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529eee28 00007fdc56429581 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901 00007fdc5642cb2d 0000000000388634 0000000000388479
0709 12:21:04.397540 (+690623us) op_driver.cc:464] REPLICATION: finished
0709 12:21:04.656078 (+258538us) write_op.cc:301] APPLY: starting
0709 12:21:04.656188 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:04.656365 (+   177us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:04.656395 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:04.657197 (+   802us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:04.657448 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:04.657519 (+    71us) write_op.cc:312] APPLY: finished
0709 12:21:04.657839 (+   320us) log.cc:844] Serialized 47 byte log entry
0709 12:21:04.712094 (+ 54255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:04.712236 (+   142us) write_op.cc:454] Released schema lock
0709 12:21:04.716001 (+  3765us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:04.716417 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:04.716445 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134499,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":245485,"apply.run_cpu_time_us":2712,"apply.run_wall_time_us":60350,"num_ops":5,"prepare.queue_time_us":201878,"prepare.run_cpu_time_us":7096,"prepare.run_wall_time_us":266288,"replication_time_us":713976,"spinlock_wait_cycles":95445248,"thread_start_us":376352,"threads_started":2}]]}
W20260709 12:21:05.137292  4547 leader_election.cc:336] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.057s (SENT)
I20260709 12:21:05.154675  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:05.111774  3747 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.154053  3925 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.156901  3747 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.158108  3747 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:05.161401  3923 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.155193  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.161898  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.164181  3925 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:05.164834  3917 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.165766  3747 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:05.167872  3921 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:05.167299  3747 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.169785  3747 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.171666  3747 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:05.144604  5278 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:05.096585  5275 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.145346  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.194377  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.180982  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.195173  3925 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.189917  4547 leader_election.cc:336] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.072s (SENT)
I20260709 12:21:05.195761  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:05.193039  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:05.194314  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.163542  5431 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:05.224511  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.225267  3917 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.195889  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.226599  3923 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.199143  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.228781  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.229605  3924 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:05.230597  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:05.199672  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.200438  3920 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.231287  3924 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.207821  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.233007  3919 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:05.233877  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:05.234293  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 192540us
I20260709 12:21:05.207154  3921 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.236402  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.236948  3921 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.237171  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.235337  3922 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.240425  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.232373  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.241925  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.242501  3920 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.242514  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68996.3us
W20260709 12:21:05.229115  3889 leader_election.cc:336] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.020s (SENT)
I20260709 12:21:05.249217  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.234463  3919 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.255116  3917 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.256847  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.262920  3916 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.274000  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44930us
W20260709 12:21:05.257778  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.255298  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.256661  4581 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:05.261936  3925 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:05.274718  3889 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.026s (SENT)
I20260709 12:21:05.287926  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.242645  5277 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.289636  4583 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:05.257014  3996 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
W20260709 12:21:05.291393  3889 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.028s (SENT)
I20260709 12:21:05.291893  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.293581  3924 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.294502  3921 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.296344  3919 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:05.299052  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.299865  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.178939  5440 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 12:21:05.234930  3990 raft_consensus.cc:2376] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2. Re-sending same reply.
I20260709 12:21:05.302776  3923 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:05.306439  3922 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.308521  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.279011  5432 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:05.375099  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.375666  3920 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:05.377164  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.379539  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.305326  5282 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.392560  5275 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:05.388917  3916 raft_consensus.cc:2410] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:05.377192  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.397564  4576 raft_consensus.cc:2368] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:05.398337  5297 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.401086  3998 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:21:05.401503  3998 pending_rounds.cc:85] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 4
I20260709 12:21:05.401739  3998 pending_rounds.cc:107] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:05.401921  3995 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.401968  3998 raft_consensus.cc:2889] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.403862  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.404649  3991 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.404995  3991 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:05.405858  3991 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.406854  3991 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.396718  5446 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:05.411161  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.412118  4578 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:05.416548  3991 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:21:05.417073  3991 pending_rounds.cc:85] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 4
I20260709 12:21:05.417282  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.418185  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.418426  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.417307  3991 pending_rounds.cc:107] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:05.419327  3998 raft_consensus.cc:2376] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3. Re-sending same reply.
I20260709 12:21:05.418187  4583 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:05.420094  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.420183  5185 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.422600  3991 raft_consensus.cc:2889] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.422816  5185 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:05.423933  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.423832  5185 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.424880  3990 raft_consensus.cc:2368] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3.
I20260709 12:21:05.425155  5185 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.425972  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.426743  4578 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:05.427011  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.420277  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.427736  3990 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:05.428013  3994 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.424008  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.420892  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.429075  4575 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.429793  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.430241  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.411240  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.424974  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.432791  3995 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.433534  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.433729  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:05.433887  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.434302  3994 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.434736  5297 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.437423  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.440512  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.441475  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.442364  3994 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:05.441542  3916 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 1.
I20260709 12:21:05.443397  3890 leader_election.cc:400] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:05.444661  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.427873  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:05.446393  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:05.452867  5444 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:21:05.453047  5393 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:05.453655  5393 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.455670  5399 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:05.456314  5399 raft_consensus.cc:697] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:05.456928  5449 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:21:05.457299  5399 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:05.458638  5443 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.002s
W20260709 12:21:05.461232  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.462816  3994 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
W20260709 12:21:05.477640  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 346984us
W20260709 12:21:05.480443  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 189070us
W20260709 12:21:05.481168  3889 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.060s (SENT)
I20260709 12:21:05.481654  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:05.482120  3889 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.082s (SENT)
I20260709 12:21:05.482264  3994 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.499919  3994 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:05.501600  3889 leader_election.cc:336] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.130s (SENT)
I20260709 12:21:05.503546  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.504431  3994 raft_consensus.cc:2368] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
W20260709 12:21:05.504735  3889 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.137s (SENT)
I20260709 12:21:05.462589  5305 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.479183  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:05.508193  3889 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.149s (SENT)
I20260709 12:21:05.510092  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.515573  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:05.516263  3848 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.475943  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:05.519287  3889 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.158s (SENT)
I20260709 12:21:05.520918  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.523051  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:05.519853  5297 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:05.525060  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:05.525758  3849 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.508488  5393 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:05.504240  4575 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:05.530575  3848 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:05.530608  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.531705  3991 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.532269  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:05.532967  3843 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.503504  5418 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:21:05.533267  3815 leader_election.cc:400] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:05.536630  3815 leader_election.cc:403] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:21:05.531713  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 401924us
I20260709 12:21:05.535306  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:05.536356  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.538537  3994 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:05.503264  5322 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:21:05.542182  3849 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:05.542297  3889 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.170s (SENT)
I20260709 12:21:05.544312  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.545315  3994 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.548561  5426 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:05.549507  5426 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.549849  5426 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:05.558568  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.559165  3889 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.203s (SENT)
I20260709 12:21:05.559374  5432 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.560010  3889 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.221s (SENT)
I20260709 12:21:05.560434  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:05.561554  3889 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.234s (SENT)
I20260709 12:21:05.550727  5426 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:05.562254  3889 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.275s (SENT)
I20260709 12:21:05.562642  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.563035  5426 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.564030  5282 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.533697  5275 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:05.567306  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:05.539362  5297 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:05.540843  5433 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:05.576128  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.576537  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.576941  3996 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:05.563637  5456 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.578387  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.543927  5434 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:21:05.582299  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.579340  3993 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:05.584993  3994 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:05.571830  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.572377  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.572713  5436 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.573541  4576 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.573953  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.546612  5413 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:05.577188  3998 raft_consensus.cc:2376] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5. Re-sending same reply.
I20260709 12:21:05.568789  5275 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:05.533215  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 70735.8us
I20260709 12:21:05.591807  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.588850  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.587384  3995 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:05.590408  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.594380  3997 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.594671  3991 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:05.589023  3843 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:05.596269  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:05.596939  3847 raft_consensus.cc:606] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:05.559967  5432 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.594965  5440 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:21:05.593258  5411 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:21:05.599468  5322 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.604386  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.605134  3997 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:05.611685  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:05.614158  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.614904  3848 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.615710  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:05.616240  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.617359  3991 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.614965  3997 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:05.588557  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.599920  5322 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.617307  3998 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:05.591403  5275 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.622498  5392 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:05.627883  5448 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:21:05.627689  5431 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:05.616484  5439 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:21:05.591552  5436 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:05.629745  4576 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:05.630170  4577 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.596329  5453 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:21:05.630913  5447 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:05.618423  5433 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.631810  5447 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.595178  5456 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:05.632222  5447 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:05.627751  5392 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:05.633777  5423 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:05.634413  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.634828  5392 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.638077  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.630956  5436 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.631834  5433 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.635365  5423 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.640148  3922 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:05.640798  5411 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:21:05.657908  5411 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.658299  5411 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.633128  5447 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.643044  5277 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:05.639407  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.641676  5434 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.666997  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:05.673907  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:05.674810  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50358.9us
I20260709 12:21:05.676869  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:05.677748  5297 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:05.678364  5297 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:05.678009  5282 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:05.643728  5423 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.680370  5423 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.640954  5393 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:05.681697  5423 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.642930  5433 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.643934  5305 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:05.682806  5377 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:05.644882  5439 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.683414  5433 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.683746  5439 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.684015  3848 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:05.643220  5308 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.684552  5308 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.682667  3843 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.684633  5439 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.685441  5308 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.686003  5439 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.686851  5308 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.645818  5056 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:21:05.689779  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:05.696529  3994 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:05.645174  5452 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:21:05.645344  5440 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:05.704926  5440 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.661151  5447 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.710549  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 148294us
W20260709 12:21:05.713204  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.672029  5434 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:05.723585  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.729964  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.740823  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.744861  3916 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [1.4-3.5]
I20260709 12:21:05.659106  5411 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.699921  5392 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.751468  3918 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.751459  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.752249  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:05.689558  5368 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:21:05.753222  5377 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.753996  3925 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.754411  3917 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.768486  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.769200  3922 raft_consensus.cc:2368] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:05.705981  5440 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.647212  5421 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:21:05.644407  5453 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:21:05.689007  5297 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:05.760334  5304 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:05.753376  3921 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.777043  3925 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.777529  3921 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.762413  3916 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:05.654647  5458 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:21:05.765342  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:05.786327  3924 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.773257  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.774191  3917 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.789507  3921 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.791141  3917 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.792364  3921 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.778420  3925 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.779877  5440 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:05.810966  3843 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.814345  3922 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.785439  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:05.769738  5432 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:05.827767  3924 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:05.763077  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.787642  5411 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.709438  5322 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.834126  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:05.836298  3998 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.839835  3991 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.842506  3991 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.847311  3994 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.847739  3994 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:05.847980  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.848613  3994 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:05.849788  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.850522  3998 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:05.848929  5305 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:05.852679  3997 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.856812  3997 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:05.853796  3995 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:05.825580  5277 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.866130  3994 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.830113  5297 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:05.877396  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.858059  3997 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.833927  4577 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.826063  5451 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 12:21:05.887840  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 111849us
I20260709 12:21:05.889436  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:05.897782  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.785343  5434 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.863600  5453 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.898877  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:05.895766  3997 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:05.901297  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.905194  3994 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:05.903370  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.913417  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:05.914247  3992 raft_consensus.cc:606] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:05.914678  3992 raft_consensus.cc:614] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:05.906260  5254 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:05.906630  5322 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.904382  5453 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:05.849561  5460 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:21:05.927316  3997 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:05.935561  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.896838  5185 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:21:05.937938  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.940460  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.910969  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 162745us
W20260709 12:21:05.943061  5464 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:21:05.883335  4576 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:05.926841  3990 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:05.936545  5473 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:05.980885  3990 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:05.878942  5377 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.956429  5254 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:21:05.988453  5254 consensus_queue.cc:1243] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:05.944017  5465 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:05.944545  3845 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:05.945050  3843 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.948050  3848 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.952112  3847 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:05.921988  5434 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:05.956073  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 57243.8us
W20260709 12:21:05.965068  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.968288  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.011305  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:05.975064  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.012677  3964 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:06.012998  3964 leader_election.cc:403] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:06.013372  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.979775  5453 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:05.986953  5275 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:06.017294  5462 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:21:06.028625  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
W20260709 12:21:06.028007  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 200092us
I20260709 12:21:06.027426  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.020478  5185 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:21:06.018393  5254 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:06.026516  5453 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.048019  3846 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:06.058982  3992 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:06.063661  3992 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:06.063124  4581 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:06.053581  5451 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:06.071090  5451 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:06.069093  5304 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:06.073230  5304 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:06.069108  5483 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:06.060286  5254 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:06.074550  5254 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.074666  5483 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:06.067243  5474 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:21:06.065949  5413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34144 (request call id 71) took 13712 ms. Trace:
W20260709 12:21:06.090095  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 62729.6us
I20260709 12:21:06.101402  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.102742  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.108124  5393 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:21:06.100255  5413 rpcz_store.cc:276] 0709 12:20:52.354646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.354874 (+   228us) service_pool.cc:224] Handling call
0709 12:20:52.424925 (+ 70051us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54004d24a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52970520 00007fdc529f9b42 00007fdc529f8800 00007fdc529f19fa 00007fdc579b94c9 00007fdc50f35c54 00007fdc50f35be2 00007fdc50f35b11 00007fdc50f35a8c 00007fdc50f34d42
0709 12:20:52.440427 (+ 15502us) log.cc:844] Serialized 494 byte log entry
0709 12:20:52.557841 (+117414us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b18003a62a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc5294cb0b 00007fdc529d1b63 00007fdc529f9752 00007fdc529f19fa
0709 12:20:52.610326 (+ 52485us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b54004d24a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52968dbe 00007fdc52973930 00007fdc529738d8 00007fdc52973858 00007fdc52973813 00007fdc52972a9c 00007fdc5885e2f6 00007fdc58858aa8 00007fdc529af7cb 00007fdc529b22c0
0709 12:20:52.656001 (+ 45675us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54004d24a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52969aaa 00007fdc52968dd9 00007fdc52973930 00007fdc529738d8 00007fdc52973858 00007fdc52973813 00007fdc52972a9c 00007fdc5885e2f6 00007fdc58858aa8 00007fdc529af7cb
0709 12:21:06.062642 (+13406641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19376,"raft.queue_time_us":47768,"raft.run_cpu_time_us":1705,"raft.run_wall_time_us":40416,"spinlock_wait_cycles":121337088,"thread_start_us":71575,"threads_started":1,"wal-append.queue_time_us":82017,"wal-append.run_cpu_time_us":6839,"wal-append.run_wall_time_us":1135599}
W20260709 12:21:06.120047  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 70502.7us
I20260709 12:21:06.132519  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:06.133251  3992 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:06.133699  3992 raft_consensus.cc:614] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:06.132059  5185 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.149027  5185 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:06.149484  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.142275  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff4bdec26d3e4879bd33a92daad5d607 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:06.156960  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:06.157775  3992 raft_consensus.cc:606] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:06.158144  3992 raft_consensus.cc:614] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:06.160012  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:06.162039  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:06.165082  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:06.165575  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.172040  4577 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:06.176031  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:06.178198  5056 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:06.178792  5056 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:06.179913  5056 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.192615  5469 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:06.193238  5469 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:06.194204  5469 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.197011  5432 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:06.197727  5432 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:06.215638  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 100863us
W20260709 12:21:06.243521  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.273468  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.279570  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:06.296695  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.309499  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 195994us
I20260709 12:21:06.261091  5056 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.190847  3990 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.324143  3990 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.278976  5469 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:06.329607  3847 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:06.198820  5432 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.281924  5297 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.334884  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 279218us
W20260709 12:21:06.339099  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.345454  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.336686  5447 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.000s
W20260709 12:21:06.354292  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.367872  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.390285  5254 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.390940  3990 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.391877  5492 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.392712  5492 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:06.394138  5492 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.394902  5492 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.340965  5297 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.334498  5185 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.343330  5434 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.398772  5185 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:06.400336  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.398916  5434 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:06.404225  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67490us
I20260709 12:21:06.395241  5492 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:06.406023  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59311.3us
I20260709 12:21:06.406518  3889 leader_election.cc:400] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
W20260709 12:21:06.406833  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.406987  3889 leader_election.cc:403] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:06.407859  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 128396us
I20260709 12:21:06.408623  3889 leader_election.cc:400] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:06.408970  3889 leader_election.cc:403] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:06.421010  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:06.422811  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.432001  5499 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:06.431993  5453 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:06.437294  5492 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.437666  5453 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.440721  5453 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.441877  5492 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.443671  5501 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:06.444007  5475 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:06.445254  5475 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.445643  5475 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:06.445890  5254 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:06.446938  5467 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:06.446596  5475 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.447973  5434 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.448112  5475 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.451696  3848 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:06.425752  5213 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:06.455929  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.461326  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.447388  5467 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:06.453387  5282 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:06.455101  5500 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.478475  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.480131  5436 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.478219  5213 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:06.488106  5496 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.273s	user 0.002s	sys 0.002s
I20260709 12:21:06.481488  5254 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.492442  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:06.496554  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.484402  5490 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:06.502853  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.505354  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.507652  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.483964  5467 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.516610  5399 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:06.517413  5502 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:06.518293  5275 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.516443  5453 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:06.519488  5465 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:06.505842  5490 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:06.526688  5421 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:06.528895  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.529364  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.529752  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.531204  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.531267  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:06.525071  5434 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:06.508566  5254 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.511510  5213 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.506615  5469 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:06.545688  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.546152  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 137671us
I20260709 12:21:06.547724  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.549443  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.550514  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.556855  3889 leader_election.cc:400] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:06.557317  3889 leader_election.cc:403] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:06.559271  3997 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:06.563476  3995 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.563241  3998 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.564855  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:06.565702  3995 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:06.566648  5056 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:06.564822  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:06.567303  3995 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:06.571376  3993 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:06.572141  3995 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.573467  3995 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.523623  5425 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:21:06.541428  5456 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.546294  5483 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:06.579255  5509 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:06.583228  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:06.554749  5421 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:21:06.583657  5490 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.555243  5499 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.555671  5254 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.555511  5501 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.585793  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:06.602099  3815 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.505s (SENT) [suppressed 102 similar messages]
I20260709 12:21:06.553694  5467 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:06.575366  5504 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:06.555846  5213 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.553488  5497 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:06.572633  5469 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:06.546155  5413 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:21:06.597829  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.602953  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.579715  5282 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.606985  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.585955  5483 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:06.623876  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.629105  5501 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.633668  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.637006  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:06.637323  5297 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.654870  5500 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:06.659811  3918 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:21:06.660292  3918 pending_rounds.cc:85] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 4
I20260709 12:21:06.660600  3918 pending_rounds.cc:107] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:21:06.660729  5526 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.660887  3918 raft_consensus.cc:2889] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:06.592320  5275 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:06.617883  5509 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.668120  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.677881  3920 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:06.678449  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:06.735365  3923 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.635190  5499 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.587854  5456 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:06.687076  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 119029us
I20260709 12:21:06.605561  5254 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.650451  5492 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.665942  5473 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.622128  5213 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.682226  5297 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:06.683781  5305 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.735472  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67445us
I20260709 12:21:06.621632  5497 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:06.739279  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.682010  5510 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.762195  3923 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:06.768950  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.771219  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:06.772485  3992 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:06.739154  5500 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:06.776288  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:06.736689  5431 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:06.775164  3998 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:06.739997  5518 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.734642  5526 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.778373  5475 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:06.776031  5368 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:06.776762  5500 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:06.775754  5509 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:06.800791  5213 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.766438  5510 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.778317  5425 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:21:06.738368  5469 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.826759  5510 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.823499  5500 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.778261  5413 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:21:06.742643  5492 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.802208  5456 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.760622  5305 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.823683  5518 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.835120  5305 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:06.785382  5530 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:21:06.835661  5518 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.836369  5521 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.774641  5470 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:06.803254  5254 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.803082  5431 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.837133  5470 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:06.836910  5521 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.838104  5470 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:06.839026  5431 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:06.804419  5436 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.839723  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.840687  3845 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:06.808620  3846 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:06.742573  5297 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:06.811573  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.833184  5492 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.843118  5470 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:06.848138  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.849938  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:06.816397  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 214326us
I20260709 12:21:06.734200  5483 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.820605  5368 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.819491  5501 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:06.833159  5526 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:06.841005  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70656.8us
I20260709 12:21:06.857957  4581 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.861555  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:06.867408  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.868350  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.776505  5421 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:21:06.760092  5473 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.891722  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:06.900817  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.883656  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.906776  5456 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.907373  5456 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:06.909722  5456 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:06.906420  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139647us
I20260709 12:21:06.842341  5297 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.823652  5509 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:06.920310  3999 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:06.863119  5368 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.839135  5521 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:06.935516  5516 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.983734  5516 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:06.988029  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48100.5us
W20260709 12:21:06.988274  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48171.5us
W20260709 12:21:06.988965  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.990523  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.935752  5526 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.938954  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.993060  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.965535  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.916440  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:06.932613  5509 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.914441  5483 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.995923  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:06.998900  3994 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:07.001837  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.020680  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.021430  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.002872  5304 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.003432  5465 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:07.004733  5526 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.040441  3918 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:07.040758  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:07.006507  5425 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.041846  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.042171  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.006737  3815 leader_election.cc:400] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:07.042618  3918 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:07.043299  5490 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.007194  5475 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.043977  5490 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:07.044267  5475 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.008035  5484 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:07.051076  5475 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.041735  5526 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:07.008630  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.009033  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:07.011596  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.053297  3997 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.053364  3919 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:07.054593  3919 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:06.893435  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 153183us
I20260709 12:21:06.886200  5497 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:07.011946  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.057394  3916 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.058715  3916 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.059091  5465 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:07.014397  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.014743  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.064903  3921 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:07.064654  3925 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:07.066855  3921 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.016945  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.021524  3994 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:07.007236  3923 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:07.068531  3919 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:06.986939  5516 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:07.028198  3924 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:21:07.034026  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.038856  3920 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:07.041659  5451 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:07.045852  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:07.047209  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.044839  5254 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:07.062603  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:07.051849  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.052480  5484 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.079377  3996 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:07.013628  5473 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:07.060312  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:07.016737  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.085461  3922 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:07.069219  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.086736  3994 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
W20260709 12:21:07.075106  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.037674  5056 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.037019  5456 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:07.097802  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 158778us
I20260709 12:21:07.100621  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.101600  3996 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:07.077355  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.049507  5490 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.081212  3997 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:07.090035  5466 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:07.090735  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:07.090803  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.063476  3845 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:07.064203  5465 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:07.046666  5322 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:07.062950  5467 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:07.130816  5399 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.131608  5399 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.135011  5399 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.047040  5304 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.113184  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.088701  5516 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.114950  5254 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.078423  5453 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:07.118147  5484 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.118386  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 62549.8us
I20260709 12:21:07.108678  5456 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.148762  5456 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:07.097038  5500 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.145712  5535 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:21:07.152345  5297 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.153542  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 116) took 1007 ms. Trace:
I20260709 12:21:07.154003  3846 rpcz_store.cc:276] 0709 12:21:06.146481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.150905 (+  4424us) service_pool.cc:224] Handling call
0709 12:21:06.492255 (+341350us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:07.153336 (+661081us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54002ab554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:07.153472 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360315008}
I20260709 12:21:07.140980  3916 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:07.095011  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.109213  5056 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.136168  5465 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.144176  5304 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.145680  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:07.146324  5436 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:07.154830  5516 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:07.174484  5516 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.159578  5453 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.177284  5500 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.166203  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:07.198946  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.151208  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:07.166137  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:07.201516  3848 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:07.202235  3848 pending_rounds.cc:85] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 5
I20260709 12:21:07.202499  3848 pending_rounds.cc:107] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:07.154958  5297 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:07.155555  5254 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:07.183290  5453 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:07.184847  5465 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.164777  5483 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:07.201481  5517 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.202761  3848 raft_consensus.cc:2889] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.170771  5056 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.207412  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 123742us
I20260709 12:21:07.141639  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.197742  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:07.222460  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80885.3us
I20260709 12:21:07.211369  5436 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:07.211371  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.158421  5368 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.214169  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:07.209059  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57958.2us
I20260709 12:21:07.224292  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.211957  5392 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:07.165468  5509 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:07.208670  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63103.2us
I20260709 12:21:07.237125  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.237998  3847 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:07.232257  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:07.217760  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.239642  5322 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.240110  5509 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.240159  5322 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:07.241408  5322 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.241880  3922 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:07.229436  5473 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:07.236020  5436 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:07.229400  5502 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:07.225425  5056 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:07.243604  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.252414  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.254351  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.250808  5473 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:07.227854  5483 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:07.222718  5493 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:07.228030  5469 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.243788  5421 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:21:07.229638  5392 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.244992  5436 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.245287  5475 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:21:07.246097  5453 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:21:07.245777  5502 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.261117  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.230639  3846 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:07.278471  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.253604  5509 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.283557  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:07.287724  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.268396  5506 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:07.284960  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:07.290108  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.291044  5526 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:07.268059  5297 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.298959  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:07.221220  5517 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.293197  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.303737  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.269910  5392 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.303658  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.304698  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:07.305692  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.270502  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.306417  3999 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:07.244201  5254 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.273232  5469 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:07.288818  5497 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:07.298840  5473 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:07.293008  5526 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:07.284125  5451 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:07.293918  5506 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.295190  5304 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.302325  5475 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.353225  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.293568  5509 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.363935  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.395714  3848 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:07.338590  5492 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:07.344201  5425 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.344007  5497 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.351200  5473 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.341596  5521 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:07.340649  5447 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.405377  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:07.346259  5456 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.307130  5297 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:07.398962  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46566.5us
I20260709 12:21:07.350967  5368 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.361389  5541 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:21:07.423812  3993 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:07.353900  5506 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.398658  5493 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.357609  4577 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:07.362950  5517 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:07.422555  5413 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:07.422842  5497 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.454532  5493 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.428537  5473 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.429039  5521 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.366344  5275 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:21:07.470033  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:07.368798  5483 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.386271  5475 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.374400  5304 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:07.484328  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.451244  5492 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:07.446794  5510 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.474035  5368 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.447186  5447 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.474148  5413 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:07.434231  5456 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.488189  5453 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.360002  5469 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.495391  5492 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:07.495944  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 212872us
I20260709 12:21:07.532572  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:07.423128  5425 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.543470  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:07.486559  5521 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.565420  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.568667  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:07.596709  5554 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:21:07.597952  5544 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
W20260709 12:21:07.600958  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 131071us
W20260709 12:21:07.567642  5541 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:07.603469  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.522082  5393 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.629263  3847 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:07.563925  5254 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:07.591614  5501 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:07.636356  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.657651  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.658540  3992 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:07.570945  5492 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.666785  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:07.662588  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:07.679780  3997 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.530846  5368 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.530583  5432 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:21:07.600279  5526 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.671787  5500 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:07.675967  5546 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:21:07.632207  5393 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.592572  5453 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.599624  5552 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:21:07.593971  5439 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:21:07.657996  5451 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.561062  5510 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.538367  5470 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:07.668159  5297 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.637256  5322 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:21:07.700224  5500 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.715143  3997 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:07.697515  5501 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.665443  5254 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.716471  5453 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.710039  5393 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.631021  5413 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:07.739234  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 195908us
I20260709 12:21:07.748299  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:07.727229  5466 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:07.740262  5548 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:21:07.732676  5500 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.727803  5509 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.708118  5526 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.752238  4577 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:07.727615  5451 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.819543  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:07.820765  5547 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:21:07.766714  5466 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:07.746120  5501 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.824755  5475 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.845194  5551 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 12:21:07.856194  5399 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:07.856817  5399 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:07.858029  5399 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:07.859154  5399 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:07.869621  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 296254us
W20260709 12:21:07.870321  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 244544us
I20260709 12:21:07.817468  5304 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.961743  5368 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.877499  5392 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
I20260709 12:21:07.829752  5466 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.833751  5447 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.962404  5526 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:07.889711  5552 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:07.983621  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.985291  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 71322.3us
I20260709 12:21:07.986821  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:07.887387  5535 consensus_queue.cc:1175] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "32d706e2535f4fa19a09382d4edac677" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 12:21:07.991307  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.891809  5297 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.003940  5297 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:07.970494  5453 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:21:08.006551  5297 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:07.995990  5553 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:21:07.996116  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:08.002404  5558 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:21:07.962548  5392 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:08.002669  5575 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:21:08.003415  5561 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:21:08.022019  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 629) took 1023 ms. Trace:
I20260709 12:21:08.031682  5569 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.032829  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.032594  5569 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.033766  3993 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:08.022446  3994 rpcz_store.cc:276] 0709 12:21:06.999095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.087517 (+ 88422us) service_pool.cc:224] Handling call
0709 12:21:07.087953 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.088402 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.088444 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.399943 (+311499us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:07.420058 (+ 20115us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.700051 (+279993us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:07.719154 (+ 19103us) log.cc:844] Serialized 14 byte log entry
0709 12:21:07.719379 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.719766 (+   387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.021651 (+301885us) raft_consensus.cc:1685] finished
0709 12:21:08.021756 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.021953 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131865,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":29832,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":55483,"spinlock_wait_cycles":5105024,"thread_start_us":221960,"threads_started":1,"wal-append.queue_time_us":279705}
I20260709 12:21:08.004323  5552 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:07.962993  5456 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:08.007263  5506 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.008s
I20260709 12:21:08.011726  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:07.912966  5493 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:07.967346  5501 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.050055  5557 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:07.993113  5562 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:21:08.019237  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:08.049324  5506 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.050724  5557 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.055358  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:08.068046  4575 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.074767  5502 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:07.486892  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:08.075132  5557 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.091512  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 196) took 4497 ms. Trace:
I20260709 12:21:08.082986  5275 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:08.086023  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65), VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66), VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:08.093107  5517 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.095034  5254 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.082118  5509 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.098105  5510 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.133414  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.101269  3747 rpcz_store.cc:276] 0709 12:21:03.594629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.606758 (+ 12129us) service_pool.cc:224] Handling call
0709 12:21:04.418797 (+812039us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:08.091371 (+3672574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:05.578538 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:05.661101 (+ 82563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:05.661139 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:21:05.661159 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:05.704971 (+ 43812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:05.705064 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:05.705101 (+    37us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:21:05.705725 (+   624us) tablet.cc:701] Row locks acquired
0709 12:21:05.705744 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:05.705889 (+   145us) write_op.cc:270] Start()
0709 12:21:05.706013 (+   124us) write_op.cc:276] Timestamp: P: 1783599665705847 usec, L: 0
0709 12:21:05.706035 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:05.768006 (+ 61971us) log.cc:844] Serialized 2844 byte log entry
0709 12:21:06.338639 (+570633us) op_driver.cc:464] REPLICATION: finished
0709 12:21:06.470632 (+131993us) write_op.cc:301] APPLY: starting
0709 12:21:06.472387 (+  1755us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:06.483750 (+ 11363us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:06.488761 (+  5011us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:06.491234 (+  2473us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:06.491462 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:21:06.491513 (+    51us) write_op.cc:312] APPLY: finished
0709 12:21:06.491774 (+   261us) log.cc:844] Serialized 59 byte log entry
0709 12:21:06.491953 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:06.492077 (+   124us) write_op.cc:454] Released schema lock
0709 12:21:06.492121 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:06.493760 (+  1639us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:06.493792 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36718,"reported_tablets":15,"spinlock_wait_cycles":41425408,"child_traces":[["op",{"apply.queue_time_us":116220,"apply.run_cpu_time_us":2839,"apply.run_wall_time_us":30426,"num_ops":7,"prepare.queue_time_us":364914,"prepare.run_cpu_time_us":21750,"prepare.run_wall_time_us":371026,"raft.queue_time_us":255969,"raft.run_cpu_time_us":41528,"raft.run_wall_time_us":71612,"replication_time_us":632370,"thread_start_us":581195,"threads_started":4,"wal-append.queue_time_us":299364,"wal-append.run_cpu_time_us":22441,"wal-append.run_wall_time_us":1444466}]]}
W20260709 12:21:08.138415  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 267935us
W20260709 12:21:08.148391  3998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.006s	sys 0.020s
I20260709 12:21:08.103730  5451 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:08.154757  3998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.006s	sys 0.020s
W20260709 12:21:08.143342  5465 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.004s
I20260709 12:21:08.103016  5576 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:21:08.141853  5254 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:08.139216  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 444607us
I20260709 12:21:08.132550  5517 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.158859  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.135913  5509 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.160486  5569 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.149663  5475 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:21:08.158399  5432 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:08.186285  3889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.008s
I20260709 12:21:08.170753  5526 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:08.197235  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.198113  3922 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:21:08.200172  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 128467us
I20260709 12:21:08.183212  5510 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.202991  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.204145  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:08.206101  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:08.195972  3889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.008s
W20260709 12:21:08.208721  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 640030us
I20260709 12:21:08.175179  5254 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.191354  5392 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.124413  5552 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.195963  3846 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:08.211150  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:08.214399  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.215206  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:08.228868  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.208388  5526 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.214210  5506 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.200645  5432 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.210124  5510 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.235103  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.225659  5451 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.247949  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.248863  3842 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.233737  5475 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.253367  5566 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:21:08.276778  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:08.277153  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:08.278174  5509 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.278875  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:08.279659  5518 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.279908  5582 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:08.280320  5582 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.280570  5569 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:08.280728  5582 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.281028  5569 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:08.240758  5583 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:08.256757  5473 consensus_meta.cc:287] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.737s	user 0.002s	sys 0.010s
I20260709 12:21:08.257433  3844 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:08.257515  5425 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.260339  3845 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.263243  5254 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.235611  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.287074  3918 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:08.287341  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.272861  5475 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.273442  5526 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:08.290283  5475 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:08.254086  5497 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.007s
I20260709 12:21:08.274727  5056 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:08.280241  5518 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.292074  5497 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.293162  3998 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:08.293991  5518 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.282069  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:08.294867  5497 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.295267  5475 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:08.295861  5475 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:08.297257  5475 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:08.274405  5492 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 12:21:08.300081  5475 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.299880  5492 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.303499  5492 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.307097  5500 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.309475  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 101) took 1006 ms. Trace:
I20260709 12:21:08.239756  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.247264  5484 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:08.312338  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72712.8us
I20260709 12:21:08.309887  3999 rpcz_store.cc:276] 0709 12:21:07.302931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.308934 (+  6003us) service_pool.cc:224] Handling call
0709 12:21:07.335675 (+ 26741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.708621 (+372946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.708658 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.709150 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.983659 (+274509us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:07.984611 (+   952us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.191616 (+207005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.191701 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.266321 (+ 74620us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b180032e0c0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:08.282840 (+ 16519us) raft_consensus.cc:1685] finished
0709 12:21:08.309260 (+ 26420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.309405 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27202,"prepare.queue_time_us":596,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":57043,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":247,"spinlock_wait_cycles":58680576,"thread_start_us":780599,"threads_started":3,"wal-append.queue_time_us":446312}
I20260709 12:21:08.316766  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.317386  3999 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:08.318624  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.320231  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:08.250391  5506 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.322289  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.281452  5569 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.322463  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:08.325845  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77484.7us
I20260709 12:21:08.283756  5583 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.311504  5516 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.329502  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1573) took 1023 ms. Trace:
I20260709 12:21:08.325850  5368 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.330264  5577 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.320711  5484 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.331558  3996 rpcz_store.cc:276] 0709 12:21:07.305659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.401373 (+ 95714us) service_pool.cc:224] Handling call
0709 12:21:07.429700 (+ 28327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.430053 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.430081 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.451603 (+ 21522us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.225322 (+773719us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18002ff320. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:21:08.314069 (+ 88747us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:08.314129 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.314226 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.314287 (+    61us) raft_consensus.cc:1685] finished
0709 12:21:08.314303 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.329422 (+ 15119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2113,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5021,"spinlock_wait_cycles":7128448,"thread_start_us":88501,"threads_started":1,"wal-append.queue_time_us":830259}
I20260709 12:21:08.321045  5509 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:08.332424  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:08.270272  5451 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.315138  5473 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.393251  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.332782  5368 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.394536  3996 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:08.365681  5484 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.330998  5583 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.365126  5509 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.399930  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.384618  5526 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:21:08.402621  3996 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:08.327800  5506 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.403959  3991 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:08.378840  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:08.371016  5518 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:08.408651  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.378974  5456 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:08.328658  5492 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:21:08.414417  3997 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:08.415562  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.394887  5517 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.398999  5305 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.399386  5500 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.401823  5368 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.398808  5560 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.417290  5521 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.003s
I20260709 12:21:08.405611  5509 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.401073  5399 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.430217  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.438624  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.412868  5518 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.366143  5516 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.442330  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:08.378957  5577 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.471238  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:08.476459  5593 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:21:08.476722  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:08.466358  5510 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.466276  5517 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.485368  3999 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:08.470799  5518 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.468417  5521 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.478595  5432 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:08.435786  5305 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:08.499478  5591 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:21:08.504411  5451 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:08.484678  5500 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.506155  5500 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.446458  5560 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.508628  5500 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.484561  5584 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.509310  5560 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.470218  5399 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.491902  3846 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.493499  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:08.513351  5516 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:08.496031  5393 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.005s
I20260709 12:21:08.523098  3994 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:21:08.524083  5586 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.524755  5492 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:08.533624  5506 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.509370  5584 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.493849  5517 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:08.534526  5466 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.004s
I20260709 12:21:08.547756  5586 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.560082  5466 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.561048  5305 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.536875  5393 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.563305  5517 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.565855  5586 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.568603  5473 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.541337  5492 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.594412  5492 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.600312  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1583) took 1183 ms. Trace:
I20260709 12:21:08.591611  5563 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.592041  5466 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:08.601234  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 279013us
I20260709 12:21:08.589771  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:08.605263  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.605242  3996 rpcz_store.cc:276] 0709 12:21:07.417459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.420739 (+1003280us) service_pool.cc:224] Handling call
0709 12:21:08.422553 (+  1814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.422715 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:08.470008 (+ 47293us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.599922 (+129914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.599990 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:08.600042 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.600116 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.600246 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22928,"prepare.queue_time_us":50026,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1100,"thread_start_us":129540,"threads_started":1}
I20260709 12:21:08.614493  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:08.627740  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1584) took 1207 ms. Trace:
I20260709 12:21:08.628455  3996 rpcz_store.cc:276] 0709 12:21:07.420314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.623196 (+1202882us) service_pool.cc:224] Handling call
0709 12:21:08.627157 (+  3961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.627348 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.627375 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.627418 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:08.627470 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.627524 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.627670 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:08.589571  5399 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.598483  5509 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.641695  3996 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:08.645413  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1586) took 1185 ms. Trace:
I20260709 12:21:08.645658  3996 rpcz_store.cc:276] 0709 12:21:07.461335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.638751 (+1177416us) service_pool.cc:224] Handling call
0709 12:21:08.641464 (+  2713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.645150 (+  3686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.645361 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:08.624732  5492 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:08.600525  5583 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.644659  4575 raft_consensus.cc:2368] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:08.656265  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.640070  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1572) took 1332 ms. Trace:
I20260709 12:21:08.595355  5368 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.640902  5510 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.640988  5304 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.657059  3844 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
W20260709 12:21:08.658631  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59025.7us
I20260709 12:21:08.661900  5275 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:08.668021  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.637391  5563 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.689342  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.690565  3922 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:08.676283  5304 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.694420  5304 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.695794  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.696699  5584 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.697054  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.697933  3844 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:08.659785  3990 rpcz_store.cc:276] 0709 12:21:07.305392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.374207 (+ 68815us) service_pool.cc:224] Handling call
0709 12:21:07.431974 (+ 57767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.591648 (+159674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.594473 (+  2825us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.693547 (+ 99074us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.847045 (+153498us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:07.847106 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.598243 (+751137us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400392454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:08.598337 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.598413 (+    76us) raft_consensus.cc:1685] finished
0709 12:21:08.598437 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.637640 (+ 39203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5525,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9447,"spinlock_wait_cycles":201739008,"thread_start_us":94844,"threads_started":1,"wal-append.queue_time_us":122971}
I20260709 12:21:08.660254  5492 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.700915  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:08.691912  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:08.698937  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:08.704078  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:08.676801  5275 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:08.722733  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 95910.9us
I20260709 12:21:08.723394  3843 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:08.725450  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.726660  3922 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:08.726768  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.732419  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.733611  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.734001  3916 raft_consensus.cc:2376] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4. Re-sending same reply.
I20260709 12:21:08.734813  3917 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.735015  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.734697  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.738303  3916 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.738394  3925 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.739655  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.735944  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.736950  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.740670  3916 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:08.740576  3917 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:08.735306  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.736017  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.741583  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.742246  3924 raft_consensus.cc:2376] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4. Re-sending same reply.
I20260709 12:21:08.742445  3916 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.732668  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.731823  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.741564  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.739784  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.701309  5569 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.704512  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 104) took 1145 ms. Trace:
I20260709 12:21:08.769490  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.770339  3924 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.721902  5586 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.718899  5456 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.719326  5573 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.740903  3921 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.790908  3916 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:08.744628  3920 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:08.783051  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.792337  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.792528  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.792981  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.793411  3916 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:08.722215  5565 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.780877  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.793867  5565 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.794559  3917 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 1.
I20260709 12:21:08.673976  5510 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.699703  5518 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.809451  5609 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.727950  3918 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.795250  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:08.794026  5506 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.783668  5580 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:08.812325  3925 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:08.790330  5573 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.723657  5425 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:21:08.777304  5473 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:08.821525  3924 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:08.783931  5304 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.784051  5586 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.812938  5560 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:08.793809  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.818336  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:08.811548  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54963.7us
I20260709 12:21:08.794625  5565 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.822439  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.818681  5609 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:08.825543  5600 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:21:08.825882  5368 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.839969  5583 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.815328  5305 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.776952  3990 rpcz_store.cc:276] 0709 12:21:07.558722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.700870 (+1142148us) service_pool.cc:224] Handling call
0709 12:21:08.701237 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.701436 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.701462 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:08.701505 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:08.701540 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.701613 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.701720 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:08.816207  5509 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:08.820430  5582 consensus_meta.cc:287] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.004s
I20260709 12:21:08.837831  3921 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.839391  3846 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:08.796062  5466 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:21:08.795192  5599 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:21:08.837828  3925 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:08.820116  5483 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:08.845747  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:08.852427  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.864677  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:08.818250  5393 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.810602  5484 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.849143  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.796533  5456 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.823112  5573 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.823745  5506 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:08.871326  5516 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.868165  5583 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.842726  5586 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.872711  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:08.872047  5517 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:08.841131  5304 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.848584  5492 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.854043  5569 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.855242  5582 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.882067  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1577) took 1538 ms. Trace:
I20260709 12:21:08.896217  3997 rpcz_store.cc:276] 0709 12:21:07.343873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.739111 (+395238us) service_pool.cc:224] Handling call
0709 12:21:07.764967 (+ 25856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.415382 (+650415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.881781 (+466399us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400209754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:08.882001 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492723968}
I20260709 12:21:08.882408  5456 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.868861  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.885672  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:08.900367  3921 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.833400  5473 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.822981  5580 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.840750  5305 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.848033  5469 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:08.848727  5560 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.879683  5598 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:08.888427  5475 consensus_meta.cc:287] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.006s
I20260709 12:21:08.904500  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.913126  3997 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:08.891347  5517 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.915892  5517 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.916100  5510 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.917775  5304 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.908254  5469 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.919050  5469 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.919975  5425 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.920531  5425 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.922562  5598 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:08.908352  3921 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:08.897256  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:08.884716  5583 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.926025  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.927417  3921 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.901268  5563 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.930507  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.941653  3997 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:08.930970  5506 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:08.907688  3918 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:08.928602  5475 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:21:08.950376  5609 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.951032  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.929989  3990 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.960536  5599 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.961762  3918 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:08.961500  5599 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:08.952152  5603 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:21:08.952574  5305 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.953858  5583 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:08.956040  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:08.956274  3921 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:08.966889  3922 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:08.969069  3922 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:08.971580  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1576) took 1631 ms. Trace:
I20260709 12:21:08.963241  3918 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.972213  3992 rpcz_store.cc:276] 0709 12:21:07.340010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.691886 (+351876us) service_pool.cc:224] Handling call
0709 12:21:07.692287 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.692686 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.692730 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.428577 (+735847us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:08.441594 (+ 13017us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.638413 (+196819us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:08.638462 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.639061 (+   599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.963701 (+324640us) raft_consensus.cc:1685] finished
0709 12:21:08.963721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.971483 (+  7762us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24437,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":13186432,"thread_start_us":154158,"threads_started":1,"wal-append.queue_time_us":255583}
I20260709 12:21:08.989324  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:08.994122  3992 raft_consensus.cc:2410] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:08.974814  5518 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:08.975744  5560 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:08.987964  5576 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:08.996620  5497 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.994794  5616 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:09.000489  5598 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.020574  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.017740  5616 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:09.012212  5576 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.035341  5576 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.036453  5413 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.026016  5599 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.050993  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.039346  5469 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.039979  5616 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.061810  5586 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.099140  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.065047  5580 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.112751  5616 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.113965  5275 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:09.123579  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53969.2us
I20260709 12:21:09.141628  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1582) took 1741 ms. Trace:
I20260709 12:21:09.143872  3993 rpcz_store.cc:276] 0709 12:21:07.400153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.225892 (+825739us) service_pool.cc:224] Handling call
0709 12:21:08.226240 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.226561 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.226587 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.230280 (+  3693us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.954247 (+723967us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b180031c9c0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:21:08.994214 (+ 39967us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:08.994255 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.994334 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.110357 (+116023us) raft_consensus.cc:1685] finished
0709 12:21:09.110389 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.141530 (+ 31141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22213,"raft.queue_time_us":7619,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8224,"spinlock_wait_cycles":35411200,"thread_start_us":39776,"threads_started":1,"wal-append.queue_time_us":786466}
I20260709 12:21:09.146941  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.148175  3993 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:09.149394  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.150358  3993 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:09.151777  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.156980  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.157598  3924 raft_consensus.cc:2368] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3.
I20260709 12:21:09.160305  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.168740  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:09.169028  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.170841  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.170346  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.173190  3841 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:09.173923  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:09.174206  3992 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.174566  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.178251  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.179077  4578 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:09.182307  5399 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.165728  5586 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.188807  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.175742  5516 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.182053  5502 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.190415  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.197999  5582 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.199602  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1580) took 1844 ms. Trace:
I20260709 12:21:09.200712  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 628) took 2202 ms. Trace:
I20260709 12:21:09.182862  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.202764  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.206393  3994 rpcz_store.cc:276] 0709 12:21:07.355159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.037789 (+682630us) service_pool.cc:224] Handling call
0709 12:21:08.047680 (+  9891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.532141 (+484461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.199304 (+667163us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003e2454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:09.199533 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092586752}
I20260709 12:21:09.206450  3995 rpcz_store.cc:276] 0709 12:21:06.998696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.998844 (+   148us) service_pool.cc:224] Handling call
0709 12:21:07.402360 (+403516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.402726 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.402755 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.420394 (+ 17639us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.707890 (+287496us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:07.832411 (+124521us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.226111 (+393700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.226190 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.226229 (+    39us) raft_consensus.cc:1685] finished
0709 12:21:08.226239 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.200529 (+974290us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003e1550. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:09.200653 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11267,"prepare.queue_time_us":126111,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":18861,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":5159,"spinlock_wait_cycles":927239424,"thread_start_us":639797,"threads_started":2,"wal-append.queue_time_us":296463,"wal-append.run_cpu_time_us":4098,"wal-append.run_wall_time_us":1318700}
I20260709 12:21:09.208163  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.208859  3844 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:09.209051  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.209658  3995 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 1.
I20260709 12:21:09.210393  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.210987  3995 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:09.212436  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.213029  3994 raft_consensus.cc:2368] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:09.213043  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.214329  3993 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:09.214507  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.215085  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.215678  3995 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:09.204737  5493 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:09.217020  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.163404  5565 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.218343  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:09.216787  5627 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:21:09.224001  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.224462  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.217180  3990 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.222324  3992 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:09.212175  4576 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:09.207260  5573 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.230093  3995 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:21:09.291846  3995 pending_rounds.cc:85] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 1
I20260709 12:21:09.292497  3995 pending_rounds.cc:107] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:09.293035  3995 raft_consensus.cc:2889] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.293785  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.294888  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1597) took 1010 ms. Trace:
I20260709 12:21:09.295696  3995 rpcz_store.cc:276] 0709 12:21:08.284586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.229496 (+944910us) service_pool.cc:224] Handling call
0709 12:21:09.229746 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.294187 (+ 64441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.294694 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:09.225637  5517 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.304419  3999 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 2: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:09.241350  5484 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.281226  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.306576  5484 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:09.222159  5493 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.307320  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.308631  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.240156  5469 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.288570  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.244705  5425 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.287055  3846 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:09.288826  3848 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:21:09.243283  5473 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.285145  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.228837  5497 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:09.318688  5502 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:09.314222  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1581) took 1928 ms. Trace:
I20260709 12:21:09.281765  3842 raft_consensus.cc:2410] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:09.337917  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.327929  5517 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.307245  5484 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:09.310971  5493 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.294754  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.244244  5521 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.246824  5552 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:09.409941  5552 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:09.411373  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.412452  3916 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.412513  5552 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.414669  5552 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.242847  5573 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.228343  5577 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.416285  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.416806  5484 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:09.417511  3920 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.234745  5565 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.337194  3848 pending_rounds.cc:85] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 1
I20260709 12:21:09.337157  3998 rpcz_store.cc:276] 0709 12:21:07.385546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.161024 (+775478us) service_pool.cc:224] Handling call
0709 12:21:08.161478 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.293514 (+132036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.313267 (+1019753us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003e1f54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:09.313909 (+   642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302301952}
I20260709 12:21:09.310117  3844 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:09.311889  5469 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:09.420470  3848 pending_rounds.cc:107] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:09.421242  3848 raft_consensus.cc:2889] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.422304  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 110) took 1143 ms. Trace:
I20260709 12:21:09.427366  3921 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:09.432476  3923 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:09.424968  3991 rpcz_store.cc:276] 0709 12:21:08.276448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.276881 (+   433us) service_pool.cc:224] Handling call
0709 12:21:09.419597 (+1142716us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001982d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:09.420034 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286143360}
I20260709 12:21:09.430596  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.434136  3922 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.434414  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.434928  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1394) took 1152 ms. Trace:
I20260709 12:21:09.435360  3848 rpcz_store.cc:276] 0709 12:21:08.282620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.282797 (+   177us) service_pool.cc:224] Handling call
0709 12:21:08.283128 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.431753 (+1148625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.434222 (+  2469us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400409554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:09.434450 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310449536}
I20260709 12:21:09.437132  5275 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.437229  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.438845  3991 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:09.431218  3924 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.439812  5469 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.447860  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.448513  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.449024  3923 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.449509  3998 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.451550  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 658) took 1311 ms. Trace:
I20260709 12:21:09.452054  3843 rpcz_store.cc:276] 0709 12:21:08.139714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.139856 (+   142us) service_pool.cc:224] Handling call
0709 12:21:08.605088 (+465232us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:09.451085 (+845997us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002aa654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:09.451306 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267432960}
I20260709 12:21:09.453164  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.452234  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.453893  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.454272  3923 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.454903  3918 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.456035  3923 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.456851  3918 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:09.453007  3924 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.454046  3921 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.458722  5584 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.459949  3994 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:09.459599  5584 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.460923  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.462311  5584 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.463231  3991 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:09.423044  5502 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:09.468007  5577 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.468149  5565 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.468875  5577 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.469028  5565 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.469179  5502 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.470185  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.471431  5577 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.471431  5565 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.443069  5469 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.478613  5484 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.482936  5484 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.483867  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.485103  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:09.463264  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 256) took 1259 ms. Trace:
I20260709 12:21:09.504805  3995 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:09.520577  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:09.486346  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 82382.6us
I20260709 12:21:09.517445  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.532995  3916 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:09.533777  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.550830  3925 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:21:09.536424  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.539006  3918 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.539242  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.559043  3845 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:09.560434  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.561276  3845 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:09.562383  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.563153  3845 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.544634  3917 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.535169  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.556991  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.539001  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 3, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:09.564416  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 108) took 4006 ms. Trace:
W20260709 12:21:09.569661  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.569460  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.571406  5469 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:09.543794  5393 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.590224  3843 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.594678  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.595826  3850 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:09.596973  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.596666  5393 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.597757  3922 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.600103  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.601073  3844 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.601202  3746 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:09.600145  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:09.604522  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.605149  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.605963  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.606668  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.607426  3991 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.607784  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:09.608640  3997 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.609336  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.610136  3999 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:09.610265  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:09.610893  3924 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:09.599080  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.597677  3850 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:09.613237  3922 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.612111  3925 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:09.596738  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1596) took 1312 ms. Trace:
I20260709 12:21:09.614039  3994 rpcz_store.cc:276] 0709 12:21:08.284333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.229065 (+944732us) service_pool.cc:224] Handling call
0709 12:21:09.329474 (+100409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.460391 (+130917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.596480 (+136089us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54003e2950. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:09.596676 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204385152}
I20260709 12:21:09.621289  3998 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:09.601205  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.500706  4575 rpcz_store.cc:276] 0709 12:21:08.203695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.203853 (+   158us) service_pool.cc:224] Handling call
0709 12:21:09.323406 (+1119553us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540060fed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:09.463044 (+139638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948309888}
I20260709 12:21:09.621037  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.629325  3920 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:09.634153  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.642829  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.621863  5577 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:09.644562  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.649026  3924 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.651664  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:09.647718  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46858us
I20260709 12:21:09.637327  5393 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:09.634001  5552 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:09.632742  3746 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 4, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:09.645169  5577 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.667768  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.668284  3991 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:09.666402  3920 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.690829  3924 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:09.676136  5577 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.665431  5565 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:09.677464  5275 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:09.706653  3843 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:09.709563  3848 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:09.659540  5469 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.717728  3920 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:09.718019  5469 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:09.681340  3918 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.706454  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:09.712942  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47413.1us
I20260709 12:21:09.708595  5275 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:09.725101  5275 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.731431  3815 leader_election.cc:400] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:09.731904  3815 leader_election.cc:403] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.732232  5393 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:09.732784  3995 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:09.715020  5565 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.688444  5552 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.732465  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:09.735474  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1587) took 2225 ms. Trace:
I20260709 12:21:09.735560  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:09.715237  3925 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:09.744117  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.744935  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:09.745674  3924 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.748368  5568 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:09.748711  5563 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:09.749044  5568 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:09.749431  5563 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.743170  3844 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:09.756620  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78096.8us
I20260709 12:21:09.764657  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:09.767166  3922 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:09.770183  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:09.771698  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:09.787672  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64702.3us
I20260709 12:21:09.796587  3843 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:09.796612  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:09.797920  3925 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:09.579766  3745 rpcz_store.cc:276] 0709 12:21:05.557941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.558147 (+   206us) service_pool.cc:224] Handling call
0709 12:21:09.563979 (+4005832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:08.331832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:08.497819 (+165987us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:08.510351 (+ 12532us) write_op.cc:435] Acquired schema lock
0709 12:21:08.514036 (+  3685us) tablet.cc:662] Decoding operations
0709 12:21:08.566486 (+ 52450us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:08.569838 (+  3352us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:08.571855 (+  2017us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:08.587729 (+ 15874us) tablet.cc:701] Row locks acquired
0709 12:21:08.587751 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:21:08.587940 (+   189us) write_op.cc:270] Start()
0709 12:21:08.588077 (+   137us) write_op.cc:276] Timestamp: P: 1783599668587871 usec, L: 0
0709 12:21:08.588097 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:21:08.590429 (+  2332us) log.cc:844] Serialized 780 byte log entry
0709 12:21:08.932251 (+341822us) op_driver.cc:464] REPLICATION: finished
0709 12:21:09.030413 (+ 98162us) write_op.cc:301] APPLY: starting
0709 12:21:09.031750 (+  1337us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:09.047636 (+ 15886us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:09.056570 (+  8934us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:09.056863 (+   293us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:09.094125 (+ 37262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:09.098162 (+  4037us) write_op.cc:312] APPLY: finished
0709 12:21:09.104057 (+  5895us) log.cc:844] Serialized 23 byte log entry
0709 12:21:09.104307 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:09.104435 (+   128us) write_op.cc:454] Released schema lock
0709 12:21:09.104507 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:09.104979 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:09.105032 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":962075,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":92015,"apply.run_cpu_time_us":3053,"apply.run_wall_time_us":78241,"num_ops":1,"prepare.queue_time_us":198960,"prepare.run_cpu_time_us":22071,"prepare.run_wall_time_us":400771,"raft.queue_time_us":104964,"raft.run_cpu_time_us":23520,"raft.run_wall_time_us":58905,"replication_time_us":344001,"thread_start_us":449225,"threads_started":4,"wal-append.queue_time_us":195264}]]}
I20260709 12:21:09.818518  3924 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:09.764884  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:09.736088  3996 rpcz_store.cc:276] 0709 12:21:07.476807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.646234 (+1169427us) service_pool.cc:224] Handling call
0709 12:21:08.647842 (+  1608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.648123 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:08.656751 (+  8628us) log.cc:844] Serialized 14 byte log entry
0709 12:21:09.312609 (+655858us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18003eea80. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:21:09.645486 (+332877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:09.658220 (+ 12734us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:09.674181 (+ 15961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.679309 (+  5128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.702211 (+ 22902us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8794,"prepare.queue_time_us":8332,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":8119,"raft.queue_time_us":33635,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":8704,"spinlock_wait_cycles":7340800,"thread_start_us":214892,"threads_started":1,"wal-append.queue_time_us":1033720}
I20260709 12:21:09.805378  5393 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:09.798007  3845 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:09.832990  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:09.841837  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58030.2us
I20260709 12:21:09.862251  5601 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:09.862943  5601 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.863394  5601 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.874305  5616 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5.
I20260709 12:21:09.857364  5393 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:09.842666  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 98457.7us
W20260709 12:21:09.899232  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 168083us
I20260709 12:21:09.926162  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.914812  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.931540  5436 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:09.932217  5436 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:09.933245  5436 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.935974  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.936801  4577 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:09.937292  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51183.6us
I20260709 12:21:09.936983  5393 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.938668  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.926008  5577 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:09.905700  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:09.913131  5563 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:09.950182  3815 leader_election.cc:336] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.505s (SENT)
I20260709 12:21:09.950870  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:09.952818  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.954095  5399 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:09.963462  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:09.971182  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1604) took 1193 ms. Trace:
I20260709 12:21:09.971701  3993 rpcz_store.cc:276] 0709 12:21:08.777222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.318549 (+541327us) service_pool.cc:224] Handling call
0709 12:21:09.319348 (+   799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.423167 (+103819us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:09.634229 (+211062us) log.cc:844] Serialized 14 byte log entry
0709 12:21:09.970599 (+336370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:09.970657 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:09.970704 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.970772 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.970914 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140530,"prepare.queue_time_us":266662,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"thread_start_us":354716,"threads_started":2,"wal-append.queue_time_us":293685}
I20260709 12:21:09.972918  5565 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.973956  5573 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:09.974730  5573 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:09.971226  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1601) took 1194 ms. Trace:
I20260709 12:21:09.978041  5497 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:09.976351  3990 rpcz_store.cc:276] 0709 12:21:08.776367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.297785 (+521418us) service_pool.cc:224] Handling call
0709 12:21:09.298537 (+   752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.299340 (+   803us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:09.578415 (+279075us) log.cc:844] Serialized 14 byte log entry
0709 12:21:09.970473 (+392058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:09.970558 (+    85us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:09.970619 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.970813 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.970965 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143949,"prepare.queue_time_us":413151,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":153645,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2432,"thread_start_us":440632,"threads_started":2,"wal-append.queue_time_us":306971}
I20260709 12:21:09.978569  5497 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.978508  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:09.979156  5497 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.979831  5584 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:09.980289  5584 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.985353  5552 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:09.980648  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:10.003005  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59752.6us
I20260709 12:21:09.993588  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:09.976603  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1593) took 1693 ms. Trace:
I20260709 12:21:09.980700  5584 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.995054  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:10.006093  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.016703  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.955343  5601 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.000844  5577 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.000788  5425 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:21:10.036259  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55722.8us
I20260709 12:21:10.020747  5563 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:10.010401  3992 rpcz_store.cc:276] 0709 12:21:08.283451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.226836 (+943385us) service_pool.cc:224] Handling call
0709 12:21:09.227170 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.227335 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:09.636921 (+409586us) log.cc:844] Serialized 14 byte log entry
0709 12:21:09.975755 (+338834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:09.975847 (+    92us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:09.975924 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.976030 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.976418 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134454,"prepare.queue_time_us":450816,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":8754,"raft.queue_time_us":136051,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":19200,"thread_start_us":466276,"threads_started":2}
I20260709 12:21:09.974725  5580 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.908025  5568 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.022238  5573 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:10.110598  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78313.8us
I20260709 12:21:10.119985  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:10.120159  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 127540us
I20260709 12:21:10.120733  3919 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:10.121219  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:10.122377  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 172263us
I20260709 12:21:10.125250  5601 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.125981  5510 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:10.131923  5637 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:21:10.132761  5586 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.133358  5469 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:10.133591  5586 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:10.119764  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130198us
I20260709 12:21:10.113803  5484 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:10.108875  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 156056us
I20260709 12:21:10.144701  5473 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:10.142750  3918 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:10.145632  5565 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:10.211364  5565 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.194329  5573 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:10.205212  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.209808  5586 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.189395  5297 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:10.236021  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 114990us
I20260709 12:21:10.223719  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:10.257232  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62219.7us
I20260709 12:21:10.215245  5565 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.209908  5577 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.266500  5577 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.267763  5577 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.211364  5484 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:10.183254  5275 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.273028  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.236222  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:10.280866  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57424us
I20260709 12:21:10.264187  5510 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:10.269672  5577 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.285957  5565 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.286700  5565 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.290359  4577 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:10.279240  5484 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.297179  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:10.298235  3848 raft_consensus.cc:2368] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:10.300280  4546 leader_election.cc:400] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:10.300665  4546 leader_election.cc:403] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:10.301899  5275 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.191648  5497 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.192523  5580 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.308741  5580 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.302686  5275 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.312456  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.313608  5601 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:10.311152  5577 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:21:10.315344  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.316494  5563 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:10.316999  5563 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.318223  5563 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:10.319212  5649 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.003s
I20260709 12:21:10.320147  5563 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:10.321626  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.328037  5297 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:10.331588  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 199440us
W20260709 12:21:10.329329  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46755.2us
W20260709 12:21:10.306563  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 183216us
I20260709 12:21:10.303467  5510 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:10.287905  5565 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.345410  5510 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:10.356019  3815 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.661s (SENT)
I20260709 12:21:10.375190  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.377569  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.392452  5601 raft_consensus.cc:2764] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:10.396844  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.397682  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:10.399798  5601 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:10.400390  5601 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:10.400847  5601 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:10.409608  5601 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.418835  5601 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.414577  3889 leader_election.cc:400] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
W20260709 12:21:10.419816  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65175.9us
I20260709 12:21:10.413018  5584 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.418984  5484 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.426594  3889 leader_election.cc:403] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:10.421451  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74586.4us
I20260709 12:21:10.425771  5425 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:21:10.452584  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 255942us
W20260709 12:21:10.455482  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 104669us
I20260709 12:21:10.431224  5473 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:10.434288  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 435055us
I20260709 12:21:10.462918  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:10.464524  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.458077  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:10.459832  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:10.438772  5297 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.467499  5584 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.467238  5473 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.468816  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:10.470731  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:10.471151  5484 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.457383  5497 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:10.478333  5413 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:10.479522  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:10.491000  5651 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:21:10.494066  5275 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
W20260709 12:21:10.494177  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 79824.1us
I20260709 12:21:10.517060  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.495575  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.499595  5577 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:10.500030  3850 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:10.520329  3842 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.470600  5659 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:10.519132  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:10.525957  4578 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:10.514240  5568 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:10.526935  5568 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.527333  5568 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.528486  3849 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:10.532052  5577 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:10.532361  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53068us
I20260709 12:21:10.532714  5577 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:10.533296  5577 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.534814  5425 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:10.535287  5425 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.535728  5552 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:10.536218  5425 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.524287  5573 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:10.537565  5425 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:10.537775  5573 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.512812  5413 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.540323  5413 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:10.545126  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83686.6us
W20260709 12:21:10.562271  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45341.2us
I20260709 12:21:10.564314  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.565639  5657 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:10.566157  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.569000  3920 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:10.560374  5497 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:10.577315  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.560460  5659 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:10.579377  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89044.5us
I20260709 12:21:10.581760  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:10.583379  5662 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.584031  5662 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.585870  5667 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:10.586333  5667 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.586732  5667 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.587357  5662 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.577709  5497 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:10.583282  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:10.616099  3841 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:10.621694  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.613209  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.623211  5275 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:21:10.640179  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:10.642477  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.660202  5573 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.663910  5568 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:10.669883  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.605611  5497 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.620025  5678 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.668689  5275 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:21:10.674582  5678 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.675760  5678 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:10.679595  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 96426.5us
I20260709 12:21:10.612399  5484 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:10.685075  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 124131us
I20260709 12:21:10.627121  5510 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.691942  5469 raft_consensus.cc:2764] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:21:10.710351  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 133143us
I20260709 12:21:10.711354  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:10.695291  5584 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:10.687877  5484 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.738549  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.739272  3992 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.739517  3842 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:10.746657  5680 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.747319  5659 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:10.747395  5680 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:10.751616  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 130013us
I20260709 12:21:10.715344  5657 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.717886  5584 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.746907  5510 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.729461  5601 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.777576  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.777805  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.748085  5659 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:10.782388  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.772586  5584 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.729293  5563 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 12:21:10.786926  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75664.7us
I20260709 12:21:10.795744  3993 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:10.796203  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:10.794620  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:10.802114  5568 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.802186  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.802922  5659 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.803717  3999 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:10.805637  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.806504  3998 raft_consensus.cc:2368] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:10.807502  5685 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:10.806411  3918 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:10.808514  5685 consensus_queue.cc:1243] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:21:10.808984  5563 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.809157  5685 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.809487  5563 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.809731  5685 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:10.810536  5563 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.797958  5425 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:21:10.812286  5425 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:10.812628  5425 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:10.799878  5662 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:10.807114  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:10.813493  5662 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:10.813589  5425 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.814952  5425 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.815791  5674 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.816011  5657 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.816352  5674 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:10.816586  5657 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.817243  5678 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.817690  5674 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.810815  5685 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.819043  5657 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.820194  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:10.820983  3998 raft_consensus.cc:606] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:10.814795  5662 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.791008  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.821317  3998 raft_consensus.cc:614] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:10.831637  3995 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:10.776243  5681 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:10.832984  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.787370  5601 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.819695  5685 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.819885  5680 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.836421  3841 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:10.837776  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:10.838876  3850 raft_consensus.cc:2410] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:10.840883  3992 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:10.846836  5681 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:10.847077  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:10.848868  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:10.855424  3916 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:10.855746  3993 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:10.854499  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.858327  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.864341  5652 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:10.865460  5677 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:10.865906  5677 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:10.870582  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:10.873216  3993 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.861577  5297 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:10.866482  5563 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.849603  5436 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:10.891922  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:10.882640  5521 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:10.892737  5521 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:10.892879  5681 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:10.893193  5521 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.882656  5684 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:10.881708  5393 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:21:10.884940  5686 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:10.872972  5677 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:10.885972  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89857.2us
I20260709 12:21:10.900242  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:10.889616  5667 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.901165  5573 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:10.901580  5573 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:10.901957  5573 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.903069  5667 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.908378  3990 raft_consensus.cc:2368] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3.
I20260709 12:21:10.904810  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:10.898473  5484 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:10.903690  5616 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:10.906836  5584 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.896441  5413 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.912668  5662 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.949893  3991 raft_consensus.cc:2368] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:10.949893  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:10.951543  3842 raft_consensus.cc:2410] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:21:10.953606  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61821.5us
I20260709 12:21:10.961823  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.963429  4547 leader_election.cc:400] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:10.964947  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.965497  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.968859  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.971505  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.975068  3846 raft_consensus.cc:2368] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:10.977370  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.978030  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.978288  5584 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:10.978775  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.979007  5584 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:10.979740  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.984025  3921 raft_consensus.cc:2393] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 2: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:10.934901  5497 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:10.958065  5662 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.993034  5686 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:10.999099  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.947590  5565 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:21:11.011879  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:10.978821  3918 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.980253  5601 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:11.015342  3964 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.616s (SENT)
I20260709 12:21:10.993548  3916 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:11.036952  3921 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:11.037405  3919 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.980669  5577 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:10.993700  5686 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.041399  5413 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:11.023998  3922 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:11.047739  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55242.1us
I20260709 12:21:11.062465  3997 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:11.009931  5584 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:11.035676  5692 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:21:11.065786  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:11.056805  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.078953  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:10.965618  5502 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:11.078953  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:11.010828  5652 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:21:11.082000  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:11.057142  3993 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:11.098001  3921 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:11.101967  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 152725us
I20260709 12:21:11.107612  3888 leader_election.cc:400] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:11.091867  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:11.108144  3888 leader_election.cc:403] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:11.108517  3919 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:11.110630  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:11.120141  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 189906us
W20260709 12:21:11.122763  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.128765  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 279339us
I20260709 12:21:11.132261  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:11.133458  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:11.082828  5667 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:11.133460  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 127872us
I20260709 12:21:11.140718  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:11.140770  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0999586420000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:21:11.143121  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0125366079998912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 12:21:11.148859  3918 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:11.150470  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:11.152943  3841 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:11.084865  5616 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:21:11.154611  3844 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.155463  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:11.121497  5657 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:11.159185  3847 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.159873  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.161181  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.133006  5510 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.168716  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.183940  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:11.179210  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.196012  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.195205  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.216174  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.217708  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.217494  3991 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:11.188491  5616 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:11.174868  5497 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:11.226820  3996 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:11.229403  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 52470.2us
I20260709 12:21:11.233858  5702 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.234586  5702 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:11.235930  5709 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.236500  5709 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:11.238193  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 77163.1us
I20260709 12:21:11.238680  5709 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:11.239198  5709 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.239655  5709 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.218300  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:11.243297  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.243899  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.225272  5616 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.173237  5657 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.248005  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.247933  5616 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.248878  3992 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:11.249645  5616 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.249780  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.250578  3992 raft_consensus.cc:2368] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3.
I20260709 12:21:11.226970  5577 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:11.254029  5584 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:11.254478  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.255240  3993 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:11.224756  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51173.5us
I20260709 12:21:11.256060  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.256709  3993 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:11.257020  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.257611  3991 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.257536  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.258190  3993 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.241890  5709 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:11.259804  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:11.262740  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.263566  5709 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:11.214748  5413 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:21:11.266466  5700 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:11.267202  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.268996  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.297267  3848 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:11.266032  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.269697  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:11.270169  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.269970  5674 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:11.251356  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.293905  3994 raft_consensus.cc:2410] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:11.302484  3991 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:11.303563  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:11.304239  3994 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:11.302541  3992 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:11.307579  3995 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:11.308012  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:11.307928  5674 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.310245  5674 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:11.310290  5393 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:11.310750  5393 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:11.262823  5573 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.323007  3847 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:11.337841  3993 raft_consensus.cc:2410] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:21:11.342396  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 76474.4us
I20260709 12:21:11.342686  5573 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:11.316313  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60269.6us
I20260709 12:21:11.343357  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.345552  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.346455  5710 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:11.347222  5710 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.347848  5700 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.348888  5700 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:11.350844  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.356426  5710 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:11.357733  3842 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.364786  5662 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:11.318068  3990 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:11.347332  5565 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:11.380954  3995 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:11.381850  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.382009  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:11.390766  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.394063  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.397926  3849 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:11.401290  3916 raft_consensus.cc:2955] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:11.405107  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.405994  3848 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:11.370626  5497 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:11.379902  5565 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.423753  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:11.431870  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.396803  5678 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:11.438526  5710 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:11.439179  5565 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.440455  5565 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:11.440943  5521 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.008s
I20260709 12:21:11.441380  5521 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:11.446003  5563 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.003s
I20260709 12:21:11.446648  5678 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.450675  5521 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:11.453143  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 130185us
I20260709 12:21:11.429464  5662 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:11.412591  5680 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:21:11.452636  5681 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.002s
I20260709 12:21:11.467952  3996 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:11.432576  5497 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:11.434722  5659 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:11.500135  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76419.8us
I20260709 12:21:11.399886  5393 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:11.500943  5497 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.505173  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:11.453300  5678 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:11.510329  5699 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:21:11.523615  5702 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:11.481226  5677 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 12:21:11.529491  5677 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.439149  5710 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:11.532781  3844 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.533720  5677 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:11.534042  5601 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:11.536490  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109198us
W20260709 12:21:11.582868  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46594.2us
I20260709 12:21:11.491856  5681 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:11.586521  5510 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:11.592643  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.491688  5659 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:11.592026  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:11.579214  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 235176us
I20260709 12:21:11.600549  5659 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.636713  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:11.614872  5616 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:11.633965  5393 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.612528  5521 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:11.647570  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:11.632867  3925 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 2.
I20260709 12:21:11.656904  3842 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:11.658771  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.662213  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.670599  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:11.676661  3843 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.677047  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:11.650918  5616 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:11.685757  3848 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:11.591413  5601 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:11.680773  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.679848  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:11.692860  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:11.663765  5521 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:11.675925  4577 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:11.692008  3814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.671s (SENT) [suppressed 14 similar messages]
I20260709 12:21:11.676235  5677 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.688743  5616 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.695761  5662 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:11.696779  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.690783  5436 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:11.671038  5702 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:21:11.717375  5521 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:11.750059  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.718791  5667 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:11.757056  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64300.2us
I20260709 12:21:11.763087  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:11.718096  5700 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:21:11.679173  5710 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:11.809773  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.813256  5686 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:11.813726  5601 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:11.816706  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49418.2us
I20260709 12:21:11.790015  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:11.790966  5705 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:11.791091  5678 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:11.791399  5714 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:11.791838  5708 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:21:11.792496  5719 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:11.721949  5580 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:21:11.761445  5552 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:21:11.835192  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45306.1us
I20260709 12:21:11.840773  3848 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:11.730598  5662 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.726317  5677 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.732412  5473 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 12:21:11.870062  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:11.756547  5436 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:11.825537  5714 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.820191  5705 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:11.842953  5497 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:21:11.851845  5719 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.909832  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:11.865583  5573 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:11.886574  5662 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:11.909924  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 156780us
I20260709 12:21:11.871253  5678 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.847641  5601 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:21:11.914925  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97334us
I20260709 12:21:11.911535  5705 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.871631  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:11.908414  5714 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.865772  5552 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.943329  3841 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:11.945441  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 75537.9us
I20260709 12:21:11.915400  5719 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.917388  5573 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:11.958688  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 209948us
I20260709 12:21:11.917083  5584 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:21:11.940963  5667 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:11.951634  5563 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.938855  5681 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:11.954008  5565 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:11.956925  5573 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.968362  5738 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:11.968606  5497 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.962476  5684 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.974069  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:11.976604  5734 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:21:11.977073  5702 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:11.977958  5711 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:21:11.978637  5552 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.958691  5601 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:11.964178  5739 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.010139  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.010711  5740 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.010841  5552 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:12.021704  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47702.1us
I20260709 12:21:11.998077  5565 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:11.987784  5563 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:12.032877  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45666.7us
I20260709 12:21:12.060386  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:12.058135  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 86034.5us
W20260709 12:21:12.067426  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.012837  5739 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.005805  5684 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:11.999598  5497 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:12.097421  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.101176  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:12.090077  5584 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:12.017269  5601 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.107880  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:12.111110  3814 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.558s (SENT)
I20260709 12:21:12.013737  5678 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.123631  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.124871  3924 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:12.126394  3922 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:12.127369  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.128352  5733 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.128510  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.129361  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.130823  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:12.099422  5677 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.133019  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:12.133315  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.133513  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.134696  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.134986  5739 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.135725  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.135848  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:12.136358  5739 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.137036  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.138226  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.139226  5740 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:12.139945  5740 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:12.140604  5740 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:12.142339  5705 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.100274  5667 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.144513  5705 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.144779  5616 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.145970  3848 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:12.154459  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.121042  5741 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.165712  5469 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.166299  5469 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.167932  5685 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.168414  5685 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:12.147125  5616 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:12.168455  5563 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.196933  5702 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:12.198319  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60163.8us
I20260709 12:21:12.199361  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.200901  5497 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.167309  5469 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.207762  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:12.204258  5659 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.006s
I20260709 12:21:12.237394  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.240777  3918 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.229852  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.192437  5700 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.242599  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:21:12.247789  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48533.7us
I20260709 12:21:12.236325  5747 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.247758  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.238423  5497 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.251154  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.203191  5662 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.203275  5521 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.253365  3921 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.208057  5702 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.241902  5552 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.258903  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.261806  3922 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.249466  5616 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.163280  5565 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.263710  3918 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:12.253652  5469 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.270955  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.271152  3919 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:12.271468  3918 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:12.241940  5714 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.246140  5700 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.243846  5659 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.266057  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.268551  5616 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:12.258905  5747 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.268651  5552 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.277941  5580 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.265727  5752 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:12.283596  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.259279  5573 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.302464  5616 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.308064  5552 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.304984  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.309190  3846 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.302213  5714 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.275820  5741 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.313733  5741 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.314194  5741 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.273986  5497 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:12.285473  5521 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.266630  5667 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:21:12.287180  3845 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.329772  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.329772  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.330472  3923 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.330695  5616 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.287261  5738 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:12.287940  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.288712  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.289233  3847 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:12.275225  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.290735  5702 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.334187  3847 pending_rounds.cc:85] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 1
I20260709 12:21:12.293232  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.334913  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:12.291220  4575 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.300139  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.337028  3842 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:12.284896  5662 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.317338  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.293202  5659 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:12.334959  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59789.7us
I20260709 12:21:12.293885  5700 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.335517  3847 pending_rounds.cc:107] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:12.339020  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.339761  3847 raft_consensus.cc:2889] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.338660  3916 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.340960  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.342499  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.343248  3916 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.339500  5552 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.315649  5580 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.347618  5580 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.348838  5580 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.351138  3846 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:12.358916  5436 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.360438  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.357613  5719 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.361173  3925 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:12.355079  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.362243  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.362916  3925 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.363927  5577 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:12.366429  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.367750  5678 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.367884  5662 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.370280  5678 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.368006  5700 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:12.338119  5738 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:12.369159  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.375972  3916 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.364739  5657 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.377787  5747 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.375352  3845 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:12.373939  3745 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.379541  5563 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.391366  5563 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:12.392409  5563 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.393813  3922 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:12.372999  5577 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:12.395843  5601 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.381680  5685 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.396309  5577 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.395242  3923 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:12.403946  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51443.2us
I20260709 12:21:12.363230  5719 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:12.384829  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.388582  5684 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:12.388888  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.412230  5729 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:12.413159  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.390321  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.414386  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.415125  5497 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:12.416008  5497 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.416342  5497 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.416682  5497 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.417902  5521 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:12.419875  5667 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.420441  5667 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.419919  5521 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.421728  5521 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.421353  5667 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.422645  5521 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.423983  5521 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.390298  5710 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.424863  5710 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.413319  5729 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.425848  5729 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:12.425714  5710 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.426892  5729 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.428385  5729 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:12.429530  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90592.5us
I20260709 12:21:12.450233  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.397693  5738 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:12.426775  5710 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.435024  3847 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:12.461719  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.436077  3850 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.463435  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.455312  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:12.457407  3745 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 2, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.458202  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.430922  5678 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.467180  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:12.472723  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.473306  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:12.485802  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 131044us
I20260709 12:21:12.441735  5685 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.492616  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.461062  5738 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.460230  5719 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:12.499799  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.505276  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.507251  3847 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:12.482407  5731 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:12.511977  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.482692  5473 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.460594  5700 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:21:12.467700  5747 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.509011  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.507215  5705 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:12.506275  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:12.515522  3925 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.527730  3919 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.516914  3850 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.505439  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.501835  5677 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.534169  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:12.512014  5731 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:12.480785  5552 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.525180  3916 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.537798  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.517961  5473 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.524210  5752 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:12.549228  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56699.1us
I20260709 12:21:12.550530  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.517611  5702 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:21:12.517455  5662 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:12.532490  5484 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:12.558173  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.562566  3996 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:12.562657  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.564081  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.574780  3848 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.540153  5705 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:12.539157  5677 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.582703  5563 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.579988  5577 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:12.578130  5752 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.612236  5752 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.614743  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.615033  5473 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.616182  5473 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.616991  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.617818  4578 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:12.618355  5739 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:12.618796  5739 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.621234  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.577536  5573 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.599980  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.586805  5552 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.601696  5712 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.602689  3990 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:12.603088  5759 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.638827  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.603914  5741 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.605504  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.606348  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.647517  3999 raft_consensus.cc:2376] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5. Re-sending same reply.
I20260709 12:21:12.649061  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.650058  3999 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:12.607359  3992 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:12.632453  3919 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:12.633478  3995 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:12.637635  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73661us
I20260709 12:21:12.683164  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.596907  5563 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.654793  3998 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:21:12.654422  5705 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.657876  5677 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.659216  5584 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.660241  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:12.660550  5616 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:12.662029  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.663923  5484 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:12.685920  5563 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.669153  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.636101  5552 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.672672  5726 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:12.673882  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.598418  5577 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.676370  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:12.678928  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51418.6us
I20260709 12:21:12.653054  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.697324  3996 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.639195  5712 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:12.588261  5731 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.711475  5731 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.712568  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.712978  5709 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.713368  5709 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.713866  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.701495  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.714278  5709 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.715072  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:12.696615  5584 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.710348  5484 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.722054  5747 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.711537  5712 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.698395  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.722288  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.722879  3998 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.715380  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.724088  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.715674  5616 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.716421  5773 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.717506  5767 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:12.719101  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.699308  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.733266  3995 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:12.733512  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:12.725602  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.731343  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.706377  5552 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.725134  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.734356  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:12.726890  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.708799  5577 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.686655  5738 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.739650  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.766508  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.757539  3998 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:12.767249  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.760807  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.756423  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:12.768900  3992 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.730228  5771 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:12.722502  5747 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:12.773847  3991 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:12.780272  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.695387  5739 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.676995  5759 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:12.808485  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 105899us
I20260709 12:21:12.742305  5659 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:12.821795  3996 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:12.825973  3994 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:12.826301  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 125661us
W20260709 12:21:12.830788  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 105735us
I20260709 12:21:12.755890  5767 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:12.837215  3991 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:12.733775  5399 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 12:21:12.832535  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.832736  3843 raft_consensus.cc:606] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:12.793098  5700 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.831789  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:12.792042  5681 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.709090  5726 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.856108  5767 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.824957  5659 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:12.860049  5659 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.831936  5772 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.790614  5601 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.842862  3995 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:12.789186  5521 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:12.775115  5684 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:12.861801  3999 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:12.862841  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 166675us
I20260709 12:21:12.836181  5568 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:12.883901  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:12.884433  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.886461  5677 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:12.844844  5712 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.897612  5712 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:12.840437  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60269.1us
I20260709 12:21:12.880308  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:12.881903  4577 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:12.875785  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:12.905961  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:12.839854  5584 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:12.843357  5667 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:12.866060  5772 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.909498  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:12.873600  5739 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.916836  3848 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.909677  5473 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:12.900861  5521 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.920885  5521 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.871829  5601 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.921772  5601 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.922240  5710 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.921697  5747 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.911988  5684 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:12.923893  5684 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.924677  5710 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.925701  5710 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.926051  5710 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:12.926806  5726 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.926970  5710 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.928376  5710 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.929311  5759 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.933398  5616 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:12.932876  3745 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.934001  5616 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.921204  5783 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.935663  5783 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:12.936295  5700 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:12.936800  5700 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.937218  5616 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:12.936731  5783 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.938289  5783 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.943403  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.946888  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.883949  5568 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:12.919114  5473 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.934788  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 4, term changed from 3 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68), VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted, no longer has a pending config: VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65), VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66), VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.954169  3990 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:12.955248  5738 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.955631  5473 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.956173  5741 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.915478  5772 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.864302  5681 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.961750  5681 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.872448  5497 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.963184  3745 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.964534  5497 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:12.966996  3745 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:12.972591  5601 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:12.973237  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:12.973564  3745 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.888890  5677 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:12.975795  5729 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:21:12.985738  3745 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.978171  4577 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:12.984655  5677 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.990944  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:13.034932  3848 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:12.993100  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:12.995715  5678 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:13.035583  3745 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:12.999701  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 211) took 8126 ms. Trace:
I20260709 12:21:13.002682  5552 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.044838  5552 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.005085  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:13.006009  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:13.045959  3844 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:13.046758  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.038195  5678 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.006083  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:13.005138  5563 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.051739  3849 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.052150  3849 raft_consensus.cc:614] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:13.051899  5678 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.010082  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:13.053203  5678 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.053326  5563 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.012861  5772 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.055779  5772 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:12.918112  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.023025  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:13.025934  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.954325  5568 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.059147  5710 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:13.059788  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 286857us
W20260709 12:21:13.060609  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 142899us
I20260709 12:21:13.061282  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.062151  5747 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.062712  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.032770  5584 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.069494  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.073829  5563 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:13.074352  5563 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:13.064693  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.002988  5659 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.061369  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.069519  3844 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:13.076813  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.078446  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.083201  3993 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:13.038928  3745 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 1 to 3, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:13.090533  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.091255  3919 raft_consensus.cc:2376] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3. Re-sending same reply.
I20260709 12:21:13.092231  3918 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:13.093631  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.094698  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.095022  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.095662  3918 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:13.095904  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.096475  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.096715  3922 raft_consensus.cc:2410] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:13.097607  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.097733  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.097607  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.098824  5772 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.099323  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.099632  5772 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.100107  3922 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:13.100894  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.100666  5772 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.101460  3922 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.111948  3997 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.113364  3998 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:13.113823  3999 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.114645  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.115417  3998 raft_consensus.cc:2368] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:13.115528  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.115716  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.116982  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.117622  3999 raft_consensus.cc:2376] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6. Re-sending same reply.
I20260709 12:21:13.119053  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.074750  5563 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.120378  3992 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.090731  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.005249  5577 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.122673  3998 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.122875  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.123751  3996 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.126183  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.126454  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.126609  5765 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:13.126899  3998 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:13.127732  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.127925  3990 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:13.132475  3919 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:13.133265  5659 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.134052  3919 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:21:13.110545  5731 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:13.135949  5731 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:13.136437  5601 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.128715  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.136968  5731 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.138626  3925 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:21:13.129200  3920 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:13.140058  3844 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.140748  3920 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.141252  5577 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.110141  5710 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.129339  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.127835  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.144207  3923 raft_consensus.cc:2376] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3. Re-sending same reply.
I20260709 12:21:13.129745  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.127092  3917 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:13.129817  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:13.146111  3997 raft_consensus.cc:606] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.146504  3997 raft_consensus.cc:614] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:13.127233  3996 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:13.110704  5667 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:13.130034  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.151754  3995 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:13.130558  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.123950  5497 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.127128  5765 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.069684  5773 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.148429  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:13.158687  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.159572  3993 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:13.150075  3999 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.147646  3919 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:13.153137  3916 raft_consensus.cc:2410] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:13.153345  3922 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:13.156087  3991 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:21:13.161986  3991 pending_rounds.cc:85] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 2
I20260709 12:21:13.162298  3991 pending_rounds.cc:107] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:21:13.162583  3991 raft_consensus.cc:2889] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:13.163018  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.163842  3850 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:13.038949  3746 rpcz_store.cc:276] 0709 12:21:04.873517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.873854 (+   337us) service_pool.cc:224] Handling call
0709 12:21:12.999609 (+8125755us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:10.159682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:10.160582 (+   900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:10.160646 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:21:10.160671 (+    25us) tablet.cc:662] Decoding operations
0709 12:21:10.161530 (+   859us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:10.161654 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:10.161700 (+    46us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:10.162217 (+   517us) tablet.cc:701] Row locks acquired
0709 12:21:10.162282 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:21:10.162499 (+   217us) write_op.cc:270] Start()
0709 12:21:10.162687 (+   188us) write_op.cc:276] Timestamp: P: 1783599670162432 usec, L: 0
0709 12:21:10.162733 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:21:10.235724 (+ 72991us) log.cc:844] Serialized 1303 byte log entry
0709 12:21:10.541857 (+306133us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b18002c0ec0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:10.820659 (+278802us) op_driver.cc:464] REPLICATION: finished
0709 12:21:10.933336 (+112677us) write_op.cc:301] APPLY: starting
0709 12:21:10.933479 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:10.933685 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:10.933736 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:11.060424 (+126688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:11.188595 (+128171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:11.218529 (+ 29934us) write_op.cc:312] APPLY: finished
0709 12:21:11.366696 (+148167us) log.cc:844] Serialized 35 byte log entry
0709 12:21:11.385419 (+ 18723us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:11.397122 (+ 11703us) write_op.cc:454] Released schema lock
0709 12:21:11.412319 (+ 15197us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:11.426911 (+ 14592us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:11.430662 (+  3751us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":198744,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":61492,"apply.run_cpu_time_us":4550,"apply.run_wall_time_us":498749,"num_ops":3,"prepare.queue_time_us":381305,"prepare.run_cpu_time_us":23968,"prepare.run_wall_time_us":320106,"raft.queue_time_us":219858,"raft.run_cpu_time_us":7655,"raft.run_wall_time_us":39397,"replication_time_us":657712,"spinlock_wait_cycles":20767872,"thread_start_us":613777,"threads_started":4,"wal-append.queue_time_us":260234,"wal-append.run_cpu_time_us":70755,"wal-append.run_wall_time_us":1904868}]]}
I20260709 12:21:13.165784  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:13.126471  5786 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.166826  3918 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:13.167560  3925 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:13.168751  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.169471  3992 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:13.176990  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.177726  3997 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:13.081607  5584 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.155124  5765 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.180806  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.183770  3997 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:13.191133  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.191996  3996 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:13.165827  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.194129  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.167754  5667 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.196897  3992 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.197222  5752 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:13.226305  3918 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.226179  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.227072  3916 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:13.227833  5773 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.227883  5785 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.229027  5785 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.231289  5684 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.231876  5684 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.233917  5684 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.234360  5785 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.237130  5584 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:13.242102  3918 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.243743  3918 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.243757  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.245714  3922 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.249449  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.252305  3921 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:13.252821  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.253877  3992 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.253930  3923 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:13.254537  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.255122  3920 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.255839  3917 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.257126  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.259275  3918 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.267731  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:13.268689  3997 raft_consensus.cc:606] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.269202  3997 raft_consensus.cc:614] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:13.269656  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.270834  3992 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.271272  3919 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 1. Current term is 2. Ops: []
W20260709 12:21:13.272565  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.306229  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.300647  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.326855  3923 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:13.309526  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.316813  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:13.327596  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:13.317355  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.328930  3921 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.318938  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:13.327975  3849 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:13.279984  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.331292  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.332233  3924 raft_consensus.cc:2410] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:13.332623  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.335206  5772 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.351895  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.335884  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:13.337218  5652 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:13.338552  5700 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.341463  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:13.342806  4547 leader_election.cc:400] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4.
I20260709 12:21:13.363678  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.365005  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.288800  3990 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.366230  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.367973  3921 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:13.343391  5667 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.344636  5738 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.301970  5677 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.369971  5738 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.370486  3843 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.371065  5738 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.371897  5677 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.342715  5436 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:21:13.372596  5738 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.380211  5779 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.352679  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:13.381836  3841 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.355134  5767 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.358011  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:13.383930  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.358778  5552 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.359510  5788 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.360671  5772 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.389690  5700 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.389930  5772 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.373528  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.390028  5712 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:13.391036  5667 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.390950  5772 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.391431  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.391702  5712 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.378428  3920 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:13.349365  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:13.395241  3919 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:13.379108  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.378943  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.380097  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.354544  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:13.396600  3918 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.385469  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:13.389554  5705 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.397713  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.376813  5563 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:13.373615  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.401379  5786 raft_consensus.cc:2764] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:13.402711  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.402977  5563 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:13.373536  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.350011  3917 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.400826  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.384155  5717 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.404510  5436 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:13.405108  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.405920  3921 raft_consensus.cc:2410] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:13.392143  3923 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.407967  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.392737  5565 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:13.408527  5652 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:13.408782  5747 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.411015  5757 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.410478  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:13.390188  5616 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.395588  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.403962  5786 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.392262  5772 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.415680  5785 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:13.381848  4577 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:13.387235  5773 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.424226  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.395512  5399 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.429685  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:13.395622  5752 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:13.430739  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.409731  5765 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.437839  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.438342  5616 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.465024  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.466331  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.467550  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.438486  5497 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.427621  5755 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:13.472921  5755 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:13.473515  5755 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.435613  5705 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:21:13.452797  5399 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:13.474670  5659 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.423375  5436 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:13.450879  3923 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:13.398293  5677 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:21:13.483511  3920 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.475351  5399 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:13.467039  5601 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.488003  5399 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.489562  5497 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.446177  5730 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.464869  5616 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.491777  5616 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.492966  5616 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.496658  5436 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:13.497503  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:13.460626  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73102.7us
I20260709 12:21:13.395943  5767 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.431423  5726 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:13.434159  5552 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:21:13.427834  5565 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.462978  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.472103  5584 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.486653  3917 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:13.463069  5752 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.465684  5712 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.477037  5739 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.475262  5738 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:13.516336  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49381.1us
I20260709 12:21:13.522290  3843 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.512336  5565 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:13.525280  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 57827.3us
W20260709 12:21:13.527839  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64943.8us
I20260709 12:21:13.527736  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.525295  3844 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:13.513621  5726 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:13.515874  5436 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.540256  3843 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.515259  5752 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.543434  5584 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.543645  5738 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:13.544373  5584 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:13.529844  5712 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.524083  5677 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:21:13.548480  5712 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.526675  5684 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.563705  5765 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.564746  5667 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:13.565181  5667 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.568949  5767 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:13.574930  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46041.8us
I20260709 12:21:13.575747  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.574116  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.566007  5667 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.580839  3843 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:13.580906  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53330.5us
I20260709 12:21:13.583241  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.584111  5810 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:13.584560  5810 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.584141  5659 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.584920  5810 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.586859  3841 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:13.589214  5710 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.591674  5709 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.594738  5667 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.597594  5784 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.598240  5784 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.595112  5810 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.581305  5497 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:21:13.540979  5726 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.609745  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.524283  5785 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:21:13.583045  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:13.613687  5473 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:13.615178  5497 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:13.611107  5681 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.602749  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:13.616394  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.648342  5681 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:13.605072  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.601145  5810 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:13.602232  5765 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.650636  5681 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:13.652153  5808 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.644111  5497 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.653806  5497 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.655035  5497 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.619822  5747 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:13.601941  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:13.656087  3843 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:13.620939  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46932.7us
I20260709 12:21:13.602766  5659 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:21:13.605636  5802 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.189s	user 0.005s	sys 0.000s
I20260709 12:21:13.624188  5786 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:13.641130  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58199.4us
I20260709 12:21:13.646354  3844 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:13.667376  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:13.668813  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 66151.5us
I20260709 12:21:13.670329  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.676848  3843 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:13.644868  5473 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.679906  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.684499  5733 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.667620  5747 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.668289  5601 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.681851  5808 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:21:13.690220  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.689602  5809 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.690856  5810 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:13.701470  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.668252  5786 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.599434  5784 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.664556  5757 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.697024  5741 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:13.725303  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:13.704114  5808 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.682163  5730 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:13.707974  5786 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:13.729169  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54703.2us
I20260709 12:21:13.725800  4578 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:13.780088  5667 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.780800  5667 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.781476  5712 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:13.784708  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:13.793860  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 109940us
I20260709 12:21:13.692694  5747 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.730598  5741 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:13.803561  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.795723  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.817538  3919 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:13.818876  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:13.796151  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45651.4us
I20260709 12:21:13.807086  3923 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:13.811605  3918 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.799849  5730 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:13.822706  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:13.823361  3920 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.821412  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:13.831888  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.840186  3919 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:13.840523  3920 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:13.842795  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.845527  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:13.801738  5552 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.847054  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:13.849640  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.857504  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.858672  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.857559  5469 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:13.849324  5563 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.862542  5563 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.863500  5563 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.864816  5563 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.830082  5765 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.867841  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:13.829497  5705 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.830770  5667 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:13.735419  5473 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.838080  5772 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.876681  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.848414  5767 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:13.854046  5552 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.838183  5808 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.851392  5521 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.875725  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.876348  5584 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.856036  5577 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:13.881155  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.887633  3997 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:13.868691  5662 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.911841  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.902215  3998 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:13.912492  3994 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:13.850781  5810 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:21:13.902920  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.850998  5712 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:21:13.906323  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.916497  3993 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:13.851967  5678 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:21:13.872406  5469 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.909116  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.855523  5807 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:21:13.912772  3991 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.888985  5731 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.907302  5733 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:13.922608  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.936309  3999 raft_consensus.cc:2376] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5. Re-sending same reply.
I20260709 12:21:13.937284  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.880220  5705 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.919189  5473 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.905644  5772 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.939803  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.944180  3994 raft_consensus.cc:2410] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:13.928627  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.945442  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.946153  3999 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.946292  3993 raft_consensus.cc:2410] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:13.945365  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.949604  3994 raft_consensus.cc:2376] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3. Re-sending same reply.
I20260709 12:21:13.920212  5577 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.965988  3994 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:21:13.966607  3994 pending_rounds.cc:85] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 2
I20260709 12:21:13.926321  5767 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:13.970506  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:13.907130  5752 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.972198  3995 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:13.932864  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.973656  3994 pending_rounds.cc:107] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:21:13.979298  3994 raft_consensus.cc:2889] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:13.941759  5731 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.923269  5741 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:13.997473  3999 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:13.998721  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:13.999418  3999 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:14.000716  3999 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:13.986132  3990 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:14.006239  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.007223  3998 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:14.007751  5577 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.031896  3991 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:14.036693  5823 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:13.969662  5552 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.046559  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:14.047870  3922 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:14.041913  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.044679  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:14.042428  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:14.049578  3917 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.039124  3990 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:14.043277  3921 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:14.056555  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.079638  3917 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:14.082036  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:14.085356  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.086221  3999 raft_consensus.cc:2410] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:14.086795  5563 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.086249  5552 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:14.088905  5786 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.090153  3925 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:14.090967  5565 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
I20260709 12:21:14.091104  5786 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.030864  5705 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.027685  5772 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.096571  3916 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:14.101804  3916 pending_rounds.cc:85] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 1
I20260709 12:21:14.102113  3916 pending_rounds.cc:107] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:14.102458  3916 raft_consensus.cc:2889] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:14.100201  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:14.106323  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49920.2us
I20260709 12:21:14.107141  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.108016  3999 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:14.109094  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.110217  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.111122  3999 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:14.111868  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:14.114279  3917 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:14.115906  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.123297  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.178332  3999 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:14.127429  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.169509  5436 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.180358  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.074569  5807 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:14.094309  5755 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.005s
I20260709 12:21:14.122314  5601 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:14.136575  5771 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.139132  5678 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.097559  5765 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.122531  5786 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.186082  5786 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:14.186232  5731 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.186678  5786 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.075963  5738 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:14.147233  3992 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:14.109493  5733 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.097445  5710 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:14.109683  5584 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:14.118723  5563 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 12:21:14.175760  5726 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.001s
I20260709 12:21:14.091418  5565 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.109546  5712 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:21:14.181938  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.221674  3999 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:14.174613  5709 consensus_meta.cc:287] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.001s
W20260709 12:21:14.189728  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.094683  5767 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.193039  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.227037  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.229950  3843 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:14.233871  5659 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:14.193219  5601 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.238061  5601 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.189270  5755 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.240185  3918 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.241441  5755 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.217782  5733 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.254729  5733 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:14.257678  5809 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.008s
I20260709 12:21:14.258318  5809 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.208243  5584 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.259645  5584 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.262619  3993 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:14.274745  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 343811us
I20260709 12:21:14.208932  5765 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.297708  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:14.193383  5827 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.298723  3846 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.305284  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.305554  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.306313  3844 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:14.307016  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:14.307343  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.309434  5755 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:14.189832  5436 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.312777  5436 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.313493  5784 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:14.264478  5757 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:14.322731  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.323748  3919 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:14.217581  5808 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:21:14.334169  3996 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:14.302994  4577 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.004s
I20260709 12:21:14.220352  5662 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:21:14.329864  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:14.212386  5738 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.213337  5710 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.296662  5752 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.220042  5726 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.318617  5473 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:14.342442  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:14.358321  3846 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
W20260709 12:21:14.360411  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 248663us
I20260709 12:21:14.336664  5739 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.317059  5765 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.340197  4577 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:14.348413  5436 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:14.410070  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 208364us
I20260709 12:21:14.423095  3999 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:14.433243  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.434175  3848 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:14.436180  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:14.448328  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:14.460449  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:14.387045  5709 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.454207  5820 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:14.449666  5436 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.359073  5473 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.459581  4578 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.467660  5659 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:14.457059  5705 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:21:14.470028  5712 raft_consensus.cc:2764] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:14.407585  5739 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.490770  5726 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.476257  5436 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.474500  5709 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.492023  3845 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:14.506083  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.487524  5752 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:21:14.496826  5659 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:14.498543  5565 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.515558  3999 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:14.521660  5473 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:14.588366  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 177317us
I20260709 12:21:14.589198  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.566519  5731 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:14.595502  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:14.578480  5738 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.601096  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:14.604601  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 153801us
I20260709 12:21:14.607137  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:14.608314  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.565970  5584 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.608418  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.591596  5765 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.615871  5808 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:14.604074  5731 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:14.651367  5497 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.995s	user 0.014s	sys 0.000s
I20260709 12:21:14.664525  5741 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.626706  5601 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:21:14.625555  5755 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.592419  5659 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:14.691319  5837 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:21:14.718302  5755 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:14.722623  5808 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:14.722841  5741 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:14.723683  5817 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.006s
I20260709 12:21:14.724128  5709 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.724586  5584 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.705382  5586 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.728329  5821 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.742s	user 0.005s	sys 0.000s
I20260709 12:21:14.728843  5813 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.760854  5741 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:14.730110  5834 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:21:14.761441  5731 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.733933  5816 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:14.767730  5816 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.770169  5816 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.773908  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.746488  3997 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:14.751461  5808 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:14.741580  5841 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:21:14.760558  5813 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:14.732016  5851 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:21:14.761739  5586 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:14.732772  5839 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:21:14.763621  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1488) took 1037 ms. Trace:
I20260709 12:21:14.781984  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:14.783033  4577 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:14.785244  5586 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.786095  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:14.750183  5755 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.766335  5436 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.779690  5855 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.765731  5832 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.423s	user 0.002s	sys 0.000s
I20260709 12:21:14.781924  3849 rpcz_store.cc:276] 0709 12:21:13.726549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.726693 (+   144us) service_pool.cc:224] Handling call
0709 12:21:13.727880 (+  1187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.733409 (+  5529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.733459 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.734058 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:21:13.849999 (+115941us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:13.850057 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.850156 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.727652 (+877496us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:14.763293 (+ 35641us) raft_consensus.cc:1685] finished
0709 12:21:14.763321 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.763552 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1852,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":34085,"spinlock_wait_cycles":7152000,"thread_start_us":48055,"threads_started":1,"wal-append.queue_time_us":144573}
I20260709 12:21:14.787884  5808 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.789152  3998 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.801836  5584 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:14.817493  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.819304  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:14.820732  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.824326  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.801232  5816 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:14.826283  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.827114  3995 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:14.802614  5855 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.833465  5855 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.836907  3994 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:14.817830  5741 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.799561  5684 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:21:14.823957  5469 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:14.840268  4575 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:14.836392  5816 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:14.841687  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 405593us
I20260709 12:21:14.817675  5584 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.845247  5855 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.854606  5855 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.849011  5469 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.850795  5816 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:14.865166  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:14.865986  3995 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:14.868597  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.870949  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:14.871598  3921 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.874954  3923 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:14.881963  5705 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:14.890152  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:14.853530  5772 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:21:14.895730  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:14.901180  5584 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.901914  5731 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:14.902496  5731 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:14.903810  5436 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.845639  5741 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.883185  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:14.903872  5786 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.717s	user 0.014s	sys 0.001s
I20260709 12:21:14.903672  5731 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.921908  5731 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.921130  5867 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:14.923418  5867 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:14.921785  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.917569  5786 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.926484  5786 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.927863  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.928100  5755 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.928710  3846 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:14.930359  5755 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.935703  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:14.939414  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:14.939706  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:14.942991  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:14.923133  5816 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.943881  5681 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.944310  5681 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:14.944710  5681 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.945412  5816 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.936687  3843 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:14.942863  5741 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.946964  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:14.949746  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1653) took 1074 ms. Trace:
I20260709 12:21:14.950001  3991 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:14.950371  3996 rpcz_store.cc:276] 0709 12:21:13.875635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.875978 (+   343us) service_pool.cc:224] Handling call
0709 12:21:14.949489 (+1073511us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54003e3854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:14.949663 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906342272}
I20260709 12:21:14.955557  5684 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.956156  5684 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.955796  3921 raft_consensus.cc:2410] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:14.957358  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:14.957952  5772 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:14.958138  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:14.965337  5436 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:14.965948  5813 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.966023  5436 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.966723  5436 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.961952  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:14.962047  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:14.968079  3919 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:14.962595  3924 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:14.958681  5678 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.969548  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1632) took 1156 ms. Trace:
I20260709 12:21:14.969223  5678 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.969946  3918 rpcz_store.cc:276] 0709 12:21:13.812778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.829605 (+ 16827us) service_pool.cc:224] Handling call
0709 12:21:13.830040 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.240560 (+410520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.969291 (+728731us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54001cf054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:14.969464 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942795008}
I20260709 12:21:14.971457  5678 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:14.958240  5684 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:14.972741  5829 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
I20260709 12:21:14.976100  5739 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.975791  5772 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.977419  5710 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.978157  5772 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.979394  4578 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:14.982056  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:14.982975  5684 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:14.955166  5855 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:14.984404  5827 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:14.984937  5827 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:14.985878  5827 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:14.990250  5772 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:14.990975  5772 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:14.991971  5772 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:14.992245  5729 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:14.992903  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1669) took 1108 ms. Trace:
I20260709 12:21:14.993363  5729 consensus_queue.cc:1243] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:14.993319  3993 rpcz_store.cc:276] 0709 12:21:13.884873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.948961 (+ 64088us) service_pool.cc:224] Handling call
0709 12:21:14.992733 (+1043772us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002959d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:14.992846 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638305536}
I20260709 12:21:14.994427  5813 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:14.994897  5813 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:14.996409  5813 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.003576  5705 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:15.004256  5705 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.008188  5521 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.009687  5521 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.003862  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:15.012142  3924 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.013212  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.013940  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.013213  3922 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.014590  3916 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:15.016896  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:15.018774  5700 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:15.019338  5700 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:15.019722  5705 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:15.021289  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.022240  5521 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:14.982084  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.025317  3921 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.027313  5469 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:15.027908  5469 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.028399  5469 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.029052  5741 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.029040  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.032445  3890 leader_election.cc:400] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:15.032791  3890 leader_election.cc:403] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:15.033288  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.034935  3996 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:15.033504  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.035928  3993 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:15.037340  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:15.038215  3846 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.053694  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.056407  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.058424  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:15.061707  3924 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:15.063221  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.069975  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.063277  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.070899  3924 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:15.073493  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.074205  3847 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:15.079890  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:15.080235  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46147.5us
I20260709 12:21:15.080742  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.082561  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.084718  3848 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:15.089010  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.090864  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.071141  3992 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:15.097100  3924 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.068326  5816 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.081507  5681 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.102346  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.103965  5681 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.099284  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.111557  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:15.063611  5484 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.119131  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.081360  5757 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.113727  5469 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:15.097353  5788 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:15.107506  5741 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.096758  5807 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:15.153318  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.114324  5784 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:15.127086  5752 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.020200  5700 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.116998  5747 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:21:15.157914  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:15.149101  5788 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.175088  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:15.079726  5773 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:21:15.164876  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.168872  3846 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:15.172345  5862 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:21:15.173224  5835 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.177392  3842 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:15.178407  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.184675  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:15.159698  5469 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.156840  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.196441  3919 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:15.200675  5709 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.203797  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.213783  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.214113  3991 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.213953  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.214892  3993 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.162989  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.224756  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.225549  3992 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:15.184001  5788 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.174255  5784 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:15.184438  5752 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.233623  3999 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.235642  3842 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.234318  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.228878  3923 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:15.156980  5741 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.205183  5810 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.215560  5773 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.215708  5705 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.241875  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.216110  5739 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:15.245102  3996 raft_consensus.cc:2410] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:15.245318  5784 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.247617  5844 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:15.250434  5813 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:15.251967  5870 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:21:15.253006  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.254282  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.214840  5733 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:15.261919  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.263419  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.264973  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.245358  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.272330  3993 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:15.234362  5730 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:15.273203  3998 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:21:15.273947  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.275087  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.279192  3990 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.271272  3991 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:15.276847  4581 raft_consensus.cc:2410] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:15.280692  3995 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:21:15.272197  5752 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.233160  5843 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.293063  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.294241  3991 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 3: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:15.261008  5755 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.301880  5755 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:15.254571  5739 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.259855  5773 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:15.219861  5709 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.266767  5835 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.313233  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.314307  3993 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:15.316318  3993 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:15.288264  5730 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.327771  3991 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:15.317477  3990 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:15.322854  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57954.6us
I20260709 12:21:15.286911  5497 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:15.335317  5497 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:15.276101  5705 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.309337  5739 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.338958  5867 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:15.327945  5730 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.324088  5835 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:15.354635  5873 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:21:15.361032  5874 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:21:15.372430  5835 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.383921  5773 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.385600  5773 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.340517  5855 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.397622  3990 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:21:15.403198  3990 pending_rounds.cc:85] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 1
I20260709 12:21:15.406512  3990 pending_rounds.cc:107] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:21:15.408558  3990 raft_consensus.cc:2889] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.306083  5843 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.395678  3993 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.339509  5436 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.424121  5705 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.431401  5709 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:15.433895  5741 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:15.437692  5843 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:15.404309  5731 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.438421  5730 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.438655  5731 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.448694  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.449054  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.449728  3842 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:15.450300  3846 raft_consensus.cc:2410] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:15.452417  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.440860  5731 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.454821  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.456358  5436 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:15.460961  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.348968  5755 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.466504  5741 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:15.472645  4577 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4.
I20260709 12:21:15.509086  5730 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:15.514056  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 430055us
I20260709 12:21:15.530869  3919 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.531222  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.532182  3918 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:15.534257  5705 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:21:15.537417  5705 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.538137  5705 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:15.539582  5705 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.540162  5577 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:15.541293  5705 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.551980  5577 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:15.565922  5577 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:15.566355  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.567209  5616 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:15.567750  5616 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.568223  5616 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.575279  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.477243  5741 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.497515  5755 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:15.501152  5827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.013s	sys 0.035s
I20260709 12:21:15.607728  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:15.611112  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 354545us
I20260709 12:21:15.613019  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.614001  3918 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:15.618103  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.618386  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:15.590741  5767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.005s
W20260709 12:21:15.594762  5772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.017s	sys 0.022s
W20260709 12:21:15.625954  3921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.010s
W20260709 12:21:15.645045  3921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.010s
I20260709 12:21:15.645813  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:15.649506  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:15.592926  5843 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.621472  5827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.014s	sys 0.035s
I20260709 12:21:15.601071  5741 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:15.642195  5772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.023s
W20260709 12:21:15.661195  3850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.009s
I20260709 12:21:15.661358  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:15.678157  3850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.009s
W20260709 12:21:15.643554  5767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.015s	sys 0.006s
I20260709 12:21:15.637389  5835 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.656601  5786 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:15.677896  4548 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:15.659787  5565 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:15.713151  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:15.716418  3993 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:15.716539  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.759748  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:15.761735  4546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.012s
W20260709 12:21:15.762157  4546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.012s
W20260709 12:21:15.762806  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 549075us
I20260709 12:21:15.760654  4583 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:15.774490  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.694898  5584 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.662457  5843 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.719223  5586 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:15.718835  5855 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:15.775242  3994 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:15.720969  5786 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:15.683907  5659 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:21:15.784672  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.786898  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:15.837419  3991 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:15.837934  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51148.5us
I20260709 12:21:15.810544  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:15.685995  5867 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:21:15.814594  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.839824  3994 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.681372  5844 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:15.846704  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 81898.5us
I20260709 12:21:15.696458  5835 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.706708  5772 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 12:21:15.862581  4583 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:15.865725  3995 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:15.760731  5565 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.829485  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:15.824424  5849 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:21:15.778759  5752 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.886211  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:15.890657  3990 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:15.876267  5497 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.914569  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:15.881381  5807 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:15.915864  5875 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 12:21:15.916734  5887 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:21:15.917480  5888 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:15.918138  5871 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:21:15.918478  3990 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.887905  5899 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:15.808362  5700 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:21:15.878886  5757 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:15.925654  3991 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:15.915222  5876 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:21:15.795148  5584 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.937547  5835 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.888260  5784 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:15.904771  5577 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.927315  5862 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.958160  3990 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.863337  5855 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:15.961913  5883 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:15.956221  5812 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:15.990587  5565 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:15.992206  5877 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:15.960031  5757 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.952207  5807 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:15.997596  5757 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:15.998194  5807 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:15.962937  5786 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.922894  5752 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:16.007814  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 318953us
I20260709 12:21:16.008714  3994 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
W20260709 12:21:16.023679  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.017374  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:16.017222  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.026809  3841 raft_consensus.cc:2410] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:21:15.960821  5899 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.040875  3850 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:16.032990  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.037153  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:16.043359  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 270440us
I20260709 12:21:15.777891  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:16.045143  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 267345us
I20260709 12:21:15.969143  5784 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.014575  5807 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.981235  5577 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:15.987025  5862 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.051229  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.068028  3815 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:16.087532  3815 leader_election.cc:403] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:16.016299  5565 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:21:15.964847  5844 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.051939  5772 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:16.024461  5867 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:21:16.054114  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:16.019610  5741 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:16.158046  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51900.6us
I20260709 12:21:16.076037  5586 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:16.161302  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:16.165516  3991 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:16.166333  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:16.085932  5843 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:16.168236  3998 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:16.014074  5812 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.156339  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:16.102293  5767 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.097645  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.078534  5807 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.183655  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:16.184437  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 78068.5us
W20260709 12:21:16.168936  5739 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.003s
I20260709 12:21:16.192734  5739 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.197956  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:16.166507  5898 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.172046  5709 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.203562  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:16.212553  3850 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.204252  3846 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:16.164506  5890 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:16.205240  5807 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.218566  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.224512  5752 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:16.236726  5894 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.237257  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.237673  5894 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.200656  5779 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:16.249245  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:16.250555  5906 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:16.252349  5741 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:16.241345  5898 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.258288  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:16.261329  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1402) took 1192 ms. Trace:
W20260709 12:21:16.264348  5901 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:21:16.264915  5892 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:16.279232  5565 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.287776  5586 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.268893  5497 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.293071  5788 consensus_meta.cc:287] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.049s	user 0.011s	sys 0.002s
I20260709 12:21:16.247728  5890 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.295706  5779 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:21:16.296300  5773 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.910s	user 0.008s	sys 0.005s
I20260709 12:21:16.297011  5812 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.201407  5889 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:21:16.290046  3921 rpcz_store.cc:276] 0709 12:21:15.068490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.068991 (+   501us) service_pool.cc:224] Handling call
0709 12:21:15.069374 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:15.646567 (+577193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.646608 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:15.684531 (+ 37923us) log.cc:844] Serialized 52 byte log entry
0709 12:21:16.021518 (+336987us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:16.049558 (+ 28040us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.052309 (+  2751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.052408 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.260967 (+208559us) raft_consensus.cc:1685] finished
0709 12:21:16.261033 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.261262 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23591,"prepare.queue_time_us":67577,"raft.queue_time_us":35374,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":31100,"spinlock_wait_cycles":7511808,"thread_start_us":799564,"threads_started":2,"wal-append.queue_time_us":452924}
I20260709 12:21:16.298820  5521 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:16.337549  5521 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.339962  3842 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:16.304577  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:16.310621  3850 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:16.343392  3848 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.317428  5767 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:16.302937  4578 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.339789  5899 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:16.318279  5678 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:16.320943  5898 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:16.324536  5497 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.324851  5568 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.332216  5890 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.286342  5709 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.295222  5894 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.299629  5584 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:16.340104  5892 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:16.333230  5779 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:16.350494  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 184131us
I20260709 12:21:16.363842  5767 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:16.366817  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:16.367736  3998 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:16.311851  5565 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.371892  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1688) took 1104 ms. Trace:
I20260709 12:21:16.349684  5678 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:16.372663  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:16.376395  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.373987  3996 rpcz_store.cc:276] 0709 12:21:15.267088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.296168 (+ 29080us) service_pool.cc:224] Handling call
0709 12:21:15.301975 (+  5807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.637045 (+335070us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:15.684488 (+ 47443us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.098013 (+413525us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:16.181312 (+ 83299us) log.cc:844] Serialized 26 byte log entry
0709 12:21:16.181720 (+   408us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:16.182262 (+   542us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.182648 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.182772 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.354629 (+171857us) raft_consensus.cc:1685] finished
0709 12:21:16.354655 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.371824 (+ 17169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32406,"prepare.queue_time_us":71954,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":5212,"raft.queue_time_us":49745,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":75247,"thread_start_us":612819,"threads_started":2,"wal-append.queue_time_us":427347}
I20260709 12:21:16.381081  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.381896  3846 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:16.387468  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:16.329025  5788 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.359964  5784 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.369515  5773 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.164s
I20260709 12:21:16.356302  5568 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:16.540412  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.033s	sys 0.060s
W20260709 12:21:16.531692  5616 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.005s
W20260709 12:21:16.528667  5911 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:21:16.543721  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.033s	sys 0.060s
I20260709 12:21:16.549266  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1509) took 1300 ms. Trace:
I20260709 12:21:16.549707  3844 rpcz_store.cc:276] 0709 12:21:15.248640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.254902 (+  6262us) service_pool.cc:224] Handling call
0709 12:21:15.255233 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.260988 (+  5755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.261018 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.950741 (+689723us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b2c000014c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:15.951297 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:21:16.310732 (+359435us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:16.310793 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.310901 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.540013 (+229112us) raft_consensus.cc:1685] finished
0709 12:21:16.540039 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.549174 (+  9135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5350,"raft.queue_time_us":21631,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":12605184,"thread_start_us":343611,"threads_started":1,"wal-append.queue_time_us":415988}
I20260709 12:21:16.541397  5521 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:16.547597  5705 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:16.567564  5786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.052s	sys 0.083s
I20260709 12:21:16.582489  5521 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:16.548870  5616 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.591068  5521 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.606381  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1683) took 1341 ms. Trace:
I20260709 12:21:16.609689  5886 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:16.610491  5521 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:16.610296  5886 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.606962  3999 rpcz_store.cc:276] 0709 12:21:15.264822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.264949 (+   127us) service_pool.cc:224] Handling call
0709 12:21:15.265255 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.772780 (+507525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.772810 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.779010 (+  6200us) log.cc:844] Serialized 26 byte log entry
0709 12:21:16.014460 (+235450us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:16.014518 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.014643 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.606084 (+591441us) raft_consensus.cc:1685] finished
0709 12:21:16.606112 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.606300 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43191,"raft.queue_time_us":57826,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":2372,"thread_start_us":698875,"threads_started":2,"wal-append.queue_time_us":518054}
I20260709 12:21:16.566381  5678 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:16.589668  5786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.053s	sys 0.084s
W20260709 12:21:16.626820  5902 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.521s	user 0.005s	sys 0.000s
I20260709 12:21:16.629115  5568 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:16.609083  5755 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.987s	user 0.008s	sys 0.015s
I20260709 12:21:16.591495  5705 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.637151  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1512) took 1191 ms. Trace:
I20260709 12:21:16.637814  3843 rpcz_store.cc:276] 0709 12:21:15.446014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.446255 (+   241us) service_pool.cc:224] Handling call
0709 12:21:15.446695 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.457809 (+ 11114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.457876 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.467714 (+  9838us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.656390 (+188676us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:15.656449 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.656544 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.355082 (+698538us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:16.635567 (+280485us) raft_consensus.cc:1685] finished
0709 12:21:16.635610 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.637042 (+  1432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10612,"raft.queue_time_us":12282,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":58499840,"thread_start_us":188273,"threads_started":1,"wal-append.queue_time_us":538903}
I20260709 12:21:16.625609  5497 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:16.739311  3888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.039s	sys 0.040s
W20260709 12:21:16.739748  3888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.040s	sys 0.040s
W20260709 12:21:16.743541  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 663007us
I20260709 12:21:16.569123  5892 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.761232  3848 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:16.805042  5705 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:16.839574  3993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.012s	sys 0.043s
W20260709 12:21:16.841158  3993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.012s	sys 0.043s
I20260709 12:21:16.637231  5565 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.641013  5709 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:16.767680  5788 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:16.851673  5844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.015s	sys 0.049s
W20260709 12:21:16.868801  5844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.015s	sys 0.049s
I20260709 12:21:16.806823  5784 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:16.766774  5867 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:16.876605  5586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.031s	sys 0.036s
W20260709 12:21:16.936772  3998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.056s
I20260709 12:21:16.888170  5867 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:16.889492  5784 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.843993  4578 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:16.890765  5862 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:16.891243  5886 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.893338  5616 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:16.899549  5678 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:16.955721  3994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.028s
W20260709 12:21:16.956174  3994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.018s	sys 0.028s
I20260709 12:21:16.917090  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.921463  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.923563  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.923671  5767 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:16.924118  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:16.932585  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1701) took 1151 ms. Trace:
I20260709 12:21:16.932911  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1408) took 1314 ms. Trace:
I20260709 12:21:16.932964  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1650) took 1407 ms. Trace:
I20260709 12:21:16.946084  5484 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:16.941344  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 194569us
W20260709 12:21:16.936009  5586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.031s	sys 0.036s
I20260709 12:21:16.946401  5684 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:16.948112  5900 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.931s	user 0.004s	sys 0.000s
I20260709 12:21:17.007589  5484 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:16.961860  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1652) took 1435 ms. Trace:
W20260709 12:21:16.937237  3998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.057s
I20260709 12:21:16.940588  5786 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:16.964551  3919 rpcz_store.cc:276] 0709 12:21:15.618405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.628883 (+ 10478us) service_pool.cc:224] Handling call
0709 12:21:15.629384 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.631977 (+  2593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.632025 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.665666 (+ 33641us) log.cc:844] Serialized 26 byte log entry
0709 12:21:16.169018 (+503352us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:16.197769 (+ 28751us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.932151 (+734382us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b18003771a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287 00007fdc52a0e208
0709 12:21:16.932354 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.932500 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.932601 (+   101us) raft_consensus.cc:1685] finished
0709 12:21:16.932713 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.932854 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5478,"prepare.queue_time_us":31381,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5546,"raft.queue_time_us":742880,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":18816,"spinlock_wait_cycles":13268352,"thread_start_us":465046,"threads_started":1,"wal-append.queue_time_us":673091}
I20260709 12:21:16.963518  3995 rpcz_store.cc:276] 0709 12:21:15.784811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.993672 (+208861us) service_pool.cc:224] Handling call
0709 12:21:15.994024 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.994371 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.994399 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.994887 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:21:16.169751 (+174864us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:16.577289 (+407538us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.577582 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.577688 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:16.921947 (+344259us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18004160e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:16.932151 (+ 10204us) raft_consensus.cc:1685] finished
0709 12:21:16.932266 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.932500 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4246,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":54,"raft.queue_time_us":3545,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":1781,"spinlock_wait_cycles":8048896,"thread_start_us":581752,"threads_started":2,"wal-append.queue_time_us":587533}
I20260709 12:21:16.965251  3923 rpcz_store.cc:276] 0709 12:21:15.525889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.526205 (+   316us) service_pool.cc:224] Handling call
0709 12:21:15.526716 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.526931 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:15.963783 (+436852us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.217706 (+253923us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.932509 (+714803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:16.932591 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:16.932659 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.932751 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.932890 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1463146,"prepare.queue_time_us":447616,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":5646,"raft.queue_time_us":729265,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":19821,"thread_start_us":657399,"threads_started":2,"wal-append.queue_time_us":634059}
I20260709 12:21:16.952394  5810 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:16.968381  5862 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.043743  5705 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.047952  5684 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:17.051321  5563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.028s	sys 0.091s
I20260709 12:21:17.010753  5709 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.019991  5827 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.967594  5767 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.014896  3916 rpcz_store.cc:276] 0709 12:21:15.526613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.527456 (+   843us) service_pool.cc:224] Handling call
0709 12:21:15.527841 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.528048 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:15.692879 (+164831us) log.cc:844] Serialized 14 byte log entry
0709 12:21:15.693353 (+   474us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.908644 (+1215291us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b1800422980. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc525a9d70 00007fdc5259d293 00007fdc52592cea 00007fdc5259323a 00007fdc529fda2a 00007fdc52a0d0bf 00007fdc52a0d038
0709 12:21:16.961365 (+ 52721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:16.961442 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:16.961506 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:16.961597 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:16.961772 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71290,"prepare.queue_time_us":1012769,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":56698,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":8450,"spinlock_wait_cycles":43229696,"thread_start_us":164414,"threads_started":1}
I20260709 12:21:17.015834  5601 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:21:17.042466  5733 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.045409  5731 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.050894  5755 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.058718  4581 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:17.044677  5786 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.063297  5497 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:17.074107  3964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.596s (SENT) [suppressed 20 similar messages]
I20260709 12:21:17.096025  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:17.064807  5563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.029s	sys 0.092s
I20260709 12:21:17.076120  5733 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.098141  5601 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.098775  5601 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.100052  5733 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.100803  5601 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.101590  3916 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:17.101999  5484 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.068127  5862 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:17.104291  5928 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:21:17.106261  5924 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:17.070699  5827 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:17.107585  5925 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:17.108683  5827 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.077515  5731 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.067303  5810 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.111964  5784 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.081296  5755 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.113680  5810 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.067617  5684 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.116459  5684 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.065371  5705 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.119632  5705 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.121887  5767 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.122982  5855 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.128023  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.093091  5881 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.136590  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.128994  3841 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:17.105649  5927 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:21:17.147783  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.115067  5755 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.136060  5521 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.067934  5709 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.125413  5497 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.146150  5659 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:17.168743  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 1.11466e+06us
I20260709 12:21:17.173679  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.153033  5855 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.158212  5808 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.148777  5810 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.175870  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.140414  5881 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.164419  5484 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.162887  5733 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.179320  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.220992  4576 raft_consensus.cc:2410] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:17.221896  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:17.224845  5926 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.225620  5926 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.202044  5808 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.166513  5521 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.223084  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.200594  5934 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:17.203344  4577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 271) took 2165 ms (client timeout 1896 ms). Trace:
I20260709 12:21:17.206437  5731 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.238919  5862 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.244201  5935 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:17.244881  5601 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:17.245004  5878 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.229s	user 0.000s	sys 0.003s
I20260709 12:21:17.245327  5934 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:17.245674  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:17.246294  5896 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 1.195s	user 0.007s	sys 0.007s
I20260709 12:21:17.246981  5936 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:17.229282  5684 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:17.201766  5855 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.204437  5810 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.188347  5659 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:17.252524  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 157485us
I20260709 12:21:17.274362  3920 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:17.237406  5667 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:17.275233  5667 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:17.275779  5739 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.234941  5765 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.254498  3917 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:17.214735  5484 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.217319  5733 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.242725  5786 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.259352  3918 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:17.256211  5601 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:17.269519  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.284459  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 210410us
W20260709 12:21:17.237263  4577 rpcz_store.cc:269] 0709 12:21:15.012411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.012760 (+   349us) service_pool.cc:224] Handling call
0709 12:21:17.168507 (+2155747us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540012b1d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:17.177943 (+  9436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018757376}
I20260709 12:21:17.296977  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.298127  5862 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.298722  5862 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.286330  5767 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:21:17.276368  5667 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.301633  5862 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.296116  3964 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.303089  5936 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.283964  5765 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.304095  5862 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.255329  5935 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.310125  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.292412  5601 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.311527  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:17.289292  5684 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:17.314493  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:17.316154  5709 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.296041  5926 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.311313  5936 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.316957  5926 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:17.318840  5936 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:17.319026  5929 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:21:17.319648  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.319928  5577 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.310156  5765 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.288195  5934 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.325390  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1682) took 2060 ms. Trace:
I20260709 12:21:17.326210  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:17.328023  5862 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:17.328451  5812 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.328964  5812 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.329560  5812 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.332175  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1518) took 1329 ms. Trace:
I20260709 12:21:17.332626  5659 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.335865  5577 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.328878  5862 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:17.338033  5862 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.256127  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.353436  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.362901  5705 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:17.363420  5705 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.363929  5705 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.366276  5784 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:17.366880  5784 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.344909  5521 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.345853  5773 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.371393  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:17.372382  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:17.326004  3992 rpcz_store.cc:276] 0709 12:21:15.264534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.264662 (+   128us) service_pool.cc:224] Handling call
0709 12:21:15.265017 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.273328 (+  8311us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:15.308347 (+ 35019us) log.cc:844] Serialized 14 byte log entry
0709 12:21:15.691436 (+383089us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.760610 (+ 69174us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.760868 (+   258us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:15.760927 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.761200 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:17.245614 (+1484414us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:17.325028 (+ 79414us) raft_consensus.cc:1685] finished
0709 12:21:17.325141 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.325296 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20522,"prepare.queue_time_us":36269,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":22490,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":24824,"spinlock_wait_cycles":51316736,"thread_start_us":360033,"threads_started":1,"wal-append.queue_time_us":648076}
W20260709 12:21:17.405107  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89275.8us
I20260709 12:21:17.332566  3845 rpcz_store.cc:276] 0709 12:21:16.002624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.005335 (+  2711us) service_pool.cc:224] Handling call
0709 12:21:16.039123 (+ 33788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:16.324215 (+285092us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:16.361911 (+ 37696us) log.cc:844] Serialized 14 byte log entry
0709 12:21:16.912528 (+550617us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180014d460. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:21:17.149682 (+237154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.149767 (+    85us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:17.149857 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.331938 (+182081us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b54001199d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:17.331986 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.332107 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1957,"prepare.queue_time_us":25408,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4722,"raft.queue_time_us":10570,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4821,"spinlock_wait_cycles":151009280,"thread_start_us":228325,"threads_started":1,"wal-append.queue_time_us":857849}
I20260709 12:21:17.405678  5577 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:17.290087  5808 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.431907  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.436268  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.421332  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 109) took 6525 ms. Trace:
I20260709 12:21:17.437017  3994 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
W20260709 12:21:17.437371  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 289706us
I20260709 12:21:17.438406  3962 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.438920  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.439636  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.441291  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.444947  3997 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:17.441412  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.443046  3998 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.446367  3992 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:17.447747  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.450420  3843 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:17.453292  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.453999  3918 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:17.420222  5882 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.455624  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.455196  3962 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.457819  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.437021  3745 rpcz_store.cc:276] 0709 12:21:10.895712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.902802 (+  7090us) service_pool.cc:224] Handling call
0709 12:21:17.421261 (+6518459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:13.223650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:13.224352 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:13.224386 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:21:13.224405 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:13.225466 (+  1061us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:13.225527 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:13.225558 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:21:13.226379 (+   821us) tablet.cc:701] Row locks acquired
0709 12:21:13.226403 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:21:13.226550 (+   147us) write_op.cc:270] Start()
0709 12:21:13.226666 (+   116us) write_op.cc:276] Timestamp: P: 1783599673226508 usec, L: 0
0709 12:21:13.226689 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:13.227395 (+   706us) log.cc:844] Serialized 3954 byte log entry
0709 12:21:13.694986 (+467591us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc4f8e90ac 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b
0709 12:21:14.012492 (+317506us) op_driver.cc:464] REPLICATION: finished
0709 12:21:14.469500 (+457008us) write_op.cc:301] APPLY: starting
0709 12:21:14.475785 (+  6285us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:14.484311 (+  8526us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:14.484338 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:14.516280 (+ 31942us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:14.575543 (+ 59263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:21:14.580670 (+  5127us) write_op.cc:312] APPLY: finished
0709 12:21:14.620279 (+ 39609us) log.cc:844] Serialized 77 byte log entry
0709 12:21:14.629058 (+  8779us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:14.718330 (+ 89272us) write_op.cc:454] Released schema lock
0709 12:21:14.723914 (+  5584us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:14.724288 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:14.724317 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1099547,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":429398,"apply.run_cpu_time_us":12314,"apply.run_wall_time_us":261603,"num_ops":10,"prepare.queue_time_us":80591,"prepare.run_cpu_time_us":11740,"prepare.run_wall_time_us":531220,"raft.queue_time_us":179469,"raft.run_cpu_time_us":11424,"raft.run_wall_time_us":376397,"replication_time_us":765054,"spinlock_wait_cycles":13664640,"thread_start_us":825134,"threads_started":4,"wal-append.queue_time_us":487725,"wal-append.run_cpu_time_us":29851,"wal-append.run_wall_time_us":2042830}]]}
I20260709 12:21:17.466015  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:17.466986  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:17.468797  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.469594  3918 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:17.471539  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.471971  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.473227  3916 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:17.475162  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.455785  5867 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.479277  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:17.479952  3916 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.454433  5484 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.456435  5521 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:17.437848  5773 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.481980  3923 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:17.460632  5733 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.477249  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.470288  5895 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.477804  5811 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.489782  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1651) took 1963 ms. Trace:
I20260709 12:21:17.476910  5808 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.480718  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:17.488550  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 168141us
I20260709 12:21:17.561298  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.503397  3916 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:17.468832  5882 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.486286  5521 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.571525  5827 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:17.572804  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.500025  3925 rpcz_store.cc:276] 0709 12:21:15.526312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.526436 (+   124us) service_pool.cc:224] Handling call
0709 12:21:15.526789 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.526983 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:16.018382 (+491399us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.487270 (+1468888us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.489430 (+  2160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:17.489481 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:17.489537 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.489612 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:17.489720 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":386476,"prepare.queue_time_us":585839,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":7119,"raft.queue_time_us":402904,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":4263,"spinlock_wait_cycles":2432,"thread_start_us":1572568,"threads_started":4,"wal-append.queue_time_us":821833}
I20260709 12:21:17.578902  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:17.579308  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102083us
I20260709 12:21:17.490768  5919 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.586742  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.587412  3841 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:17.583424  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:17.576191  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 121098us
I20260709 12:21:17.588604  3845 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:17.589365  3994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:17.589996  3994 raft_consensus.cc:606] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:17.590341  3994 raft_consensus.cc:614] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.592068  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.592626  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:17.593538  3916 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.594018  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.594883  3850 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:17.499583  5861 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.499907  5811 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.600525  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.502167  5497 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.606360  3842 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:17.592736  3846 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:17.601389  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:17.555857  5935 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.611577  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.582084  5521 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.567832  5808 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:17.597398  5918 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:21:17.578380  5827 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.624249  3916 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:17.486238  5684 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.625160  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.644362  3923 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:17.610739  5811 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.630096  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:17.652603  3995 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.631940  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:17.655087  3999 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.633208  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.656294  3990 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:17.634451  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.656831  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:17.640448  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.641358  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.638065  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.658854  3998 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:17.585431  5940 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.615267  5810 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:17.668320  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.669376  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.670083  3996 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:17.621246  5881 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.614639  5862 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.664322  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.688867  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.614058  5616 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.659430  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.643841  5497 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.691325  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.693887  3999 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:17.647533  5827 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:17.646963  5950 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.599479  5919 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.701006  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.702232  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.723650  5616 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.739786  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:17.740621  3999 raft_consensus.cc:606] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:17.741060  3999 raft_consensus.cc:614] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.719707  3918 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:17.721127  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62800.6us
I20260709 12:21:17.742064  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.742206  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.689535  5940 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.697551  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:17.745227  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.745924  3990 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:17.746873  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.748277  3998 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:17.749711  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.750561  3991 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:17.754012  5894 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:17.724364  5497 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.755259  5497 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.754758  5894 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:17.676148  5678 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.721s	user 0.016s	sys 0.001s
I20260709 12:21:17.757858  5894 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.761158  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.764456  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:17.743297  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.677351  5784 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.784335  3995 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:17.698941  5862 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.794606  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet ff4bdec26d3e4879bd33a92daad5d607 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52848
I20260709 12:21:17.798743  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.817174  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.818069  3995 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:17.819617  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.821399  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.734061  5667 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:17.832755  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.833920  3918 raft_consensus.cc:2410] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:21:17.838272  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.796684  5862 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.843633  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.845369  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.846011  3916 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:17.847587  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.848284  3916 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:17.852546  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.853493  3918 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:17.861896  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 138975us
I20260709 12:21:17.865639  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.886832  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.735383  5950 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:17.830703  5667 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:17.920287  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 178131us
I20260709 12:21:17.952198  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:17.953045  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:17.833719  5484 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.835153  5810 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.814580  5733 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:17.936750  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:17.936844  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.839399  5855 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:17.938287  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.943567  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.967005  3916 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:17.967100  3925 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:17.947240  5955 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:17.956120  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:17.963214  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:17.978569  3995 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:17.988968  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.926029  5773 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:17.989951  3916 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:18.001296  5947 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:21:17.957603  5667 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:18.015281  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:17.976605  5936 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.024459  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.003454  5934 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:18.011224  5944 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:21:17.989254  5955 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:18.036235  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90890.5us
W20260709 12:21:18.023712  5949 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:21:18.036405  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.019222  5810 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:17.977370  5484 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.041872  5936 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:18.042558  5972 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.042784  5855 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.028770  5966 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.044803  5861 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.032652  5934 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.988929  5733 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:18.056577  5941 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:21:18.056427  5709 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:18.057049  5705 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.693s	user 0.014s	sys 0.000s
I20260709 12:21:18.059075  5950 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.083153  5855 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:18.083684  5855 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.085657  5827 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.086890  3920 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:18.076848  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.081492  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:18.089663  3925 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:18.088757  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 500191us
I20260709 12:21:18.088686  3922 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:18.094939  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.091012  5966 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.098744  5966 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.087925  5861 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.102069  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.062721  5926 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.745s	user 0.006s	sys 0.003s
W20260709 12:21:18.071977  5812 consensus_meta.cc:287] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.002s
W20260709 12:21:18.074666  5765 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.754s	user 0.001s	sys 0.014s
W20260709 12:21:18.067595  5948 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:21:18.051021  5955 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.105419  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.087767  5934 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.068708  5616 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.063797  5808 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.137933  5970 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:21:18.091379  5972 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:18.108888  5926 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:18.142107  5972 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:18.142416  5811 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:18.072919  5497 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.144184  3994 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:18.144527  5601 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.820s	user 0.004s	sys 0.021s
I20260709 12:21:18.144656  3990 raft_consensus.cc:606] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:18.145090  5497 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.124264  5765 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.070436  5810 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.120322  3922 raft_consensus.cc:2410] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:21:18.091778  5807 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:18.114885  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:18.129330  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:18.142968  3848 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:18.145155  3990 raft_consensus.cc:614] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.112267  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.146456  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 194344us
I20260709 12:21:18.158018  3925 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:18.095088  5773 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:18.092185  5705 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.115953  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.189137  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.159845  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45071.1us
I20260709 12:21:18.173312  3924 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:18.190969  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 213075us
W20260709 12:21:18.180863  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 187040us
I20260709 12:21:18.095889  5709 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.198612  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:18.103080  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:18.205803  3848 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:18.214792  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:18.214545  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.228685  5982 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:21:18.145125  5601 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.188611  5958 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:18.270043  5810 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.188722  5784 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.295387  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.271596  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.272295  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.272807  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:18.120677  5812 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:18.148173  5616 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.317121  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.318534  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.150112  5747 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.320304  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.293452  5979 tablet_replica.cc:333] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:21:18.281394  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:18.282797  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.283989  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 181417us
I20260709 12:21:18.193922  5767 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:18.284722  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86208.2us
I20260709 12:21:18.294612  3921 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:18.292542  5954 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.321241  3918 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:18.321708  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51742.1us
I20260709 12:21:18.328563  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:18.330950  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.334371  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:18.323168  5709 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.324687  5616 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.292328  5659 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.326439  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.298017  3917 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:18.327621  3995 raft_consensus.cc:2410] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:18.330032  5773 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:18.361361  5773 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:18.361850  5773 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:18.328603  3919 raft_consensus.cc:2410] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:18.334481  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:18.330576  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:18.277271  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.285370  5862 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.341559  5705 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.339155  5950 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:18.329634  5747 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.342957  5811 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.303994  5784 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.343603  5767 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:18.318557  5955 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.346064  5940 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.294818  5958 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:18.352674  5521 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.003s
I20260709 12:21:18.353072  5961 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:18.360138  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:18.459650  3995 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:18.340323  5954 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.363087  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.332643  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.365214  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:18.332878  5966 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.362413  5659 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.327487  5983 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:18.343348  5934 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:18.332608  5919 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.371176  4576 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:18.390291  3991 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:18.411295  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.414139  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.416870  5601 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.422331  5484 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.425825  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1657) took 1175 ms. Trace:
I20260709 12:21:18.426662  5882 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.440341  3997 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:18.438750  3994 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:18.444077  5577 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:18.449491  5979 raft_consensus.cc:2243] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:18.456106  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121801us
I20260709 12:21:18.528813  3925 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:18.529235  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:18.529348  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 149612us
I20260709 12:21:18.379773  5700 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.532178  3994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:18.532572  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.532804  3994 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:18.533145  3994 raft_consensus.cc:614] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.382105  5950 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.383841  5981 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:18.510247  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 177673us
I20260709 12:21:18.510070  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.518354  5986 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:18.549417  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:18.463248  3850 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:18.455718  5765 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.566063  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.518430  3921 rpcz_store.cc:276] 0709 12:21:17.250007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.250149 (+   142us) service_pool.cc:224] Handling call
0709 12:21:17.254901 (+  4752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.329720 (+1074819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.425436 (+ 95716us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540024f754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:18.425720 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390690560}
I20260709 12:21:18.519569  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:18.568724  3846 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:18.550484  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1658) took 1299 ms. Trace:
I20260709 12:21:18.569593  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:18.508263  5855 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.525324  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.525877  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.503510  5983 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.526973  3916 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:18.524793  5812 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:18.348058  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:18.585717  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 237750us
I20260709 12:21:18.530148  3919 raft_consensus.cc:2410] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:18.513362  5941 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:18.586910  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:18.536675  5978 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 12:21:18.531224  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.591475  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:18.542591  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:18.593819  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51299.8us
I20260709 12:21:18.594981  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.596752  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.599071  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.600224  3845 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:18.603797  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:18.515265  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.548715  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.505627  5521 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.570801  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.518582  5940 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.543313  5950 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:18.569239  3924 rpcz_store.cc:276] 0709 12:21:17.251511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.251690 (+   179us) service_pool.cc:224] Handling call
0709 12:21:17.252135 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.191247 (+939112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.550079 (+358832us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400021f54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:18.550387 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117965568}
I20260709 12:21:18.568526  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:18.633643  3924 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:18.523649  5966 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.520678  5659 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.642259  3998 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:18.550830  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.532222  5970 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:18.527941  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 162610us
I20260709 12:21:18.615428  5709 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.614245  5808 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:18.542193  5981 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.541720  5961 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:18.571017  5986 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.619483  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:18.567251  5894 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.624670  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.629743  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:18.579119  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.613719  5972 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:18.637241  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68792.2us
I20260709 12:21:18.637406  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:18.573880  5991 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.587311  5568 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:18.586817  5983 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:18.645903  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 95170.4us
W20260709 12:21:18.653126  5987 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 12:21:18.612339  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.760239  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:18.760735  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 148539us
I20260709 12:21:18.762511  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.659636  5966 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.620306  5979 raft_consensus.cc:2272] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.539790  5700 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:18.719008  5436 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:18.703074  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:18.645182  5577 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.700209  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.709779  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:18.647315  5935 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.718147  5810 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.719931  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:18.827244  5954 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:18.828764  5994 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:21:18.830936  5997 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:18.765095  5972 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:18.773396  5577 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:18.778816  5659 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.698637  5813 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:18.736129  5934 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:18.666174  5709 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:18.738924  5855 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.742439  5926 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.633291  5940 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.670034  5981 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.724002  5961 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.737293  5862 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.766688  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.669458  5986 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:18.702502  3921 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:18.769130  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.666937  5970 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:18.767967  5667 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 12:21:18.731643  5616 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:18.995113  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 406223us
I20260709 12:21:18.852224  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1718) took 1224 ms. Trace:
I20260709 12:21:18.770884  5700 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:19.206697  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 503686us
W20260709 12:21:19.212392  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 445827us
W20260709 12:21:18.995237  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.837435  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:19.213542  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:18.937348  3847 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:19.206130  3993 rpcz_store.cc:276] 0709 12:21:17.627334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.627518 (+   184us) service_pool.cc:224] Handling call
0709 12:21:17.628544 (+  1026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.835867 (+207323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.835903 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.855261 (+ 19358us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.278231 (+422970us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:18.278291 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.278419 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.851893 (+573474us) raft_consensus.cc:1685] finished
0709 12:21:18.851926 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:18.852130 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30577,"raft.queue_time_us":168925,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":18386,"thread_start_us":433186,"threads_started":2,"wal-append.queue_time_us":418816}
I20260709 12:21:18.774562  5601 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.772116  5497 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.214512  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:19.215408  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:19.217875  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 266799us
I20260709 12:21:19.224062  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:19.246872  3847 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:19.190160  5861 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.091s	user 0.009s	sys 0.004s
I20260709 12:21:19.252611  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:19.253443  3841 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:19.190781  5950 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:21:18.832419  5955 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:19.219888  5934 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.972285  5972 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.134639  5993 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:19.213017  5577 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.216240  5954 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:19.212821  5521 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:18.972005  5919 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:19.336020  5919 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.882054  5935 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:19.201782  5436 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:19.204718  5709 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.299826  3847 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:19.158892  5983 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.280772  5855 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.333781  5659 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.289093  5862 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:18.768818  5894 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.329998  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:19.210469  5667 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:18.987020  5810 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.348060  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:19.217648  5813 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.352319  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 789) took 1126 ms. Trace:
I20260709 12:21:19.357607  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 792) took 1063 ms. Trace:
I20260709 12:21:19.355295  3847 rpcz_store.cc:276] 0709 12:21:18.225820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.347744 (+1121924us) service_pool.cc:224] Handling call
0709 12:21:19.352227 (+  4483us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.359562  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:19.360639  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1548) took 1168 ms. Trace:
I20260709 12:21:19.361090  3847 rpcz_store.cc:276] 0709 12:21:18.192635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.359161 (+1166526us) service_pool.cc:224] Handling call
0709 12:21:19.360555 (+  1394us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.366693  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 118693us
I20260709 12:21:19.218349  5926 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:19.345036  5773 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.983s	user 0.012s	sys 0.001s
I20260709 12:21:19.358279  3841 rpcz_store.cc:276] 0709 12:21:18.293928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.312274 (+1018346us) service_pool.cc:224] Handling call
0709 12:21:19.357508 (+ 45234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.292758  5861 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.368707  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:19.304845  5950 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.390295  3996 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:19.375152  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1545) took 1212 ms. Trace:
W20260709 12:21:19.395143  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 181653us
I20260709 12:21:19.395015  3847 rpcz_store.cc:276] 0709 12:21:18.162448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.374028 (+1211580us) service_pool.cc:224] Handling call
0709 12:21:19.374459 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.374696 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.374734 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.374791 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:19.374843 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.374915 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.375057 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.396974  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.399027  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.327540  5972 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.400532  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:19.355749  5993 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:19.458879  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90316.8us
I20260709 12:21:19.371477  5862 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:19.457494  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 57053.7us
I20260709 12:21:19.475651  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.475934  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.354883  6011 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.393043  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 623959us
I20260709 12:21:19.480391  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.405129  3847 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:19.349922  5935 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.473793  3846 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:19.476581  3920 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:19.492549  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:19.490998  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.493741  3920 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:19.494030  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.477427  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:19.478307  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1551) took 1153 ms. Trace:
I20260709 12:21:19.352811  5436 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.457880  5855 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.408362  5954 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.474560  6014 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.394075  3748 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:19.495138  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:19.505250  3920 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:19.496853  3841 rpcz_store.cc:276] 0709 12:21:18.324938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.462598 (+1137660us) service_pool.cc:224] Handling call
0709 12:21:19.477532 (+ 14934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.477774 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.477815 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.477878 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:19.477950 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.478051 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.478207 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.506721  3841 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:19.507287  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1552) took 1182 ms. Trace:
W20260709 12:21:19.495810  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 163097us
I20260709 12:21:19.407548  6013 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:19.482045  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 795) took 1176 ms. Trace:
I20260709 12:21:19.548923  3847 rpcz_store.cc:276] 0709 12:21:18.305669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.404470 (+1098801us) service_pool.cc:224] Handling call
0709 12:21:19.404886 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.481698 (+ 76812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.481968 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.549998  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:19.394459  5773 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.504213  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.507582  3841 rpcz_store.cc:276] 0709 12:21:18.325374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.506016 (+1180642us) service_pool.cc:224] Handling call
0709 12:21:19.506385 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.507083 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.507245 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.478415  5966 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.510087  4582 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:19.512763  6007 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:19.512830  4574 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:19.513211  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:19.514356  6017 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:19.562069  6017 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.562631  6017 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.514937  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.517014  5563 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:19.517535  5436 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.518383  5862 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.522053  6014 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.524869  5861 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.489876  5521 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.491876  6011 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.526033  5601 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:19.356411  5970 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.527899  5894 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.528757  5940 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:19.503810  5995 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:19.531960  6016 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.532727  5972 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.534581  5935 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.534296  5709 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.527058  6022 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.532810  5700 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.496799  6018 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:19.560608  5989 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 1.228s	user 0.028s	sys 0.027s
I20260709 12:21:19.561537  5926 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.602391  6020 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:19.605396  6020 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:19.606374  6020 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.607812  6020 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.584910  6027 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.601626  6022 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.595743  5995 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.629890  6014 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.604110  6018 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.627851  6017 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.618299  6027 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.548055  6013 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.559496  6015 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.637372  6022 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.638016  6018 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.523967  3748 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.564544  3845 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:19.553540  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:19.565232  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50427.3us
I20260709 12:21:19.670002  3841 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:19.671819  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:19.674239  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 169926us
W20260709 12:21:19.676319  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.677361  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.536700  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.685205  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1716) took 2059 ms. Trace:
I20260709 12:21:19.685791  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.688060  3748 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.696954  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:19.581076  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:19.700546  5521 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:19.701874  5521 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.682723  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.703007  5521 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:19.703891  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.704949  3918 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:19.706061  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:19.685817  3992 rpcz_store.cc:276] 0709 12:21:17.626189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.626416 (+   227us) service_pool.cc:224] Handling call
0709 12:21:17.626790 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:17.648150 (+ 21360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.648198 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:18.064764 (+416566us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:18.065337 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 12:21:18.280822 (+215485us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:18.280878 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.280976 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.369496 (+1088520us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:19.684478 (+314982us) raft_consensus.cc:1685] finished
0709 12:21:19.684527 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.684890 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20808,"raft.queue_time_us":100550,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":58768,"spinlock_wait_cycles":97203456,"thread_start_us":214903,"threads_started":1,"wal-append.queue_time_us":249952}
I20260709 12:21:19.711095  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:19.713335  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.716701  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.566671  5659 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.571561  5667 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:19.581971  5601 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:19.722824  5601 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:19.695158  3748 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.719348  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.727085  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:19.612290  5709 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:19.728833  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 786) took 1555 ms. Trace:
I20260709 12:21:19.730664  3846 rpcz_store.cc:276] 0709 12:21:18.172829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.837102 (+664273us) service_pool.cc:224] Handling call
0709 12:21:19.728332 (+891230us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540008d9d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.728620 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596883840}
I20260709 12:21:19.732259  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 779) took 1580 ms. Trace:
I20260709 12:21:19.732990  3846 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:19.733843  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 234) took 1357 ms. Trace:
I20260709 12:21:19.733882  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:19.734325  3846 rpcz_store.cc:276] 0709 12:21:18.376339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.731904 (+1355565us) service_pool.cc:224] Handling call
0709 12:21:19.732574 (+   670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.733496 (+   922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.733765 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.735023  3842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 783) took 1580 ms (client timeout 2088 ms). Trace:
W20260709 12:21:19.743274  3842 rpcz_store.cc:269] 0709 12:21:18.154582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.155010 (+   428us) service_pool.cc:224] Handling call
0709 12:21:19.733470 (+1578460us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:19.734926 (+  1456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10312064}
I20260709 12:21:19.745694  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 236) took 1368 ms. Trace:
I20260709 12:21:19.746250  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:19.732779  3850 rpcz_store.cc:276] 0709 12:21:18.151167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.155706 (+  4539us) service_pool.cc:224] Handling call
0709 12:21:18.412902 (+257196us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:18.413212 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.572489 (+159277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.731496 (+1159007us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54003449d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:19.731926 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120103680}
I20260709 12:21:19.749918  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.750204  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 237) took 1373 ms. Trace:
I20260709 12:21:19.750916  3922 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:19.589012  5773 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.572789  5813 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:19.740474  3916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1432) took 1876 ms (client timeout 1622 ms). Trace:
I20260709 12:21:19.741961  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1678) took 2132 ms. Trace:
I20260709 12:21:19.746122  3842 rpcz_store.cc:276] 0709 12:21:18.376982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.744347 (+1367365us) service_pool.cc:224] Handling call
0709 12:21:19.744890 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.745288 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.745314 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.745391 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:19.745446 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.745522 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.745645 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.720391  5700 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.570139  5919 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.739136  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1541) took 1583 ms. Trace:
I20260709 12:21:19.574580  5950 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.565853  5966 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:19.782141  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.761505  5807 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:19.762405  5961 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:19.784492  5961 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.785837  5867 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:19.775120  5939 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.788389  5705 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:19.754312  5709 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:19.789338  5705 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:19.738338  3748 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 3, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.561537  5983 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.736982  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 235) took 1360 ms. Trace:
I20260709 12:21:19.629890  6011 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.810506  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:19.772608  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:19.790864  3917 rpcz_store.cc:276] 0709 12:21:17.608969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.612726 (+  3757us) service_pool.cc:224] Handling call
0709 12:21:17.613069 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.360955 (+747886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.741463 (+1380508us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400311ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:19.741777 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574734208}
W20260709 12:21:19.785785  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 748) took 2048 ms (client timeout 2481 ms). Trace:
I20260709 12:21:19.742285  5601 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:19.791757  3916 rpcz_store.cc:269] 0709 12:21:17.864020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.005417 (+141397us) service_pool.cc:224] Handling call
0709 12:21:19.740035 (+1734618us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54000465d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.740271 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150827392}
I20260709 12:21:19.774062  5936 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.773741  5659 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:19.750665  3850 rpcz_store.cc:276] 0709 12:21:18.377293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.748879 (+1371586us) service_pool.cc:224] Handling call
0709 12:21:19.749418 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.749830 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.749853 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.749920 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:19.749961 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.750021 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.750133 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.767115  5784 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.805869  6027 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.810824  6017 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.751317  5521 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:19.808812  3846 rpcz_store.cc:276] 0709 12:21:18.376684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.735369 (+1358685us) service_pool.cc:224] Handling call
0709 12:21:19.736075 (+   706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.736538 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.736570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.736632 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.736702 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.736777 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.736905 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.820611  3919 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:19.781507  3849 rpcz_store.cc:276] 0709 12:21:18.155256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.155568 (+   312us) service_pool.cc:224] Handling call
0709 12:21:18.273535 (+117967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:18.514155 (+240620us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:18.524252 (+ 10097us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.737316 (+1213064us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b18002f0da0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a
0709 12:21:19.737764 (+   448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.737840 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:19.737935 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.738766 (+   831us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54002abf54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:19.738817 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.738973 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14548,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6623,"raft.queue_time_us":47334,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":325,"spinlock_wait_cycles":565809152,"thread_start_us":58085,"threads_started":1,"wal-append.queue_time_us":140497}
I20260709 12:21:19.752444  5747 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.738740  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:19.814378  3998 rpcz_store.cc:269] 0709 12:21:17.737201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.749421 (+ 12220us) service_pool.cc:224] Handling call
0709 12:21:19.785209 (+2035788us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400390654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.785537 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050424192}
I20260709 12:21:19.822522  5659 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.782940  5684 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:21:19.836184  3922 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:19.846673  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 107163us
I20260709 12:21:19.840744  5659 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.811777  6015 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.840131  5521 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:19.856079  5961 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.855731  3918 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:19.629858  5986 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.866976  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 238) took 1489 ms. Trace:
I20260709 12:21:19.831655  5807 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.900256  3842 rpcz_store.cc:276] 0709 12:21:18.377581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.803237 (+1425656us) service_pool.cc:224] Handling call
0709 12:21:19.851837 (+ 48600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.866519 (+ 14682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.866554 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.866634 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.866684 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.866752 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.866881 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.902679  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1554) took 1448 ms. Trace:
I20260709 12:21:19.903038  5986 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:19.903380  5958 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.904860  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 240) took 1518 ms. Trace:
I20260709 12:21:19.905352  3850 rpcz_store.cc:276] 0709 12:21:18.386834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.846627 (+1459793us) service_pool.cc:224] Handling call
0709 12:21:19.903875 (+ 57248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.904373 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.904417 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.904493 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:19.904601 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.904674 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.904798 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.906483  5934 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.915637  5601 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.916458  5733 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:19.916923  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:19.886214  5919 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.919304  5890 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:19.920039  5890 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:19.919987  5919 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:19.924407  5961 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.920786  5890 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:19.903281  3849 rpcz_store.cc:276] 0709 12:21:18.454222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.843912 (+1389690us) service_pool.cc:224] Handling call
0709 12:21:19.901812 (+ 57900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.902238 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.902268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:19.902338 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:19.902383 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.902442 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.902584 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:19.941571  3842 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:19.944768  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1555) took 1485 ms. Trace:
I20260709 12:21:19.945264  3842 rpcz_store.cc:276] 0709 12:21:18.457456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.927789 (+1470333us) service_pool.cc:224] Handling call
0709 12:21:19.939045 (+ 11256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:19.942105 (+  3060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.942325 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:19.860028  5960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.482s	user 0.019s	sys 0.037s
I20260709 12:21:19.855121  5705 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.887975  6013 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.890765  5810 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:19.952698  5960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.026s	sys 0.043s
I20260709 12:21:19.961207  3748 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.962502  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:19.963366  6028 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:19.949708  5919 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:19.892244  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:19.978283  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 92493.6us
I20260709 12:21:19.987735  5705 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:19.988477  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 223) took 2621 ms (client timeout 2229 ms). Trace:
W20260709 12:21:19.989095  3848 rpcz_store.cc:269] 0709 12:21:17.366783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.371090 (+  4307us) service_pool.cc:224] Handling call
0709 12:21:19.987896 (+2616806us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b5400343ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.988175 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642703744}
W20260709 12:21:19.992273  4576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 324) took 2489 ms (client timeout 1622 ms). Trace:
W20260709 12:21:19.993005  4576 rpcz_store.cc:269] 0709 12:21:17.453089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.458190 (+  5101us) service_pool.cc:224] Handling call
0709 12:21:19.939030 (+2480840us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400671954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.942020 (+  2990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745265536}
I20260709 12:21:19.892602  5521 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:19.963379  5827 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:19.988543  3996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 755) took 2249 ms (client timeout 2822 ms). Trace:
W20260709 12:21:20.006294  3845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 797) took 1671 ms (client timeout 2050 ms). Trace:
I20260709 12:21:20.006865  6015 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.007746  4577 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:21:20.007318  3845 rpcz_store.cc:269] 0709 12:21:18.334451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.601190 (+266739us) service_pool.cc:224] Handling call
0709 12:21:19.999331 (+1398141us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54001199d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:20.005858 (+  6527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207293184}
W20260709 12:21:20.002208  3996 rpcz_store.cc:269] 0709 12:21:17.739341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.760818 (+ 21477us) service_pool.cc:224] Handling call
0709 12:21:19.988097 (+2227279us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400413cd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:19.988304 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3742715136}
I20260709 12:21:20.013837  6033 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:19.974025  5961 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.014894  6033 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.018517  5436 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:21:20.022985  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:20.025888  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet 1fc77961701c41028cd54ea83719dae9: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:20.023265  3847 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:20.010532  5919 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.036890  3918 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:20.039433  5984 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:20.040802  5984 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.041263  5984 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.042959  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1553) took 1696 ms. Trace:
I20260709 12:21:20.047138  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 749) took 2309 ms. Trace:
I20260709 12:21:20.044737  3847 rpcz_store.cc:276] 0709 12:21:18.347019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.554736 (+1207717us) service_pool.cc:224] Handling call
0709 12:21:20.019657 (+464921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.040357 (+ 20700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.042613 (+  2256us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001199d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:20.042835 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033414912}
I20260709 12:21:20.042853  5984 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.054841  3843 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:21:20.049253  5953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.608s	user 0.025s	sys 0.017s
I20260709 12:21:20.059693  5807 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:20.062651  5981 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.811s	user 0.019s	sys 0.000s
I20260709 12:21:20.008797  6028 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.047399  5936 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:20.069244  5953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.719s	user 0.026s	sys 0.018s
W20260709 12:21:20.073791  5988 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.599s	user 0.009s	sys 0.006s
I20260709 12:21:20.063226  5981 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.071877  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.071406  5936 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:20.082929  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 120584us
I20260709 12:21:20.047662  3999 rpcz_store.cc:276] 0709 12:21:17.737499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.769075 (+ 31576us) service_pool.cc:224] Handling call
0709 12:21:18.363943 (+594868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.366452 (+  2509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.366485 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.366969 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.586972 (+220003us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:18.624782 (+ 37810us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.625164 (+   382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.625288 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.742083 (+116795us) raft_consensus.cc:1685] finished
0709 12:21:18.742111 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.046754 (+1304643us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54003507d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:20.046942 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807,"prepare.queue_time_us":31810,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4525,"raft.queue_time_us":7485,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":80077,"spinlock_wait_cycles":1365948672,"thread_start_us":219551,"threads_started":1,"wal-append.queue_time_us":363431,"wal-append.run_cpu_time_us":2971,"wal-append.run_wall_time_us":1089764}
I20260709 12:21:20.100849  3917 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.116681  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:20.117393  5577 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.718s	user 0.019s	sys 0.005s
I20260709 12:21:20.117961  5577 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:20.130066  6037 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:21:20.132072  5936 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.097013  5862 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.123s
W20260709 12:21:20.157330  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63960us
I20260709 12:21:20.157745  5862 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:20.101326  3748 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:20.159722  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65100.1us
I20260709 12:21:20.163494  5919 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:20.165465  5981 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:20.172173  5980 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.855s	user 0.013s	sys 0.046s
I20260709 12:21:20.175412  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 233) took 2618 ms. Trace:
I20260709 12:21:20.176007  3843 rpcz_store.cc:276] 0709 12:21:17.556850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.557010 (+   160us) service_pool.cc:224] Handling call
0709 12:21:19.988746 (+2431736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:20.057164 (+ 68418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.174091 (+116927us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400343ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:20.175156 (+  1065us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400343ad0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:20.175318 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5720315008}
I20260709 12:21:20.175299  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:20.178301  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121668us
I20260709 12:21:20.178781  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.179265  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.180454  5993 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:20.180821  5993 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:20.181246  5993 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.179327  3917 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:20.182623  3841 raft_consensus.cc:606] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:20.183019  3841 raft_consensus.cc:614] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:20.190274  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.191248  5979 ts_tablet_manager.cc:1916] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:20.191807  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.192870  5808 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:20.193022  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.193214  5709 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:20.193588  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.193895  5709 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.194941  5995 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.195523  3916 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:20.193553  5808 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.196628  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.197420  3916 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:20.197914  5808 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.198854  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.199505  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.199620  3846 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:20.201457  3848 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:20.201989  5709 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:20.202704  5767 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:20.204916  5992 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.814s	user 0.000s	sys 0.012s
I20260709 12:21:20.205790  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:20.195046  5990 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.834s	user 0.004s	sys 0.012s
I20260709 12:21:20.206786  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 782) took 2053 ms. Trace:
I20260709 12:21:20.115036  6028 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.203306  5767 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.206795  3921 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:20.217724  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.156509  4576 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:20.219995  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.185673  5953 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:20.210846  3844 rpcz_store.cc:276] 0709 12:21:18.153035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.153148 (+   113us) service_pool.cc:224] Handling call
0709 12:21:18.153433 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.153741 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.153768 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.154262 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.355428 (+201166us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b180033f220. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:21:18.389279 (+ 33851us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:18.389353 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.389449 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.203843 (+1814394us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:20.206392 (+  2549us) raft_consensus.cc:1685] finished
0709 12:21:20.206411 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.206604 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35909,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":22032,"spinlock_wait_cycles":108149376,"thread_start_us":32478,"threads_started":1,"wal-append.queue_time_us":201872}
I20260709 12:21:20.228614  3844 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:20.189718  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.231974  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.233754  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.223507  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.220467  5767 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.243691  5577 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.189695  5659 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.241716  5953 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.247761  5936 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.248453  5953 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:20.250938  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.252300  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.253469  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.222019  3748 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.254805  3850 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.258970  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.336342  5890 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.262135  5961 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.269974  3917 raft_consensus.cc:2368] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
W20260709 12:21:20.316933  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 97720.6us
I20260709 12:21:20.254789  3748 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.344838  3919 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:20.283481  3843 raft_consensus.cc:2410] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:21:20.351675  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.357645  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:20.359097  6043 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:21:20.361508  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.269562  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:20.323248  5659 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.364409  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 242) took 1711 ms. Trace:
I20260709 12:21:20.289870  5953 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:21:20.371547  3849 rpcz_store.cc:276] 0709 12:21:18.652964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.953922 (+1300958us) service_pool.cc:224] Handling call
0709 12:21:19.994565 (+ 40643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.030077 (+ 35512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.030107 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.045577 (+ 15470us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.183972 (+138395us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:20.184030 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.184130 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.364152 (+180022us) raft_consensus.cc:1685] finished
0709 12:21:20.364183 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.364340 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":105915,"threads_started":1,"wal-append.queue_time_us":185902}
I20260709 12:21:20.387657  3748 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.370563  5890 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.393831  4575 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:20.395383  5521 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.409278  5862 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:20.409884  5862 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.397915  5951 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.411809  5951 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:20.412269  5951 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.412340  5993 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.416956  4578 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:20.400835  5984 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.400745  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.401759  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.402715  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.405088  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:20.419277  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.423913  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:20.430490  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 210931us
I20260709 12:21:20.437649  5936 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:20.438166  5936 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:20.438561  5936 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.423321  3748 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.432585  5993 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.448190  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:20.433394  5521 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:20.447595  6004 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.449172  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.438748  6033 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.440744  5890 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:21:20.449122  5950 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.450977  5521 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:20.476414  5521 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.478435  5521 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:20.478813  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.479522  3846 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:20.455793  6004 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.479905  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.480472  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.468261  3923 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:20.470299  5709 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:20.484337  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.488592  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.488817  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.489470  3841 raft_consensus.cc:2368] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:20.490373  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.480410  6004 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.479846  5862 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.469033  5950 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.474885  3748 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 3, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.498637  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.499503  3842 raft_consensus.cc:2410] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:21:20.499778  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 66227.4us
I20260709 12:21:20.496812  5659 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:21:20.500850  5950 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.505563  3748 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.512235  5862 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:20.535555  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:20.538865  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.539232  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.533361  5436 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:21:20.539958  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:20.540617  5767 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.541545  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.541707  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.541870  3846 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.547087  3748 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.550048  3748 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.551462  3996 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:20.552155  3748 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.520961  6032 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 12:21:20.563537  5881 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:20.566668  5881 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:20.567133  5881 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:20.568293  5881 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.569507  5951 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.570519  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.559434  5936 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.569852  5881 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.582491  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.581436  3748 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 2 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.584759  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.588248  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.591652  3850 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:20.592403  6036 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.593320  5767 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.594004  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.596168  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.595340  5936 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.600244  5563 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:20.600991  5953 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:20.605988  5953 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.608893  5953 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.609889  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:20.602305  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.615005  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.615571  3848 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:20.620246  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:20.622318  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.623636  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.618758  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.625706  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.625725  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.627498  3847 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:20.628192  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.628556  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.630019  3847 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.631115  5950 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.619222  5563 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.636130  3924 raft_consensus.cc:2368] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:20.636667  3845 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:20.639765  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.647949  5984 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.648474  5984 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:20.648936  5984 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.651932  3841 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:21:20.652074  5951 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.652877  5951 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:20.653908  5951 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.654316  5951 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.641000  5563 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.670553  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.676074  3962 leader_election.cc:400] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:20.676672  3962 leader_election.cc:403] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:20.674985  3992 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:20.708228  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 45868.5us
I20260709 12:21:20.695374  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.717849  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.726099  3998 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:20.669793  5951 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.695969  6032 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:20.730427  3993 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:20.714313  5521 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:20.743669  3917 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.756322  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.716725  6036 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:20.718315  5659 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:20.759258  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:20.760581  3991 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:20.779932  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.784122  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:20.787878  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.800794  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.801810  3990 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:20.802985  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:20.804005  6052 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:21:20.786267  5951 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.806875  3843 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:20.811785  5996 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:20.812232  5996 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:20.826109  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.829429  3995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:20.830152  3995 raft_consensus.cc:606] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:20.829605  6004 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.830495  3995 raft_consensus.cc:614] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:20.832280  5521 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:20.832962  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:20.833616  3996 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:20.834335  5979 ts_tablet_manager.cc:1929] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:20.834851  5979 log.cc:1199] T ff4bdec26d3e4879bd33a92daad5d607 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/ff4bdec26d3e4879bd33a92daad5d607
I20260709 12:21:20.799196  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.842254  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:20.845271  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.849886  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.852314  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:20.855504  3844 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:20.858991  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet f370e99c95594dc19f98fb403380e06c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:21:20.861456  5996 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.862396  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.863126  5996 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:20.863150  3924 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:20.865149  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.868392  3919 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:20.874204  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.872129  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.875813  3916 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:20.871431  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.873492  3998 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:20.884440  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:20.866619  5953 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.898676  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:20.899364  5979 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52848 (request call id 74) took 3321 ms. Trace:
I20260709 12:21:20.899596  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:20.904719  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.904986  5984 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:20.907156  5984 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:20.907886  6004 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:20.907860  6039 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:20.909579  6039 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:20.909955  6039 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.910835  6039 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.912565  6039 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.916633  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:20.918592  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:20.918960  5951 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:20.919693  5993 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:20.920109  5951 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.920579  3925 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:20.921200  5951 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:20.919667  5767 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:21:20.924058  6048 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.442s	user 0.004s	sys 0.000s
I20260709 12:21:20.924650  5961 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:20.925117  5961 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:20.926303  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1706) took 1208 ms. Trace:
I20260709 12:21:20.926641  6032 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.927224  6032 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:20.926808  3918 rpcz_store.cc:276] 0709 12:21:19.718411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.048783 (+330372us) service_pool.cc:224] Handling call
0709 12:21:20.056010 (+  7227us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:20.077555 (+ 21545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.078131 (+   576us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:20.086985 (+  8854us) log.cc:844] Serialized 52 byte log entry
0709 12:21:20.341108 (+254123us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:20.352523 (+ 11415us) log.cc:844] Serialized 14 byte log entry
0709 12:21:20.355510 (+  2987us) log.cc:844] Serialized 14 byte log entry
0709 12:21:20.361519 (+  6009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.361691 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.923406 (+561715us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:20.926032 (+  2626us) raft_consensus.cc:1685] finished
0709 12:21:20.926069 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.926230 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7121,"prepare.queue_time_us":7485,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":12702,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":6878,"spinlock_wait_cycles":23375744,"thread_start_us":153646,"threads_started":1,"wal-append.queue_time_us":338972}
W20260709 12:21:20.930719  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.932767  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:20.942025  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:20.943171  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:20.943683  3919 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.928509  6032 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:21.536206  3994 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 12:21:21.283000  3998 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:21.709095  3994 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:21.136782  3924 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:21.137202  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.076884  5890 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:21.711750  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.711488  5890 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:21.715865  5981 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.372601  3919 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:21.716710  5981 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:21.545138  6070 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
W20260709 12:21:21.584416  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 579167us
I20260709 12:21:20.974401  3843 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:21.663808  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.377504  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.234488  3996 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:21.722695  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:21.729858  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 797127us
I20260709 12:21:21.733842  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.737103  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:21.602231  6065 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.716s	user 0.002s	sys 0.000s
W20260709 12:21:21.503974  6067 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:21:21.542585  5810 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:21.184635  5966 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.976532  5950 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:21.746024  3993 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:20.974511  5563 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:21.761672  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.093446  5862 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:21.745556  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:20.926333  5961 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:21.772917  3998 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:21.773514  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.505455  5521 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.731571  5993 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:21.751082  6039 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.006s
I20260709 12:21:21.751643  6032 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.736955  5705 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:21:21.779132  3848 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:21:21.790098  3841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.020s	sys 0.017s
W20260709 12:21:21.792284  3841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.021s	sys 0.017s
I20260709 12:21:21.790827  3991 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:21.803575  5812 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:21.804085  5812 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:21.805171  5812 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:21.808238  5953 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:21.808863  5953 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.809825  5981 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:21.776118  5810 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:21.812927  5936 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:21.813337  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.813375  5936 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:21.813635  5810 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:21.814621  5936 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:21.815722  3996 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:21.815981  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:21.779299  5577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.016s	sys 0.025s
I20260709 12:21:21.814817  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.814775  5521 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:21.785331  5890 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:21.798959  5966 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:21.826339  5521 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:21.826951  5521 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.784603  5862 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:21.819248  5577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.016s	sys 0.026s
I20260709 12:21:21.821573  3993 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:21.831806  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1580) took 1073 ms. Trace:
I20260709 12:21:21.834998  3844 rpcz_store.cc:276] 0709 12:21:20.758486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.763395 (+  4909us) service_pool.cc:224] Handling call
0709 12:21:21.831369 (+1067974us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5400407754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:21.831720 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162496768}
I20260709 12:21:21.835431  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.836660  3991 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:21.839407  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.841471  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.842557  3994 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:21.843367  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.822922  5961 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.783885  5563 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:21:21.787268  5993 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:21.828660  5936 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.847760  3999 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:21.854625  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 829) took 1241 ms. Trace:
I20260709 12:21:21.850310  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.860976  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.828593  5966 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:21.861950  3991 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:20.899911  5979 rpcz_store.cc:276] 0709 12:21:17.604698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.675426 (+ 70728us) service_pool.cc:224] Handling call
0709 12:21:18.227161 (+551735us) ts_tablet_manager.cc:1151] Deleting tablet ff4bdec26d3e4879bd33a92daad5d607
0709 12:21:18.227275 (+   114us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:20.105662 (+1878387us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b24002c44b8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78cd7e 00007fdc4f78ab75 00007fdc4f944a58 00007fdc4f944c9d 00007fdc4f944350 00007fdc58f77835 00007fdc58f777d9 00007fdc58fb0428 00007fdc525bd85a 00007fdc525bd81e
0709 12:21:20.633001 (+527339us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:20.834178 (+201177us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:20.899247 (+ 65069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118066,"spinlock_wait_cycles":61341440,"tablet-delete.queue_time_us":431555,"thread_start_us":310329,"threads_started":1}
I20260709 12:21:21.878346  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:21.890744  3843 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:21.891897  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:21.886371  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.859529  3841 rpcz_store.cc:276] 0709 12:21:20.614686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.865013 (+250327us) service_pool.cc:224] Handling call
0709 12:21:20.865388 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.889826 (+ 24438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.889857 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.987626 (+ 97769us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.816172 (+828546us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:21.816245 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.816370 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.854362 (+ 37992us) raft_consensus.cc:1685] finished
0709 12:21:21.854388 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.854550 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18937,"raft.queue_time_us":24129,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1276,"thread_start_us":788322,"threads_started":1,"wal-append.queue_time_us":825588}
I20260709 12:21:21.888667  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:21.893720  3996 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:21.846916  5521 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:21.879889  3922 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.992s	user 0.013s	sys 0.000s
I20260709 12:21:21.897719  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:21.899307  3922 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:21.899976  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 1720) took 1048 ms. Trace:
I20260709 12:21:21.899821  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:21.900707  3843 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:21.909973  3993 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:21.994769  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.000051  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.001034  3991 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:21.901494  3922 rpcz_store.cc:276] 0709 12:21:20.851926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.858642 (+  6716us) service_pool.cc:224] Handling call
0709 12:21:21.899914 (+1041272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:21.898708  5966 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 12:21:22.037376  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.043978  3991 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:22.047933  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 287110us
I20260709 12:21:22.049212  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:22.055708  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.053637  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:22.061538  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 243403us
I20260709 12:21:22.059181  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:22.066041  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.067471  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.067939  3991 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:22.069828  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.072427  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.059084  6082 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:22.069444  3814 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.618s (SENT)
I20260709 12:21:22.082394  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.083348  3996 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.069622  5767 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:22.075085  6080 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:21:22.084539  5984 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:22.095521  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 282883us
W20260709 12:21:22.120787  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.206s (SENT) [suppressed 26 similar messages]
I20260709 12:21:22.085007  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:22.105885  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.122125  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.049825  6086 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:21:22.125394  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.126264  3991 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:22.129366  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 92597.5us
I20260709 12:21:22.086576  5563 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.121759  6082 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:22.142511  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 835) took 1324 ms. Trace:
I20260709 12:21:22.146255  3849 rpcz_store.cc:276] 0709 12:21:20.817619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.740592 (+922973us) service_pool.cc:224] Handling call
0709 12:21:21.752522 (+ 11930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.752764 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:21.994317 (+241553us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.142141 (+147824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.142205 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:22.142250 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.142327 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.142451 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5376,"prepare.queue_time_us":332906,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":6266,"thread_start_us":340693,"threads_started":2,"wal-append.queue_time_us":139348}
I20260709 12:21:22.149466  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1742) took 1439 ms. Trace:
I20260709 12:21:22.128405  5950 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:22.150079  3992 rpcz_store.cc:276] 0709 12:21:20.712567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.716976 (+  4409us) service_pool.cc:224] Handling call
0709 12:21:21.767153 (+1050177us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:21.767397 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.782294 (+ 14897us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:21.803179 (+ 20885us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.148958 (+345779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.149034 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:22.149132 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.149224 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.149383 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34673,"prepare.queue_time_us":113111,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"spinlock_wait_cycles":3906816,"thread_start_us":293736,"threads_started":2,"wal-append.queue_time_us":291872}
I20260709 12:21:22.129176  6084 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:22.155095  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.155635  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.138952  5767 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:22.131619  5984 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:22.199041  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 136688us
I20260709 12:21:22.200281  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:22.202389  3814 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.799s (SENT)
I20260709 12:21:22.153123  5521 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:22.211068  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:22.212535  6075 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:21:22.156950  5881 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.218940  5881 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.213644  6105 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:22.222867  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74075.4us
I20260709 12:21:22.127522  6094 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:21:22.195711  5966 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.225687  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:22.143076  5563 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.203773  5993 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:22.222373  5881 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:22.238485  5996 consensus_meta.cc:287] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.375s	user 0.012s	sys 0.001s
I20260709 12:21:22.204947  6082 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.269004  5966 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.287997  5966 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:22.289057  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86736.3us
I20260709 12:21:22.207911  6084 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.296442  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.297600  6084 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:22.297672  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1757) took 1124 ms. Trace:
I20260709 12:21:22.298386  3990 rpcz_store.cc:276] 0709 12:21:21.173667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.173838 (+   171us) service_pool.cc:224] Handling call
0709 12:21:22.296214 (+1122376us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:22.297588 (+  1374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10536704}
I20260709 12:21:22.244153  3996 raft_consensus.cc:2410] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:22.249540  3991 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:22.251137  3992 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:22.152560  6087 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:21:22.269743  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.158813  5953 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.277043  5984 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:22.231663  5950 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:22.235610  6088 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:22.284986  5563 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:22.285588  6100 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.244911  5767 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.301550  6032 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:22.301693  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76068.3us
I20260709 12:21:22.319821  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:22.302064  5936 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.302373  5521 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:22.303620  5862 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:22.303969  5881 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.304971  6087 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:22.315932  5996 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.307969  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.328012  3991 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:22.308670  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.329177  3996 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:22.311199  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.317759  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.318634  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:22.311618  5981 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.307219  3998 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.309937  5966 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:22.326418  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.331781  3990 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:22.334205  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:22.335141  3992 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:22.341063  5981 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.340895  5881 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.343713  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.345460  3991 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:22.318951  6100 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:22.347108  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:22.350121  3918 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:22.320797  6088 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:22.355235  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.365916  3998 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:22.340968  3917 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:22.352746  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.352896  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:22.351840  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.353412  6036 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.353464  6087 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:22.378419  6087 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.378141  6036 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.378854  6087 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:22.378574  6088 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.380815  6036 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:22.382457  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.364464  3996 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:22.354661  6098 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:22.355430  5981 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:22.324210  5521 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.400306  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.448779  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.449977  3998 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:22.446820  6036 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.451885  6036 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.456902  5881 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:22.457722  5881 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.458460  5881 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.449745  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.357817  5812 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.359800  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.464066  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.362584  3842 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:22.465416  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 834) took 1648 ms. Trace:
I20260709 12:21:22.327296  5936 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:22.366139  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.326934  6032 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.368062  3991 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:22.369047  5950 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.336304  5996 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.372298  5953 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:22.347941  5966 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.375672  5862 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:22.375315  6100 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.376183  6094 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:22.377388  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:22.377705  5961 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:21:22.399873  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.400295  6098 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:22.379796  6087 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:22.511168  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.665342  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.711341  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 832) took 2021 ms. Trace:
I20260709 12:21:22.692312  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:22.627000  3888 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Timed out: RequestConsensusVote RPC to 127.2.157.65:37307 timed out after 2.050s (SENT)
I20260709 12:21:22.667389  3993 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:22.712843  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 249) took 2030 ms. Trace:
I20260709 12:21:22.465878  3842 rpcz_store.cc:276] 0709 12:21:20.817266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.006287 (+189021us) service_pool.cc:224] Handling call
0709 12:21:22.362127 (+1355840us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:22.362336 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.465065 (+102729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.465335 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8557952}
I20260709 12:21:22.763252  3848 rpcz_store.cc:276] 0709 12:21:20.682837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.943358 (+260521us) service_pool.cc:224] Handling call
0709 12:21:20.973833 (+ 30475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.816343 (+842510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.712558 (+896215us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002ab554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:22.712771 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849390976}
W20260709 12:21:22.749604  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.761061  3845 rpcz_store.cc:276] 0709 12:21:20.690130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.985820 (+295690us) service_pool.cc:224] Handling call
0709 12:21:22.710426 (+1724606us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5800002a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:22.710677 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.710899 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.710937 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.711007 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:22.711052 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.711126 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.711260 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14926592}
I20260709 12:21:22.747363  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:22.689981  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.761233  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.445888  6082 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:22.767191  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74984.4us
I20260709 12:21:22.760980  3995 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:22.526865  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.446301  5521 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.530180  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.783289  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:22.772483  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.782141  3998 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:22.784600  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.769886  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:22.771229  3995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1756) took 1663 ms (client timeout 1813 ms). Trace:
I20260709 12:21:22.772652  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.786878  3992 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:22.720854  6076 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.708s	user 0.003s	sys 0.001s
I20260709 12:21:22.778177  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:22.448242  5981 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.771574  3997 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:22.709710  6106 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.675298  6103 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:22.830200  6103 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:22.831161  6103 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.766196  5862 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.791972  5881 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:22.832780  5862 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.833357  5881 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.834108  5881 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.818892  6106 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:22.793612  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:22.836735  6110 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.837038  6106 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:22.837370  6110 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.739356  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:22.738055  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:22.795074  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.769452  5950 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.796505  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:22.797513  5966 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:22.797680  3996 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:22.798166  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.801296  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:22.802006  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:22.786473  3995 rpcz_store.cc:269] 0709 12:21:21.108155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.108332 (+   177us) service_pool.cc:224] Handling call
0709 12:21:22.665111 (+1556779us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:22.771171 (+106060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17908480}
I20260709 12:21:22.813369  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1760) took 1302 ms. Trace:
I20260709 12:21:22.815044  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:22.772063  5810 raft_consensus.cc:2764] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:22.826164  6115 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:22.844592  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:22.779192  6094 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:22.779383  6082 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:22.863775  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 159874us
I20260709 12:21:22.791574  5767 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:22.787791  6036 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.072851  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:23.209012  3748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 188) took 15368 ms (client timeout 15000 ms). Trace:
I20260709 12:21:22.888096  3993 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
W20260709 12:21:23.312526  3889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.014s
I20260709 12:21:23.128878  3850 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
W20260709 12:21:22.903354  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.324611  3889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.012s	sys 0.014s
W20260709 12:21:23.249940  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.210282  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.250839  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.878804  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:23.209869  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.312546  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.314975  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.005716  3875 heartbeater.cc:646] Failed to heartbeat to 127.2.157.126:36337 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.157.126:36337 timed out after 15.000s (SENT)
I20260709 12:21:23.340912  3845 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:23.325196  3997 rpcz_store.cc:276] 0709 12:21:21.512368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.623909 (+111541us) service_pool.cc:224] Handling call
0709 12:21:22.363585 (+739676us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:22.813277 (+449692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13730176}
W20260709 12:21:23.341925  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.342768  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.909904  4575 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:23.350430  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.350641  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:22.907575  6076 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:21:23.354404  3922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.020s	sys 0.012s
I20260709 12:21:22.931596  5936 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:23.349529  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.013s
W20260709 12:21:23.372006  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.014s	sys 0.016s
I20260709 12:21:23.372090  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:22.944948  6116 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:23.342640  6106 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.359388  3994 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
W20260709 12:21:23.359527  3888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.015s
I20260709 12:21:23.373454  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:22.919591  6100 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.312393  6087 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.102355  6032 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.365927  3850 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:22.934254  6110 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:23.063069  5812 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.003s
W20260709 12:21:23.367683  3922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.020s	sys 0.016s
I20260709 12:21:23.103403  5996 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.006018  5961 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.986131  6084 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:23.058305  5563 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.131142  6114 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:23.374218  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.343331  6103 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.840240  5981 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.376209  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:23.313668  5881 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.312911  5950 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:23.378001  3888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.017s	sys 0.015s
I20260709 12:21:23.002411  3747 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:21:23.382143  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.386301  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.387642  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.349896  5767 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.130254  5521 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.311399  5862 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.400915  3996 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:23.378929  6086 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:23.409713  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.410571  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:23.411461  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.407361  6110 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:23.446861  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 806) took 1151 ms. Trace:
I20260709 12:21:23.447274  3993 rpcz_store.cc:276] 0709 12:21:22.301210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.391889 (+1090679us) service_pool.cc:224] Handling call
0709 12:21:23.446793 (+ 54904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.448226  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.448803  3993 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:23.449254  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 803) took 1155 ms. Trace:
I20260709 12:21:23.449545  3993 rpcz_store.cc:276] 0709 12:21:22.294333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.447951 (+1153618us) service_pool.cc:224] Handling call
0709 12:21:23.449200 (+  1249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.450436  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.451197  3993 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:23.385820  5993 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.106156  6098 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.419019  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.451665  5993 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.451972  6098 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:23.452143  5993 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.429383  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:23.430922  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.342502  6115 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.381549  6116 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.459203  3999 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:23.440258  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet ff4bdec26d3e4879bd33a92daad5d607 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
W20260709 12:21:23.442368  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 815380us
I20260709 12:21:23.416793  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.460646  3991 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:23.446190  3997 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:23.461408  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 801) took 1167 ms. Trace:
I20260709 12:21:23.445935  3995 raft_consensus.cc:2410] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:21:23.462129  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.462659  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 808) took 1131 ms. Trace:
I20260709 12:21:23.463115  3995 rpcz_store.cc:276] 0709 12:21:22.331111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.391949 (+1060838us) service_pool.cc:224] Handling call
0709 12:21:23.462602 (+ 70653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.426676  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:23.463975  3998 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:23.465539  3994 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:23.466329  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 793) took 1214 ms. Trace:
I20260709 12:21:23.461838  3997 rpcz_store.cc:276] 0709 12:21:22.293792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.391819 (+1098027us) service_pool.cc:224] Handling call
0709 12:21:23.461321 (+ 69502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.467993  3992 raft_consensus.cc:2410] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:23.453553  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 789) took 1215 ms. Trace:
I20260709 12:21:23.468516  3993 rpcz_store.cc:276] 0709 12:21:22.238531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.450173 (+1211642us) service_pool.cc:224] Handling call
0709 12:21:23.453499 (+  3326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.469959  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 807) took 1159 ms. Trace:
I20260709 12:21:23.425101  5961 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.470470  3991 rpcz_store.cc:276] 0709 12:21:22.310305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.395880 (+1085575us) service_pool.cc:224] Handling call
0709 12:21:23.469882 (+ 74002us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:23.340914  3748 rpcz_store.cc:269] 0709 12:21:07.840631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.841080 (+   449us) service_pool.cc:224] Handling call
0709 12:21:23.208888 (+15367808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:20.787182 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:20.787983 (+   801us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:20.788041 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:21:20.788072 (+    31us) tablet.cc:662] Decoding operations
0709 12:21:20.828461 (+ 40389us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:20.828541 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:20.828568 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:21:20.829862 (+  1294us) tablet.cc:701] Row locks acquired
0709 12:21:20.829917 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:21:20.830090 (+   173us) write_op.cc:270] Start()
0709 12:21:20.830242 (+   152us) write_op.cc:276] Timestamp: P: 1783599680830023 usec, L: 0
0709 12:21:20.830262 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:21:20.831002 (+   740us) log.cc:844] Serialized 6690 byte log entry
0709 12:21:22.094861 (+1263859us) op_driver.cc:464] REPLICATION: finished
0709 12:21:22.212649 (+117788us) write_op.cc:301] APPLY: starting
0709 12:21:22.212791 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:22.213303 (+   512us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:22.213480 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:22.220297 (+  6817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:22.220827 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:21:22.220911 (+    84us) write_op.cc:312] APPLY: finished
0709 12:21:22.221575 (+   664us) log.cc:844] Serialized 119 byte log entry
0709 12:21:22.221831 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:22.222074 (+   243us) write_op.cc:454] Released schema lock
0709 12:21:22.249563 (+ 27489us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:22.295423 (+ 45860us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:22.295476 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":218564,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":117433,"apply.run_cpu_time_us":6293,"apply.run_wall_time_us":82809,"num_ops":17,"prepare.queue_time_us":103798,"prepare.run_cpu_time_us":18320,"prepare.run_wall_time_us":107453,"raft.queue_time_us":375384,"raft.run_cpu_time_us":15495,"raft.run_wall_time_us":43987,"replication_time_us":1264386,"thread_start_us":445875,"threads_started":4,"wal-append.queue_time_us":103597,"wal-append.run_cpu_time_us":49760,"wal-append.run_wall_time_us":2305239}]]}
I20260709 12:21:23.475175  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.477145  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 785) took 1239 ms. Trace:
I20260709 12:21:23.466841  3994 rpcz_store.cc:276] 0709 12:21:22.251929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.464864 (+1212935us) service_pool.cc:224] Handling call
0709 12:21:23.465286 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.466031 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.466253 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.428319  5563 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.446861  6110 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.458462  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.485929  6110 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.488739  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 158) took 1132 ms. Trace:
I20260709 12:21:23.488879  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.489653  3850 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:23.490090  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.491319  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.491838  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 796) took 1199 ms. Trace:
I20260709 12:21:23.492513  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.493297  3991 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:21:23.493585  3846 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:23.494163  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 799) took 1200 ms. Trace:
I20260709 12:21:23.483582  5563 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.494647  3991 rpcz_store.cc:276] 0709 12:21:22.293256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.473559 (+1180303us) service_pool.cc:224] Handling call
0709 12:21:23.493034 (+ 19475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.493831 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.494090 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.489171  3992 rpcz_store.cc:276] 0709 12:21:22.363763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.487846 (+1124083us) service_pool.cc:224] Handling call
0709 12:21:23.488177 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.488395 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.488422 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.488459 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:23.488498 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.488552 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.488653 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.477706  3995 rpcz_store.cc:276] 0709 12:21:22.237255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.464038 (+1226783us) service_pool.cc:224] Handling call
0709 12:21:23.476430 (+ 12392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.476707 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.476740 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.476800 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:23.476858 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.476934 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.477065 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.492175  3997 rpcz_store.cc:276] 0709 12:21:22.292434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.468232 (+1175798us) service_pool.cc:224] Handling call
0709 12:21:23.479912 (+ 11680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.491522 (+ 11610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.491551 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.491597 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:23.491631 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.491688 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.491786 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.467794  6114 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.471925  5984 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.466204  6008 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.465911  6086 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:23.436470  6084 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.517442  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:23.518091  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 160) took 1118 ms. Trace:
I20260709 12:21:23.600042  3999 rpcz_store.cc:276] 0709 12:21:22.399340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.399462 (+   122us) service_pool.cc:224] Handling call
0709 12:21:23.517829 (+1118367us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540002f654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:23.518010 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601274624}
I20260709 12:21:23.526180  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 790) took 1287 ms. Trace:
I20260709 12:21:23.601724  3996 rpcz_store.cc:276] 0709 12:21:22.238853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.386074 (+147221us) service_pool.cc:224] Handling call
0709 12:21:23.525940 (+1139866us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400199bd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:23.526083 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770647936}
I20260709 12:21:23.493328  5961 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.587903  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.533145  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 802) took 1239 ms. Trace:
I20260709 12:21:23.603374  3994 rpcz_store.cc:276] 0709 12:21:22.294067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.480890 (+1186823us) service_pool.cc:224] Handling call
0709 12:21:23.481312 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.532686 (+ 51374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.532732 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.532799 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:23.532848 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.532933 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.533079 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.539572  3991 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:23.606993  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 159) took 1208 ms. Trace:
I20260709 12:21:23.607425  3991 rpcz_store.cc:276] 0709 12:21:22.398767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.498510 (+1099743us) service_pool.cc:224] Handling call
0709 12:21:23.539025 (+ 40515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.606654 (+ 67629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.606919 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.605207  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 163) took 1007 ms. Trace:
I20260709 12:21:23.613513  3995 rpcz_store.cc:276] 0709 12:21:22.597796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.528417 (+930621us) service_pool.cc:224] Handling call
0709 12:21:23.604501 (+ 76084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.604739 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.604776 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.604831 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:23.604886 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.604955 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.605131 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.618738  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:21:23.497872  3733 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54656.3us
W20260709 12:21:23.592960  3964 connection.cc:256] RPC call timeout handler was delayed by -3.0019571570001062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:21:23.608552  6008 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.625447  5966 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:23.629447  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 318339us
W20260709 12:21:23.634471  3814 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.753s (SENT)
W20260709 12:21:23.635746  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 309677us
W20260709 12:21:23.638373  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 287787us
I20260709 12:21:23.608822  6032 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:23.639672  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.642380  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.643100  3849 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:23.600188  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99027us
W20260709 12:21:23.651537  3891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.007s	sys 0.008s
W20260709 12:21:23.652091  3891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.008s
W20260709 12:21:23.656140  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.657680  3962 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:23.677613  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:23.688879  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54436.7us
W20260709 12:21:23.694988  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44202.2us
I20260709 12:21:23.648648  6082 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.641845  5881 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.713449  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.713696  5881 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.715086  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:23.716264  5881 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.715893  3918 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:23.717451  6008 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:23.718094  6008 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:23.716281  6086 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:23.709744  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50133us
I20260709 12:21:23.725708  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:23.708839  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:23.727308  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.642323  6032 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:23.735514  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.736541  3850 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:23.718792  5993 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.529309  6114 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.640959  4575 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:23.708289  5810 raft_consensus.cc:2764] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:23.749284  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:23.757156  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 67954.2us
I20260709 12:21:23.757652  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.758211  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:23.757153  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:23.745895  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 370777us
I20260709 12:21:23.743566  3888 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:23.755852  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.689868  6094 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.639918  5966 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:23.749647  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121044us
I20260709 12:21:23.731293  6123 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.764690  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.766083  3964 connection.cc:256] RPC call timeout handler was delayed by -2.8921571569999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 12:21:23.768128  3889 connection.cc:256] RPC call timeout handler was delayed by -1.0045352319998528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32010000000000005s for a response
I20260709 12:21:23.762465  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:23.722128  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.739706  6032 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:23.776865  3846 raft_consensus.cc:606] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:23.773619  3964 connection.cc:256] RPC call timeout handler was delayed by -2.7751571569999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:21:23.777593  3846 raft_consensus.cc:614] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:23.777819  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.709165  6101 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:23.778249  3964 connection.cc:256] RPC call timeout handler was delayed by -2.6959571570000662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:21:23.776969  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.778646  3964 connection.cc:256] RPC call timeout handler was delayed by -2.5321571570000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:21:23.778177  5881 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.780009  5881 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.780350  5881 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:23.786940  3889 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.707s (SENT)
W20260709 12:21:23.779354  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6997041550000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
I20260709 12:21:23.747169  6124 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:23.788066  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.788157  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6682041550000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:21:23.789611  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.792227  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:23.792930  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6592041549999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 12:21:23.793633  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6484041550002075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 12:21:23.792982  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:23.793781  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.794510  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6421041550001974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:21:23.795017  3964 connection.cc:256] RPC call timeout handler was delayed by -1.6222571569999218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
W20260709 12:21:23.796316  3964 connection.cc:256] RPC call timeout handler was delayed by -1.4792041550001613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:21:23.794467  3841 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:23.796921  3964 connection.cc:256] RPC call timeout handler was delayed by -1.2929041550000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:21:23.797776  3964 connection.cc:256] RPC call timeout handler was delayed by -1.2110041550001824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 12:21:23.798182  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1336041550000573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:21:23.801705  6118 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:21:23.803570  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1736) took 1488 ms. Trace:
I20260709 12:21:23.770763  6123 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.805054  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.782428  6110 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:23.776829  6094 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.803915  3924 rpcz_store.cc:276] 0709 12:21:22.314669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.314745 (+    76us) service_pool.cc:224] Handling call
0709 12:21:22.321172 (+  6427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.527423 (+206251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.527489 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.585486 (+ 57997us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.863713 (+278227us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:22.863751 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.863825 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.803311 (+939486us) raft_consensus.cc:1685] finished
0709 12:21:23.803331 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.803488 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30751,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":421843,"threads_started":2,"wal-append.queue_time_us":889674}
I20260709 12:21:23.805142  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.775950  5521 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.776443  5862 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.770442  6132 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:23.770403  6081 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:21:23.796378  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.813414  5981 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.819767  4582 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:23.820407  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.790171  5961 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.829818  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:23.829880  4583 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:23.818862  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44760us
I20260709 12:21:23.813584  6123 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:23.833890  6139 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:21:23.798596  6101 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:23.859539  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55897.6us
I20260709 12:21:23.828842  6116 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.842940  6110 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.799312  6124 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.830461  6094 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.877862  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:23.887365  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 75057.4us
I20260709 12:21:23.889441  3990 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:21:23.881177  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.883828  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.866304  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:23.923342  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.928618  4580 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:23.889472  3843 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:23.923770  3849 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:23.930071  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.857685  6132 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.926016  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.926568  3847 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:23.926961  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.932765  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.933048  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 168) took 1203 ms. Trace:
I20260709 12:21:23.863332  6134 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:23.937310  4576 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:23.872535  5966 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:23.938247  6101 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.884341  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.940184  4574 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:23.938262  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:23.941246  5993 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.873396  6084 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:23.934315  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:23.930917  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:23.965909  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.872450  6115 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.878809  6114 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.970345  3841 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:23.974018  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 797) took 1681 ms. Trace:
W20260709 12:21:23.977417  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46595.3us
I20260709 12:21:23.978284  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:23.979205  6123 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:23.979605  6086 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:23.980234  6106 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.002s
I20260709 12:21:23.980638  6086 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:23.981038  6086 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:23.981410  6086 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.981782  6123 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:23.976529  3993 rpcz_store.cc:276] 0709 12:21:22.292727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.469672 (+1176945us) service_pool.cc:224] Handling call
0709 12:21:23.523369 (+ 53697us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:23.523980 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.524023 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:23.537770 (+ 13747us) log.cc:844] Serialized 52 byte log entry
0709 12:21:23.677995 (+140225us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:23.936646 (+258651us) log.cc:844] Serialized 14 byte log entry
0709 12:21:23.936940 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.950627 (+ 13687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.950713 (+    86us) raft_consensus.cc:1685] finished
0709 12:21:23.950732 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.973954 (+ 23222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4342,"raft.queue_time_us":3001,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":60856,"spinlock_wait_cycles":21376,"thread_start_us":299155,"threads_started":2,"wal-append.queue_time_us":56571}
W20260709 12:21:23.979760  6138 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:21:23.965938  3997 rpcz_store.cc:276] 0709 12:21:22.730106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.528297 (+798191us) service_pool.cc:224] Handling call
0709 12:21:23.603290 (+ 74993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.603679 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.603708 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.613249 (+  9541us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.732540 (+119291us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:23.732582 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.732664 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.885480 (+152816us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:23.888828 (+  3348us) raft_consensus.cc:1685] finished
0709 12:21:23.888868 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.932987 (+ 44119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2807,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":14161,"spinlock_wait_cycles":7387904,"thread_start_us":82683,"threads_started":1,"wal-append.queue_time_us":161389}
W20260709 12:21:23.994594  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71770.5us
I20260709 12:21:23.985275  6101 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:23.995512  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:23.999361  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.000276  5966 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:24.000626  6136 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:21:24.001067  5966 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.000895  6032 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.002717  3917 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:24.005772  6128 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.275s	user 0.002s	sys 0.000s
I20260709 12:21:24.005903  6101 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.007062  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1587) took 1231 ms. Trace:
I20260709 12:21:24.006966  6101 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.007561  3842 rpcz_store.cc:276] 0709 12:21:22.775850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.775985 (+   135us) service_pool.cc:224] Handling call
0709 12:21:22.820838 (+ 44853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.872985 (+ 52147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.873028 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.986610 (+113582us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.453597 (+466987us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:23.453641 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.453709 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.005185 (+551476us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:24.006732 (+  1547us) raft_consensus.cc:1685] finished
0709 12:21:24.006755 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.006993 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16965,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":26361,"spinlock_wait_cycles":8141696,"thread_start_us":349699,"threads_started":1,"wal-append.queue_time_us":550326}
I20260709 12:21:24.002749  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.016144  5563 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:24.017086  6124 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.011929  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:24.020808  6094 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.021632  6106 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.020691  3842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:24.025127  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.025307  3842 raft_consensus.cc:606] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.032637  6032 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.026984  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.032655  5881 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.028278  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 792) took 1788 ms. Trace:
I20260709 12:21:24.041602  3990 rpcz_store.cc:276] 0709 12:21:22.239437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.463696 (+224259us) service_pool.cc:224] Handling call
0709 12:21:24.028005 (+1564309us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003e1554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:24.028198 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3262260096}
W20260709 12:21:24.030522  6122 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.398s	user 0.000s	sys 0.002s
I20260709 12:21:24.044265  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1733) took 1730 ms. Trace:
I20260709 12:21:24.026041  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:23.988131  6084 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:21:24.045181  3841 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:24.031427  5993 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.045544  6084 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.046469  6084 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:24.044723  3922 rpcz_store.cc:276] 0709 12:21:22.313866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.314602 (+   736us) service_pool.cc:224] Handling call
0709 12:21:22.321584 (+  6982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.769077 (+447493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.769127 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.782746 (+ 13619us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.400705 (+617959us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:23.400767 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.400866 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.029775 (+628909us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:24.043862 (+ 14087us) raft_consensus.cc:1685] finished
0709 12:21:24.043894 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.044185 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19280,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":58,"spinlock_wait_cycles":8893824,"thread_start_us":1034730,"threads_started":2,"wal-append.queue_time_us":707206}
I20260709 12:21:24.030858  6135 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:24.047308  6084 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.048581  6135 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.049072  6135 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:24.049345  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:24.050015  3841 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.050355  3841 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:24.050268  6135 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.036981  6116 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.055004  6116 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.057183  6116 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.058049  5881 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:24.037658  6098 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.001s
I20260709 12:21:24.038936  6149 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:24.060213  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.061124  6135 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.040439  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:24.040802  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 108225us
I20260709 12:21:24.066905  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.067767  6098 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.068902  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.069952  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.070685  3844 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:24.036036  5966 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:24.071200  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.036438  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:24.071827  3843 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.045877  5993 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:24.072605  5993 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.072917  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.048599  6084 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.053035  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.042343  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.076959  5936 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.077344  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.077625  5936 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.078575  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.068809  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.079771  6032 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:24.071777  5966 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.080394  6032 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.080953  6032 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.081013  5966 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.083657  6115 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.083834  6149 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.084594  6115 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.085008  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:24.079990  3849 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:24.086313  6123 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.086822  6123 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.053915  6094 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.087790  6094 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.088099  6116 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:24.090404  6094 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.087231  6123 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.085034  6115 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:24.091428  6115 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.085602  3841 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:24.093899  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53561us
I20260709 12:21:24.094687  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.087047  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.095506  6100 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.096091  6100 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.096362  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.096508  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:24.096607  6100 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.097062  3849 raft_consensus.cc:606] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.097203  6134 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:24.097570  6134 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.097921  6134 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.098528  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:24.099820  3842 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.100346  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:24.078926  5936 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.103766  6081 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:24.104449  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 79402.8us
I20260709 12:21:24.105278  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.109580  6134 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.110430  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.111666  6081 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.112329  6081 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:24.112695  6081 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.113198  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.116757  6124 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.111624  6149 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:24.120177  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60075.6us
I20260709 12:21:24.121687  5862 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:24.071229  6098 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.122306  5810 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.122714  6098 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.961421  6132 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:23.992327  5767 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:24.111925  3890 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3bacd87db564c3ba5256af726514f84. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.115367  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.160189  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:24.164685  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 52930.9us
I20260709 12:21:24.169533  3843 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:24.171141  3888 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.161690  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:24.186501  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 162) took 1664 ms. Trace:
W20260709 12:21:24.176848  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 313760us
I20260709 12:21:24.187162  3992 rpcz_store.cc:276] 0709 12:21:22.522614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.527283 (+1004669us) service_pool.cc:224] Handling call
0709 12:21:23.532495 (+  5212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.590090 (+ 57595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.590116 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.613016 (+ 22900us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.777917 (+164901us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:24.166880 (+388963us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.186000 (+ 19120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.186115 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.186176 (+    61us) raft_consensus.cc:1685] finished
0709 12:21:24.186198 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.186413 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241786,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":484103,"threads_started":2,"wal-append.queue_time_us":233100}
W20260709 12:21:24.192245  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 76990.4us
I20260709 12:21:24.192503  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.193079  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.196900  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.191030  6086 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.198326  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.198443  6082 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.198945  6082 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.199430  6086 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.199345  6082 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.200527  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.199096  5563 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.201766  5563 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.202118  5563 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.203845  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:24.205580  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:24.211367  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115086us
I20260709 12:21:24.212869  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.213340  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:24.215585  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53980.8us
I20260709 12:21:24.216749  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.218391  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.194921  5767 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.212337  5981 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.212395  5812 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.167256  5993 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.232460  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.178225  5810 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.214699  6149 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.237188  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.238346  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.239720  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:24.255848  3922 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.240957  3916 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.241405  6150 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.242383  5810 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.246135  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.258852  3924 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:24.246855  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.259953  3925 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:24.248297  5862 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.265115  5862 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.230147  6134 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.265857  3843 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:21:24.267407  5862 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.236096  6114 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.268100  6114 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.268499  6114 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.249727  3920 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:24.271163  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.272010  3919 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:24.221267  5984 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.274075  6081 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.222237  6094 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:21:24.276213  6094 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:24.276566  6094 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:24.253834  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.255226  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:24.256608  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.278448  3921 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:24.279004  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.279419  6115 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.280267  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.281031  3849 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.281606  6115 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.226778  5767 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:24.282342  5767 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.282701  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.283793  6106 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.284175  6106 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.284539  6106 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.284698  3964 leader_election.cc:400] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
I20260709 12:21:24.285619  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.286795  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:24.287617  5521 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.288298  5521 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.288932  5521 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:24.291572  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.291819  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.291586  5862 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.292619  3917 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:24.210683  6100 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.256865  3842 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:24.261966  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.263000  5981 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:21:24.313822  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:24.314638  4574 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:24.314635  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.264546  3924 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:24.239379  3918 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:21:24.297087  3964 leader_election.cc:400] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:24.242555  6123 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.318629  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:24.319283  6123 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.319276  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.319944  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:24.320159  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103454us
I20260709 12:21:24.320597  3990 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.320675  6036 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.321123  6036 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.321195  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.321668  6036 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.322117  6084 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:24.322727  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.323298  3990 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:24.323772  6084 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.298398  5993 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.324258  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.234848  5812 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.324915  5812 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.326360  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.326930  3995 raft_consensus.cc:2376] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7. Re-sending same reply.
I20260709 12:21:24.327071  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.327883  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.300251  6132 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.301031  4575 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:24.303035  3841 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:24.306108  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:24.306408  6106 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.306759  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.307240  5936 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:24.305384  6114 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.345527  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.294870  6100 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.310508  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.348711  3842 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:24.310600  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:24.312484  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.313911  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.311249  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.349877  3849 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:24.297453  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.277392  6094 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.299499  3922 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:24.321627  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.333643  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.352468  3994 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.337000  3990 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.328207  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.337949  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.369580  3996 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:24.343999  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.344554  3918 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:24.370571  3998 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4. Re-sending same reply.
I20260709 12:21:24.344731  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.345103  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.344830  6086 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:24.346216  3995 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.319968  6149 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:24.354357  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 43840.7us
I20260709 12:21:24.372954  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.353351  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.374861  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.375167  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.375378  6100 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.375857  3844 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.358510  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.360674  6094 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.362838  6115 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.345440  6081 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.252993  6101 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.367211  3916 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:24.376094  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.380923  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.381386  3996 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.381703  3995 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:24.371738  3999 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4. Re-sending same reply.
I20260709 12:21:24.382668  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.383096  3998 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:24.376981  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48851.8us
I20260709 12:21:24.377512  3994 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.378259  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.387207  3995 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:24.388324  6115 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.389369  6115 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.390602  3997 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.392549  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.392786  3924 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:24.393216  3990 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:24.395725  3923 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:24.396839  3842 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:24.401221  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.375838  6100 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.404497  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.369249  6082 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.381058  5961 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:24.414784  6036 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.407297  6100 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.424131  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.425287  3844 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:24.412395  6009 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:24.426477  6009 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:24.426843  6009 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:24.411839  6149 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.427816  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.406291  5563 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.414649  3918 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.415200  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.416405  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.417204  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:24.411777  6106 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.418437  5961 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:24.420310  6032 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.434929  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.439412  4578 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.427769  6036 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.433269  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.416126  6132 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:24.444393  5881 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.440441  5961 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.444988  5881 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.445257  6114 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.446069  5881 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.446766  6132 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.447723  6132 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.449172  6132 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.449643  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.451881  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.455606  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.456442  4582 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.459540  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.453224  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.460891  6123 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:24.461274  4576 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.461422  6123 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.462494  6123 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.459050  6009 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.399935  5767 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.467059  6009 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.467393  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.467617  3845 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.468235  3999 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.469357  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.470269  6146 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.471202  3922 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:24.471485  6146 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:24.471941  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.472586  6146 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:24.466992  6100 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.473027  6146 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:24.473639  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.474140  6032 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.474282  3996 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:24.473991  6146 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.475361  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.475680  6100 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.475361  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.476645  3845 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.477850  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.429971  6098 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.481794  3992 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:24.493531  4582 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.500243  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.500758  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.503333  3841 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:24.505385  3924 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.436767  5812 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.510619  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.515244  4578 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:24.453336  6082 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:24.517195  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.518838  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:24.519846  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:24.519299  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:24.522137  3918 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.518230  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:24.478988  5563 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.522890  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:24.531891  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.531944  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:24.532265  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:24.532800  4583 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:24.533138  3924 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.533545  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.511179  6106 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:21:24.527477  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.540918  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.515844  6146 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.545058  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.523929  6081 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:24.549983  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.526813  6036 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:24.555979  3916 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:24.556525  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.543870  6101 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.543975  6086 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.561631  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.554291  4579 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:24.526486  5436 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:21:24.573463  3993 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:24.554891  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:24.561250  5810 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:24.574822  4577 raft_consensus.cc:2368] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:24.574851  5810 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.561367  5993 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:24.576066  5993 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:24.549642  5966 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.544440  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.576478  5810 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.577440  4575 raft_consensus.cc:2368] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
I20260709 12:21:24.561942  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.577957  5810 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.561391  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.578393  6086 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.565405  3998 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:24.555995  6127 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.576499  5993 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.579922  6127 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:24.580646  6086 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.580924  6127 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.565871  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.562312  6036 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:24.584034  3999 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7.
I20260709 12:21:24.583734  6101 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.566315  3991 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:21:24.584887  3991 pending_rounds.cc:85] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 2
I20260709 12:21:24.584385  6036 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.585139  3991 pending_rounds.cc:107] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:21:24.585515  3991 raft_consensus.cc:2889] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:24.585757  3994 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:24.556010  5563 raft_consensus.cc:2764] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:21:24.554453  6082 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.566803  6098 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.609098  6101 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.552788  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.609793  6147 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.611236  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.592430  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.612283  3994 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.567396  5812 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.567692  3995 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:24.612797  5993 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:24.568243  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.614169  3990 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7.
I20260709 12:21:24.568230  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.614949  3841 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.560341  6106 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.569156  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:24.616173  3842 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.617009  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.617318  3845 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:24.617751  3990 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.570333  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:24.619206  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.550218  6081 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:24.621090  3924 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:24.590605  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:24.621999  3849 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:24.592316  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.559949  5767 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:24.599380  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.630625  3997 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:24.615124  5993 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.630990  3992 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:24.632083  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.632844  3992 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.600253  5961 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.635859  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.637072  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.637483  3844 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:24.637454  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.638808  6081 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.639200  6009 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:24.604911  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet 63cbbf40cb084518a89acf7f7026e77b: Illegal state: Replica 32d706e2535f4fa19a09382d4edac677 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:24.620916  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.643421  3990 raft_consensus.cc:2368] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:24.637158  5961 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:24.644845  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.590670  3890 leader_election.cc:400] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:24.646322  3890 leader_election.cc:403] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:21:24.623373  3994 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:24.626338  3998 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:24.650310  3997 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:24.629717  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.651654  3993 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.657317  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.629830  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.659992  6169 ts_tablet_manager.cc:933] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:24.638218  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:24.704464  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 112214us
I20260709 12:21:24.705430  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.706703  3993 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:24.706892  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 116367us
W20260709 12:21:24.707562  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.707772  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 66704.9us
I20260709 12:21:24.713474  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.722314  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:24.717412  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50587.9us
W20260709 12:21:24.749181  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.724503  3842 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:24.746415  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.711158  3841 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:24.751101  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:24.752502  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:24.715791  5993 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.756147  3746 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.717437  6149 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:24.738649  6172 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:21:24.713323  6101 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.760879  3990 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:24.764191  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.739977  5812 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:24.738181  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:24.716117  5961 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.748769  5767 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.771999  6147 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:24.776456  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53296us
I20260709 12:21:24.777928  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.782306  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.775349  6147 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:24.763916  6100 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.795020  3746 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.797820  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.797526  3746 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.717473  6032 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:21:24.800434  3746 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.769647  6135 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.769905  5961 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:24.804800  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86444us
I20260709 12:21:24.774012  4576 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.811820  4547 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7.
I20260709 12:21:24.812248  4547 leader_election.cc:403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:24.813688  4547 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7.
I20260709 12:21:24.814909  5966 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.815150  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.815359  5966 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:24.815793  5966 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.816004  5521 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.774454  6101 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.769465  5993 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:21:24.794582  6106 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:24.803707  3746 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 5, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.800037  5810 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:24.845218  6173 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:21:24.811254  5961 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.822505  5521 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:21:24.847325  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 83209.9us
W20260709 12:21:24.847635  3747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 197) took 13886 ms (client timeout 15000 ms). Trace:
I20260709 12:21:24.848940  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:24.811301  6100 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.852854  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.855868  6106 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.858959  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.865325  6106 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:24.865914  6106 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:24.866927  6106 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.868234  6101 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:24.872277  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.877959  6081 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.879608  6147 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:24.880420  5521 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.827847  6084 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:24.907162  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58329.8us
W20260709 12:21:24.905634  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139517us
I20260709 12:21:24.908174  3814 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:24.913935  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.914594  3990 raft_consensus.cc:2376] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:21:24.917270  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.917812  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.918452  3993 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:24.918855  3995 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:24.919481  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:24.848325  3747 rpcz_store.cc:269] 0709 12:21:10.964968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.979612 (+ 14644us) service_pool.cc:224] Handling call
0709 12:21:24.847521 (+13867909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:23.806325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:23.973682 (+167357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:23.975924 (+  2242us) write_op.cc:435] Acquired schema lock
0709 12:21:23.984089 (+  8165us) tablet.cc:662] Decoding operations
0709 12:21:24.019620 (+ 35531us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:24.033329 (+ 13709us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:24.033368 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:24.033600 (+   232us) tablet.cc:701] Row locks acquired
0709 12:21:24.033614 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:21:24.033766 (+   152us) write_op.cc:270] Start()
0709 12:21:24.033890 (+   124us) write_op.cc:276] Timestamp: P: 1783599684033717 usec, L: 0
0709 12:21:24.033912 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:24.034634 (+   722us) log.cc:844] Serialized 538 byte log entry
0709 12:21:24.423709 (+389075us) op_driver.cc:464] REPLICATION: finished
0709 12:21:24.578945 (+155236us) write_op.cc:301] APPLY: starting
0709 12:21:24.579053 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:24.579156 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:24.579290 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:24.589896 (+ 10606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:24.590063 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:24.590112 (+    49us) write_op.cc:312] APPLY: finished
0709 12:21:24.598182 (+  8070us) log.cc:844] Serialized 23 byte log entry
0709 12:21:24.598432 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.598522 (+    90us) write_op.cc:454] Released schema lock
0709 12:21:24.598563 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:24.600695 (+  2132us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.600725 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144703,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":136648,"apply.run_cpu_time_us":2210,"apply.run_wall_time_us":35730,"num_ops":1,"prepare.queue_time_us":337704,"prepare.run_cpu_time_us":28553,"prepare.run_wall_time_us":436086,"raft.queue_time_us":114150,"raft.run_cpu_time_us":15723,"raft.run_wall_time_us":137009,"replication_time_us":389611,"thread_start_us":573577,"threads_started":4,"wal-append.queue_time_us":250753}]]}
I20260709 12:21:24.922662  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.923177  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.923604  3995 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.924057  3994 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:24.926263  3990 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:24.931063  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.931780  3990 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.937588  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.938970  3964 leader_election.cc:400] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:24.939429  3964 leader_election.cc:403] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:24.938284  3998 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:24.952909  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.953522  3964 leader_election.cc:400] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
W20260709 12:21:24.954661  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 406094us
I20260709 12:21:24.955797  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.956980  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:24.957705  3992 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:24.957906  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.968468  3996 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:24.969563  3993 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:21:24.963073  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.984568  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.954946  6183 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:24.986322  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.987303  3841 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:24.988368  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:24.949219  5767 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.990682  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.005789  3999 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.993989  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.008833  3995 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:25.010371  3922 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:24.974874  6098 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.017164  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:24.951756  6084 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 12:21:25.038139  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 118193us
I20260709 12:21:25.012727  6101 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:25.020673  5981 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.959002  6179 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
W20260709 12:21:25.057674  6175 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:21:25.022581  6180 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:25.087528  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48546.6us
I20260709 12:21:25.012926  6100 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:25.091822  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:25.090198  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 178425us
I20260709 12:21:25.053757  6132 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.014853  6154 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:25.105082  5936 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:25.147955  5936 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:25.149154  5936 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.150347  5936 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.094626  5767 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:21:25.106880  6146 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:21:25.109228  6082 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:25.111956  6081 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:25.112073  5521 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.055094  5981 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:25.155591  5981 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.114148  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:25.157430  6081 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:25.157910  6081 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.158316  6081 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.158914  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:25.114995  6084 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:25.160633  6084 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.161044  6084 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.161883  3814 leader_election.cc:400] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:25.162252  3814 leader_election.cc:403] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:25.115638  6179 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:25.164330  6189 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:25.164731  6179 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:25.087273  6180 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:25.165149  6189 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.165777  6180 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.166182  6189 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:25.166579  6189 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.067039  6101 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.169317  6101 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:25.171475  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:25.171941  5767 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:25.120529  5961 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.041566  6169 tablet_copy_client.cc:323] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:21:25.126415  6149 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:25.127856  5966 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.096151  5993 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:25.134840  4576 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:25.137197  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:25.138558  4575 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:25.159740  6082 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:25.192097  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 203809us
I20260709 12:21:25.173350  6127 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:25.180264  3990 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:21:25.114599  6181 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
W20260709 12:21:25.212604  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75498.5us
I20260709 12:21:25.171060  5981 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.195667  6103 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:25.227407  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.195636  6127 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.241524  6098 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5.
I20260709 12:21:25.194572  5993 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:21:25.223299  6135 raft_consensus.cc:2764] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:21:25.195574  5436 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7.
I20260709 12:21:25.254148  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.255247  6193 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:25.277388  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 86329.2us
I20260709 12:21:25.279711  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:25.176313  6189 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:25.285945  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55729.7us
I20260709 12:21:25.245576  6123 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:25.225848  6194 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 12:21:25.290660  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 98785.8us
I20260709 12:21:25.253084  6103 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:25.259311  5767 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:21:25.301362  3998 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:25.305827  3842 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:25.308372  3842 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:25.282881  6150 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:25.313084  3842 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:25.293278  4577 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:25.292121  5966 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:25.321825  3842 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:25.326274  3841 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:25.323911  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.304518  4579 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:25.331431  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet f3bacd87db564c3ba5256af726514f84 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:21:25.332196  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet f3bacd87db564c3ba5256af726514f84 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-f3bacd87db564c3ba5256af726514f84
I20260709 12:21:25.343830  3844 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:25.350054  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:25.356849  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45632.8us
I20260709 12:21:25.358635  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:25.344723  6116 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:25.332917  6135 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.381656  3999 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:25.382854  6081 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.386495  6081 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.389163  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:25.391242  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:25.370848  6116 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:25.396997  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 105144us
I20260709 12:21:25.291805  6127 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.360216  6197 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.372129  5961 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.374199  6032 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.357764  6115 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:21:25.404650  6116 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.360683  6132 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:21:25.367630  6150 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:21:25.422104  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:25.371173  6182 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 12:21:25.492493  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.451377  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 79309.9us
I20260709 12:21:25.397600  6036 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:21:25.406800  6203 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:25.429374  6115 consensus_queue.cc:1243] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:25.404098  6135 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:25.431154  5981 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.450085  6195 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:25.533671  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 111670us
I20260709 12:21:25.414218  5881 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:21:25.535427  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:25.464851  6127 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.451035  6211 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:25.540755  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 190829us
I20260709 12:21:25.541617  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.428458  6032 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.538391  5993 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:25.546651  5993 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.547621  5993 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.549220  5767 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:25.549597  5767 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.553364  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:25.423079  6197 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.559481  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.533769  6195 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:25.541278  6036 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:25.587229  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51886.2us
W20260709 12:21:25.542806  6191 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.261s	user 0.000s	sys 0.007s
W20260709 12:21:25.535706  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 164093us
W20260709 12:21:25.590119  6208 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:21:25.590569  6195 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.625880  6189 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.585687  5767 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.628012  6116 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:25.628690  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.596439  4577 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:25.597132  6213 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:25.603485  6214 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.603677  6103 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:25.584470  6114 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:25.605902  6211 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:25.613129  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53740.2us
I20260709 12:21:25.629352  6183 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.640834  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.592170  6036 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:25.656045  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:25.661867  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.665499  3844 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:25.682508  3849 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:25.632917  6213 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:25.667030  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:25.684510  3841 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:25.663803  6115 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.682791  6100 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:25.687201  6100 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.688570  5981 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:25.689177  5981 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:25.623143  6180 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.698845  6032 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.712374  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.691309  6213 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.646150  6183 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.707199  3990 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:25.708065  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.655467  6211 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.650490  6197 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.652377  6081 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.717303  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.728132  3992 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:25.690816  6150 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:25.639379  6084 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.700356  6036 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:25.739833  3844 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:25.729151  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.743222  3990 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.717787  3999 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.730934  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.744766  3993 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:25.731519  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:25.731568  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.714990  6217 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.701952  6103 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:21:25.730809  6032 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:25.713827  6106 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:21:25.727528  6081 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.763773  3997 pending_rounds.cc:85] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 1
I20260709 12:21:25.779770  3997 pending_rounds.cc:107] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:25.780196  3997 raft_consensus.cc:2889] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:25.770418  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.746922  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:25.690420  5981 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.841936  6032 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.843416  3990 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:25.851189  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80894.7us
I20260709 12:21:25.766885  5936 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:25.853343  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:25.775262  3999 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:25.793505  4577 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:25.792644  3993 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
W20260709 12:21:25.855427  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 140829us
I20260709 12:21:25.795473  6103 consensus_queue.cc:1243] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:25.796008  6036 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.861508  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.862417  6132 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.864712  6084 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.860486  6116 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.858597  5993 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:21:25.858968  6211 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.872043  6081 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.872763  5993 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:25.873157  5993 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.874010  5993 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.858592  5981 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.880371  6180 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:25.883581  6103 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.884101  6103 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:25.886283  6199 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.554s	user 0.005s	sys 0.011s
W20260709 12:21:25.859771  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 147997us
I20260709 12:21:25.894492  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:25.900915  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:25.907843  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:25.909507  4577 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:25.909878  5936 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:25.910416  5936 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:25.911375  5936 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.903961  6084 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:25.914940  6084 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.915933  6084 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:25.918414  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:25.924906  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63502.7us
I20260709 12:21:25.927157  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:25.928942  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.892704  6189 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:21:25.931504  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.903100  5993 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.928172  5984 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:25.949954  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.954186  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.924413  6203 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:25.930212  6132 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.944450  6150 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.962167  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:25.963028  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.981612  3993 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.964116  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:25.968268  5936 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:25.930832  5767 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:25.998981  3999 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:25.949050  6114 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:25.958127  5810 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.975864  5984 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:25.971989  6149 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:26.018920  3993 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:26.037357  3995 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:26.010768  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57644us
I20260709 12:21:26.050427  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:26.004386  6183 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.053766  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:26.009008  6203 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:26.005578  6150 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.047273  6149 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.051847  6228 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:26.066195  6149 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.068928  6036 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:26.073859  6032 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:26.066107  6228 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:26.075258  6228 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:26.048182  5810 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:26.079572  6196 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.747s	user 0.006s	sys 0.009s
I20260709 12:21:26.081099  5810 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.082373  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 837) took 1144 ms. Trace:
I20260709 12:21:26.082798  3998 rpcz_store.cc:276] 0709 12:21:24.937909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.957634 (+ 19725us) service_pool.cc:224] Handling call
0709 12:21:26.082191 (+1124557us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540002f154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:26.082309 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712349056}
I20260709 12:21:26.089684  6103 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.067112  6214 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:26.100472  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.053385  5984 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:21:26.105827  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52151.2us
I20260709 12:21:26.070796  6236 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:26.096580  5966 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.108213  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.108511  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.111006  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.111856  3922 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:26.112282  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.113090  3916 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:26.098235  6115 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:26.113461  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.115962  3920 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:26.116310  3918 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:26.116869  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.117650  3920 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:26.114527  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.114977  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:26.118762  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.071291  6195 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.114346  5966 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.126040  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.127674  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.128075  5966 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.128278  3917 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:26.131879  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.133172  3924 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:26.134446  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.136767  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:26.111162  6194 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:26.144563  6194 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.147327  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.148327  3919 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:26.149299  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.143824  6162 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:26.149900  3919 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:26.150049  6162 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:26.150854  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.157692  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.151420  6162 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.164199  6100 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.135207  3924 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:26.126117  3925 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:26.173365  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.173399  6236 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.174647  6106 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:26.174306  6236 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.175187  6106 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.122773  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.180841  6179 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:26.181418  6179 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:26.182382  6179 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.178804  6203 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.187559  6162 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.154115  6195 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:26.194121  6192 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.824s	user 0.015s	sys 0.000s
I20260709 12:21:26.195937  5563 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:26.196390  5563 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:26.197217  5563 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.198351  5563 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:26.199527  6100 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:21:26.207885  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.213380  4579 pending_rounds.cc:85] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 5
I20260709 12:21:26.213893  4579 pending_rounds.cc:107] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:21:26.214243  4579 raft_consensus.cc:2889] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.197620  6225 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:26.218417  6225 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.220359  3934 tablet_copy_source_session.cc:215] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:26.220758  6081 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:26.224092  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.220795  6193 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.234933  6193 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.236939  6103 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.238636  5961 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:26.239216  5961 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:26.240314  5961 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.242141  5961 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:26.246304  6192 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
I20260709 12:21:26.259333  6217 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.260069  6200 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:26.260413  6106 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.260752  6200 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.261407  6207 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:26.262163  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.262364  3842 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:26.278474  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:26.262596  3849 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:26.280418  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 318347us
W20260709 12:21:26.262619  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 125971us
I20260709 12:21:26.282842  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:26.285135  3849 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:26.268040  6106 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.270089  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.286197  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 110) took 5682 ms. Trace:
I20260709 12:21:26.272316  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:26.273618  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.274317  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.296633  3917 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:26.297576  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:26.276063  3922 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:26.221935  3934 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46046 (request call id 255) took 1007 ms. Trace:
I20260709 12:21:26.173421  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.286665  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:26.287107  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.289253  3842 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:21:26.292470  5521 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:26.299422  3923 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.298604  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:26.299772  5521 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.301921  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.311504  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.315280  3842 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:26.287420  6116 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.316877  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.322388  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.323269  3919 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.323729  3922 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:26.324532  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.324898  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.316370  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.316615  3924 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:26.325982  3922 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:26.317322  5521 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:26.305897  6106 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.319972  3845 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:26.303431  6180 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.363415  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 833) took 1432 ms. Trace:
I20260709 12:21:26.260043  6217 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.290740  6195 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:21:26.314956  6183 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:26.286437  6223 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:26.373113  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.373345  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.375432  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.364013  3994 rpcz_store.cc:276] 0709 12:21:24.930674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.934299 (+  3625us) service_pool.cc:224] Handling call
0709 12:21:24.934682 (+   383us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:24.981607 (+ 46925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.981636 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:24.988681 (+  7045us) log.cc:844] Serialized 78 byte log entry
0709 12:21:25.278726 (+290045us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:25.293842 (+ 15116us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.305729 (+ 11887us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.306149 (+   420us) log.cc:844] Serialized 14 byte log entry
0709 12:21:25.309688 (+  3539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.309772 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.595848 (+286076us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b1800353fe0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc568c758f 00007fdc4f906571 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd
0709 12:21:26.140472 (+544624us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b1800353fe0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:26.193312 (+ 52840us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:26.363075 (+169763us) raft_consensus.cc:1685] finished
0709 12:21:26.363108 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:26.363328 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":277267,"prepare.queue_time_us":914132,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":119,"raft.queue_time_us":39655,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":27102,"spinlock_wait_cycles":275646848,"thread_start_us":241663,"threads_started":1,"wal-append.queue_time_us":343526}
I20260709 12:21:26.348814  6211 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.378355  5521 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:26.396168  5521 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.405130  3919 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:26.406491  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.407946  5521 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:26.414505  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.420357  3919 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:26.382905  3917 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:26.286906  6207 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.355786  6154 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:26.350189  6116 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.368923  6135 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.396147  6150 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.429944  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.362320  6180 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:26.428996  6084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.031s	sys 0.023s
I20260709 12:21:26.493759  3922 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:26.293725  3746 rpcz_store.cc:276] 0709 12:21:20.603386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.603709 (+   323us) service_pool.cc:224] Handling call
0709 12:21:26.286125 (+5682416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:25.551178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:25.551846 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:25.551878 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:21:25.551894 (+    16us) tablet.cc:662] Decoding operations
0709 12:21:25.552606 (+   712us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:25.552665 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:25.552699 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:25.553280 (+   581us) tablet.cc:701] Row locks acquired
0709 12:21:25.553299 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:25.553443 (+   144us) write_op.cc:270] Start()
0709 12:21:25.553572 (+   129us) write_op.cc:276] Timestamp: P: 1783599685553395 usec, L: 0
0709 12:21:25.553591 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:21:25.554223 (+   632us) log.cc:844] Serialized 2054 byte log entry
0709 12:21:25.793606 (+239383us) op_driver.cc:464] REPLICATION: finished
0709 12:21:25.961803 (+168197us) write_op.cc:301] APPLY: starting
0709 12:21:25.961893 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:25.962060 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:25.962201 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:25.962890 (+   689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:25.963143 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:25.963203 (+    60us) write_op.cc:312] APPLY: finished
0709 12:21:25.963466 (+   263us) log.cc:844] Serialized 47 byte log entry
0709 12:21:25.963654 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.963778 (+   124us) write_op.cc:454] Released schema lock
0709 12:21:25.963820 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:25.964210 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:25.964243 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":178372,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":167934,"apply.run_cpu_time_us":2394,"apply.run_wall_time_us":2398,"num_ops":5,"prepare.queue_time_us":527154,"prepare.run_cpu_time_us":3358,"prepare.run_wall_time_us":3359,"replication_time_us":239837,"thread_start_us":438305,"threads_started":2}]]}
I20260709 12:21:26.303398  3934 rpcz_store.cc:276] 0709 12:21:25.238625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.285873 (+ 47248us) service_pool.cc:224] Handling call
0709 12:21:26.219887 (+934014us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540036e7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529fd3f7 00007fdc57993036 00007fdc5799ca3e 00007fdc4f26027b 00007fdc5799c9ba 00007fdc57997acc 00007fdc57992c7b 00007fdc579878d1 00007fdc56a3b4b4 00007fdc56a3b442
0709 12:21:26.221819 (+  1932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180501888}
I20260709 12:21:26.418087  4576 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:26.487146  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.424301  6193 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.430927  6225 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.460760  6194 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:26.499323  3922 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:26.451004  3849 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:26.450412  3923 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:26.509539  3924 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:26.494155  6084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.031s	sys 0.024s
I20260709 12:21:26.533183  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.534261  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:26.536983  3917 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:26.485628  6101 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:26.536144  3925 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:26.541769  3848 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:26.498036  6210 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.570710  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 287925us
I20260709 12:21:26.574532  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:26.578330  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 279789us
W20260709 12:21:26.554620  6213 consensus_meta.cc:287] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.823s	user 0.015s	sys 0.007s
W20260709 12:21:26.585347  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.588572  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.589218  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.591744  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.552281  6225 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.602775  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:26.580363  6228 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:21:26.610024  5521 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:26.569113  6206 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:26.610060  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:26.610723  5521 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.593122  6127 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.586064  6200 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:26.653512  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.564843  6101 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:26.693591  3916 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 12:21:26.694202  3916 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:26.662734  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46356.9us
W20260709 12:21:26.668819  3815 connection.cc:256] RPC call timeout handler was delayed by -1.1685403820001738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 12:21:26.583685  6210 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.644407  6223 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.725948  4580 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:26.700131  5521 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.734830  5521 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:26.735800  5521 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.736792  5521 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:26.698515  4575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.022s	sys 0.044s
I20260709 12:21:26.611169  6225 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.599639  6213 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.698992  6245 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.697257  6211 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:26.754871  4575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.029s	sys 0.053s
I20260709 12:21:26.785451  3844 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:26.617095  6228 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.701424  6127 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:26.792580  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 182591us
I20260709 12:21:26.779232  6106 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:26.776495  6217 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:26.813748  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.814622  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.821235  3964 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.004s	sys 0.013s
W20260709 12:21:26.823681  3964 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.005s	sys 0.013s
I20260709 12:21:26.785742  6116 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.827759  6183 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:26.847839  6183 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:26.826025  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 533399us
I20260709 12:21:26.858016  5521 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.860651  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.803157  6180 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.775535  6223 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.779778  6245 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:26.860821  6213 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.960502  6210 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:26.961094  6267 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:26.961688  6247 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:21:26.961978  6101 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.962036  6210 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:26.962599  6101 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:26.963215  6244 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:21:26.962735  6210 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.807919  6211 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:26.965438  6210 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:26.948258  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.959576  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 242441us
I20260709 12:21:26.939778  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:26.979079  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:26.868907  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53608.5us
I20260709 12:21:26.688651  6206 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:26.969725  3916 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
W20260709 12:21:26.983876  3964 leader_election.cc:336] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.622s (SENT)
W20260709 12:21:26.896833  6103 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.003s
W20260709 12:21:26.836208  5984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.001s	sys 0.010s
I20260709 12:21:26.986219  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:26.988233  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.986869  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 286540us
I20260709 12:21:27.007139  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:26.998845  5521 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.810105  6207 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:26.973856  6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3bacd87db564c3ba5256af726514f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:26.828022  6106 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:26.943182  6154 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.027184  5521 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:26.905078  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:27.056766  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.005017  5984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.006s	sys 0.014s
I20260709 12:21:26.985180  6123 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.063009  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:26.985180  6101 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:27.067890  6275 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.068994  6225 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:26.955623  6203 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:21:27.071945  3925 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:27.074256  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67215us
W20260709 12:21:27.075205  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91351.4us
W20260709 12:21:27.083274  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.083321  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:27.085047  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:26.961720  6267 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.027525  6207 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:27.102687  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:27.016057  6206 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:27.111205  5521 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:27.058458  6100 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.118327  5521 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:27.120252  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.121573  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.122339  3996 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:27.135200  5521 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.136190  5521 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.136816  5521 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.134990  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.141682  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.147964  3848 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:27.109436  5984 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:27.153643  3925 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:27.158020  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.114171  6225 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.032523  6106 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.059403  6154 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.074036  6123 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.139830  6207 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:27.082033  6101 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.132942  6255 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:21:27.152848  6103 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.174672  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:27.100143  6275 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.202072  3925 raft_consensus.cc:2410] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:27.166481  6127 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.164746  6225 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.132709  6100 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.210552  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.170001  5984 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:27.225342  6269 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:21:27.173103  6211 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:27.228957  5521 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.282811  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1772) took 1017 ms. Trace:
I20260709 12:21:27.227691  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:27.178323  6228 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.283258  3924 rpcz_store.cc:276] 0709 12:21:26.265556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.537577 (+272021us) service_pool.cc:224] Handling call
0709 12:21:26.538086 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.538506 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.538545 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.769140 (+230595us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b2c00010c48. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:26.775687 (+  6547us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.894979 (+119292us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:26.895041 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.895148 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.227735 (+332587us) raft_consensus.cc:1685] finished
0709 12:21:27.227762 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.282720 (+ 54958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10660,"raft.queue_time_us":13661,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5903,"spinlock_wait_cycles":9368832,"thread_start_us":97843,"threads_started":1,"wal-append.queue_time_us":443374}
W20260709 12:21:27.279273  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121383us
I20260709 12:21:27.285429  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:27.285650  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.287256  3924 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:27.321695  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:27.326370  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.327167  3924 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:27.220956  6225 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.337827  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:27.241055  6237 raft_consensus.cc:2764] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:21:27.353585  3922 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:27.362401  3922 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:27.368407  3922 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:27.286150  6213 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.333037  6239 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.405s	user 0.000s	sys 0.002s
I20260709 12:21:27.290627  6217 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.388883  6081 consensus_meta.cc:287] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.168s	user 0.009s	sys 0.004s
W20260709 12:21:27.390690  6132 consensus_meta.cc:287] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.388s	user 0.009s	sys 0.006s
I20260709 12:21:27.391222  6132 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:27.392772  6241 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:27.392910  6267 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.381891  6213 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.394908  6284 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 12:21:27.333716  6206 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.395969  6213 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.396129  6100 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:27.397043  6084 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:21:27.398680  5961 consensus_meta.cc:287] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.003s
I20260709 12:21:27.400249  3916 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:27.400640  5936 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.394s	user 0.013s	sys 0.002s
I20260709 12:21:27.401043  5936 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:27.401760  3916 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:21:27.402808  6149 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.333s	user 0.008s	sys 0.007s
I20260709 12:21:27.403223  6149 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.404625  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:27.405453  6149 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.406054  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:27.367269  6256 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.407829  6256 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:27.392944  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.409860  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:27.412179  5563 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.213s	user 0.013s	sys 0.000s
I20260709 12:21:27.413019  5563 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.413601  5563 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:27.413977  5563 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.369477  6272 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:21:27.416093  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 282) took 1151 ms. Trace:
I20260709 12:21:27.385315  6237 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.416661  3841 rpcz_store.cc:276] 0709 12:21:26.265031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.265632 (+   601us) service_pool.cc:224] Handling call
0709 12:21:26.265959 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.486224 (+220265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.486254 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:26.486303 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:26.486346 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.415833 (+929487us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400343fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:27.415879 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.416027 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505985792}
I20260709 12:21:27.417088  6237 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.418794  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.377235  6207 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.419793  6082 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:27.345448  6259 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:27.420877  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:27.421330  6259 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.421775  3841 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:27.423554  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.423888  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 250) took 1808 ms. Trace:
I20260709 12:21:27.424409  4575 rpcz_store.cc:276] 0709 12:21:25.616035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.629864 (+ 13829us) service_pool.cc:224] Handling call
0709 12:21:25.671381 (+ 41517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.686643 (+ 15262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:25.847574 (+160931us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.167282 (+319708us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800431260. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:21:26.789453 (+622171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.900246 (+110793us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.931425 (+ 31179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:26.942406 (+ 10981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.950948 (+  8542us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.423522 (+472574us) raft_consensus.cc:1685] finished
0709 12:21:27.423655 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.423802 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168622,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":26462,"raft.queue_time_us":177513,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":302,"spinlock_wait_cycles":3272448,"thread_start_us":688721,"threads_started":2,"wal-append.queue_time_us":1347576}
I20260709 12:21:27.426540  6103 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.427196  6103 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.428686  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.429812  6268 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:27.430347  6268 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:27.435088  6272 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:27.435556  6272 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:27.416034  3921 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:27.437446  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:27.417650  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1640) took 1127 ms. Trace:
I20260709 12:21:27.464735  3925 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:27.445359  3844 rpcz_store.cc:276] 0709 12:21:26.290554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.292483 (+  1929us) service_pool.cc:224] Handling call
0709 12:21:27.417368 (+1124885us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002ab054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:27.417484 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065923840}
I20260709 12:21:27.451526  3916 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:27.464735  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:27.399286  5961 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.493845  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:27.375180  6194 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:27.526727  3814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.507s (SENT) [suppressed 39 similar messages]
I20260709 12:21:27.535391  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:27.536145  3841 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.545177  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:27.493044  5767 consensus_meta.cc:287] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.485s	user 0.013s	sys 0.017s
I20260709 12:21:27.563304  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.564155  3842 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:27.565121  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.478188  6100 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.493813  5936 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.588768  5936 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.591491  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1766) took 1327 ms. Trace:
I20260709 12:21:27.441083  6294 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:27.592257  6101 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.591184  5936 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.442859  6217 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.523916  6103 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:27.378664  5984 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.598724  6162 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.410s	user 0.007s	sys 0.005s
I20260709 12:21:27.591907  3918 rpcz_store.cc:276] 0709 12:21:26.264043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.469208 (+205165us) service_pool.cc:224] Handling call
0709 12:21:26.469612 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.533901 (+ 64289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.533951 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.539188 (+  5237us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.916002 (+376814us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:26.916066 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.916172 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.591236 (+675064us) raft_consensus.cc:1685] finished
0709 12:21:27.591261 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.591407 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38412,"raft.queue_time_us":30457,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":35211,"thread_start_us":308268,"threads_started":1,"wal-append.queue_time_us":1003924}
I20260709 12:21:27.602391  6217 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:27.606174  6278 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:27.534476  6245 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.500478  6194 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:27.607667  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1644) took 1231 ms. Trace:
I20260709 12:21:27.608403  6194 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.608021  3850 rpcz_store.cc:276] 0709 12:21:26.375937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.376092 (+   155us) service_pool.cc:224] Handling call
0709 12:21:26.376451 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.596570 (+220119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.596624 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.597312 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.033461 (+436149us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:27.033511 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.033598 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.607400 (+573802us) raft_consensus.cc:1685] finished
0709 12:21:27.607429 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.607601 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26581,"raft.queue_time_us":162537,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11486,"thread_start_us":577759,"threads_started":2,"wal-append.queue_time_us":770074}
I20260709 12:21:27.609846  6194 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.609354  5563 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.609987  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.531738  6211 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.611423  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.611696  6211 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.612089  6211 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.612317  5563 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.616147  6237 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:27.617200  6154 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.618582  6275 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.436544  6272 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.620146  6272 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.631731  6100 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.634682  6100 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:27.575127  3843 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:27.586292  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.533821  5961 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.588160  6273 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:21:27.588016  6223 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:27.660051  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.661892  6245 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.662545  6245 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.431209  6268 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.665683  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:27.673575  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 388052us
I20260709 12:21:27.674701  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.676772  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.687345  3841 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:27.690732  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:27.648598  6081 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.695000  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:27.644948  6243 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:27.697963  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.698962  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:27.704063  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.709282  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1495) took 1592 ms. Trace:
I20260709 12:21:27.694200  6277 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:27.739099  3990 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:27.739385  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:27.734277  6154 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:27.740711  6282 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:21:27.740281  3996 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:27.741011  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.740816  6154 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.725637  6243 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.741992  3992 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:27.748147  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.698808  6237 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:27.735936  6273 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:21:27.752523  6101 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:27.734620  6259 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.760828  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.761760  3993 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.687973  6223 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:27.716252  5993 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.765s	user 0.019s	sys 0.010s
I20260709 12:21:27.709830  3920 rpcz_store.cc:276] 0709 12:21:26.116744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.159162 (+ 42418us) service_pool.cc:224] Handling call
0709 12:21:26.314405 (+155243us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800101a98. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:26.314580 (+   175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.317961 (+  3381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.318023 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.318539 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.564092 (+245553us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:26.790791 (+226699us) log.cc:844] Serialized 14 byte log entry
0709 12:21:26.801156 (+ 10365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.801258 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.685801 (+884543us) raft_consensus.cc:1685] finished
0709 12:21:27.708955 (+ 23154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.709182 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33875,"prepare.queue_time_us":287789,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":14552,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":42815,"spinlock_wait_cycles":44927360,"thread_start_us":440691,"threads_started":2,"wal-append.queue_time_us":1274859}
I20260709 12:21:27.715840  6081 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.727247  6189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.029s
I20260709 12:21:27.757705  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.772946  3998 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.715619  6103 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:27.760895  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.749125  3991 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:27.691637  6100 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:21:27.768572  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.752033  6123 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.776137  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.798241  3995 raft_consensus.cc:2410] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:27.724150  6106 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:27.788794  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.776047  6223 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:27.789418  3990 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:27.759903  6237 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:27.792899  3999 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.807555  3991 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:27.808018  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.767473  6132 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.770601  6101 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:27.812867  6132 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.814040  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 892) took 1538 ms. Trace:
I20260709 12:21:27.813678  6101 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.814452  3849 rpcz_store.cc:276] 0709 12:21:26.276051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.280286 (+  4235us) service_pool.cc:224] Handling call
0709 12:21:26.280527 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:26.505024 (+224497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.813756 (+1308732us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b540011a3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:27.813970 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10286848}
I20260709 12:21:27.795356  5961 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.796370  6245 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.779122  6103 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:27.773011  6189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.007s	sys 0.029s
I20260709 12:21:27.821821  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.816972  3995 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:27.802567  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.820595  3990 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:27.819970  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:27.805014  6299 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:27.831210  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.832180  3996 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:21:27.816756  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 290272us
I20260709 12:21:27.809621  6237 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.830844  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.834688  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.834918  3995 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.821781  6103 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.876150  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:27.824074  6243 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.947600  3990 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.948486  3995 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:27.950294  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.958565  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.959384  3995 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:27.887138  3998 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:27.889810  3993 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:27.876149  6296 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.877480  5961 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.979900  5961 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.964311  6211 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.982776  6211 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.894963  3999 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:27.879164  6132 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.881222  6189 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:27.882519  6223 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.899456  6251 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:27.907850  5984 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:27.912002  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1777) took 1315 ms. Trace:
I20260709 12:21:27.836499  6299 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:27.993198  3924 rpcz_store.cc:276] 0709 12:21:26.596838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.343491 (+746653us) service_pool.cc:224] Handling call
0709 12:21:27.343927 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:27.344403 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.344441 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:27.374167 (+ 29726us) log.cc:844] Serialized 52 byte log entry
0709 12:21:27.806857 (+432690us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:27.806898 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.806967 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.911699 (+104732us) raft_consensus.cc:1685] finished
0709 12:21:27.911729 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.911922 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":745,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":14556,"thread_start_us":390455,"threads_started":1,"wal-append.queue_time_us":472052}
I20260709 12:21:27.994650  6236 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.995564  6299 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.995199  6251 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:27.996699  6252 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.053s	user 0.001s	sys 0.001s
I20260709 12:21:27.996321  5984 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.997625  6251 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:27.888653  6292 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 12:21:27.998061  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 885) took 1724 ms. Trace:
I20260709 12:21:27.998603  5984 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.912822  3997 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:27.913221  6295 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:27.913513  6217 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.003240  6217 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.005407  6169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35184 (request call id 242) took 3559 ms. Trace:
I20260709 12:21:27.998487  3846 rpcz_store.cc:276] 0709 12:21:26.273357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.273468 (+   111us) service_pool.cc:224] Handling call
0709 12:21:26.273832 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:26.281363 (+  7531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.281392 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:26.289337 (+  7945us) log.cc:844] Serialized 26 byte log entry
0709 12:21:26.577809 (+288472us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:26.577866 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.577958 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:27.996019 (+1418061us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:27.997741 (+  1722us) raft_consensus.cc:1685] finished
0709 12:21:27.997763 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:27.997995 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17332,"raft.queue_time_us":10365,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1975,"spinlock_wait_cycles":112277376,"thread_start_us":229149,"threads_started":1,"wal-append.queue_time_us":521548}
I20260709 12:21:28.006289  6217 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:27.921576  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.007277  5961 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:27.984367  6296 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:27.929307  6225 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.003s
I20260709 12:21:27.836171  3996 raft_consensus.cc:2410] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:21:27.966692  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 89322.2us
W20260709 12:21:27.968489  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.976564  3990 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:28.014777  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.988313  3844 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:28.017390  3999 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.018573  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.019378  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.026342  6225 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:27.988989  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.982797  6203 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:27.992199  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:27.984318  5936 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:28.010265  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:27.991640  6189 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.029603  3996 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:28.061784  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.209055  3995 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:28.200258  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1652) took 1216 ms. Trace:
I20260709 12:21:28.034473  3993 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:28.212035  3850 rpcz_store.cc:276] 0709 12:21:26.983508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.613358 (+629850us) service_pool.cc:224] Handling call
0709 12:21:27.613647 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.663867 (+ 50220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:27.664240 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 12:21:27.881814 (+217574us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:27.883082 (+  1268us) log.cc:844] Serialized 26 byte log entry
0709 12:21:27.883279 (+   197us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:27.883330 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:27.883431 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.199923 (+316492us) raft_consensus.cc:1685] finished
0709 12:21:28.199953 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.200166 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73646,"prepare.queue_time_us":7745,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":55762,"raft.run_wall_time_us":6654,"spinlock_wait_cycles":23177728,"thread_start_us":212699,"threads_started":1,"wal-append.queue_time_us":219297}
I20260709 12:21:28.188858  6101 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.066069  6236 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:28.214577  6236 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.214437  6101 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.216884  6236 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:28.217694  5936 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.189152  6213 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:28.218310  6225 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.219077  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.219558  6203 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:28.220101  3998 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:28.221004  3995 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:28.221302  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:28.224043  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.223440  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.249267  3849 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:28.250020  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:28.235975  3889 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.116s (SENT)
I20260709 12:21:28.250597  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.250849  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:28.238426  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 228295us
I20260709 12:21:28.250196  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.253226  3849 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:28.252843  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:28.229965  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.006022  6169 rpcz_store.cc:276] 0709 12:21:24.445794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.445980 (+   186us) service_pool.cc:224] Handling call
0709 12:21:24.660371 (+214391us) ts_tablet_manager.cc:934] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
0709 12:21:26.971598 (+2311227us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:21:27.744188 (+772590us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:27.744351 (+   163us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:21:28.004379 (+260028us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:21:28.004874 (+   495us) tablet_replica.cc:206] Creating consensus instance
0709 12:21:28.005215 (+   341us) ts_tablet_manager.cc:989] Replica registered.
0709 12:21:28.005286 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":59317,"tablet-copy.queue_time_us":213384,"thread_start_us":309851,"threads_started":2}
I20260709 12:21:28.257685  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:28.259209  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.261283  6309 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:21:28.262403  5936 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:28.252182  6213 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.265519  6213 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:28.266454  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.237730  6292 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.268026  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:28.268280  6292 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.269661  3990 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.270794  6292 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.273788  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:28.276266  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:28.246739  6236 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:28.285120  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.291764  6256 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:28.291903  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.292855  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 309) took 1175 ms. Trace:
I20260709 12:21:28.293267  4579 rpcz_store.cc:276] 0709 12:21:27.117538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.291539 (+1174001us) service_pool.cc:224] Handling call
0709 12:21:28.292770 (+  1231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.294307  6162 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.294869  6162 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.287901  6100 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:28.271719  6169 tablet_copy_client.cc:806] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:28.300608  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.304503  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:28.304514  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.308524  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.302671  6169 tablet_copy_client.cc:670] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:28.302680  6162 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:28.061498  6237 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.318359  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.336870  3923 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:28.318992  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:28.337908  3916 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.318497  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.319659  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.320582  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.298899  6292 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:28.363751  6292 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:28.279837  6149 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:28.364158  6189 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:28.365733  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.365959  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.366912  3924 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:28.368040  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.369127  3925 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:28.358398  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1483) took 2223 ms (client timeout 1981 ms). Trace:
I20260709 12:21:28.359035  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:28.359198  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.360846  6106 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.362715  6296 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.376865  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.402906  3849 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:28.383195  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.404976  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:28.390329  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:28.406436  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:28.373585  3921 rpcz_store.cc:269] 0709 12:21:26.112771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.122411 (+  9640us) service_pool.cc:224] Handling call
0709 12:21:28.336138 (+2213727us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540024de54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:28.336279 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788675840}
I20260709 12:21:28.267354  6103 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.408152  3918 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:28.407303  3919 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:28.409915  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.410384  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.414633  3919 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:28.415249  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.415870  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.416255  3924 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:28.417546  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.418429  3924 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:28.419847  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.420691  3921 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:28.410739  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.424784  3992 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:28.416917  3919 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:28.364208  6292 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.436007  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.402194  6106 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.436915  6106 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.437600  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.440186  3991 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:28.271099  6203 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.408937  5767 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.445340  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.451508  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.458796  3916 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:28.402784  6217 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:21:28.403275  6236 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:21:28.408093  6194 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:21:28.408260  6189 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 12:21:28.470659  6250 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.542s	user 0.000s	sys 0.016s
I20260709 12:21:28.458683  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.454655  5767 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:28.475807  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:28.511595  3998 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:28.481480  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.512408  3996 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:28.473814  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:28.509110  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 256973us
I20260709 12:21:28.533118  3999 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:28.536630  3998 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:21:28.537073  3998 pending_rounds.cc:85] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 7
I20260709 12:21:28.537314  3998 pending_rounds.cc:107] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:21:28.537559  3998 raft_consensus.cc:2889] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:28.513820  3991 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:28.539700  3996 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:21:28.540211  3996 pending_rounds.cc:85] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:21:28.540494  3996 pending_rounds.cc:107] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:28.540781  3996 raft_consensus.cc:2889] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:28.544078  3996 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.545838  3996 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:28.549168  3991 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:28.551492  3998 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:21:28.552953  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 305140us
I20260709 12:21:28.555495  3999 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:28.535244  5767 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.550938  6100 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:28.581591  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 219431us
I20260709 12:21:28.575412  5436 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:28.577198  6135 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.701242  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:28.701143  6135 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.702159  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.703789  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.704023  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.705447  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.705544  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.706138  4574 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:28.706238  4582 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:28.707307  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:28.694725  6314 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:21:28.707947  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.700086  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.708586  3849 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:28.580914  6213 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:28.708422  6100 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.709486  6213 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.694610  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.710475  6237 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.707756  6268 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.711673  6268 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.712292  6213 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:28.713289  6135 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:28.714389  6268 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.716147  4578 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:28.719230  6292 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.721611  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 886) took 2448 ms. Trace:
I20260709 12:21:28.724124  3847 rpcz_store.cc:276] 0709 12:21:26.273660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.273792 (+   132us) service_pool.cc:224] Handling call
0709 12:21:26.274153 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:26.281496 (+  7343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:26.281528 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:26.287384 (+  5856us) log.cc:844] Serialized 52 byte log entry
0709 12:21:26.611890 (+324506us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:26.611930 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:26.612000 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.469980 (+1857980us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:28.721176 (+251196us) raft_consensus.cc:1685] finished
0709 12:21:28.721212 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.721528 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15803,"raft.queue_time_us":13141,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7169,"spinlock_wait_cycles":103821696,"thread_start_us":285203,"threads_started":1,"wal-append.queue_time_us":491459}
I20260709 12:21:28.700942  5436 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:28.698765  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.736433  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:28.723272  4583 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:28.713217  6237 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:28.720521  6106 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:28.756158  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 451673us
W20260709 12:21:28.769431  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.760288  6237 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.762128  5767 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:28.820839  4548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.022s	sys 0.015s
W20260709 12:21:28.821650  4548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.022s	sys 0.015s
W20260709 12:21:28.822101  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 511508us
I20260709 12:21:28.823951  3922 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:28.824900  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1797) took 1447 ms. Trace:
I20260709 12:21:28.825328  3922 rpcz_store.cc:276] 0709 12:21:27.377319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.823026 (+1445707us) service_pool.cc:224] Handling call
0709 12:21:28.823498 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.824579 (+  1081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.824827 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:28.827775  5436 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:28.828258  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 392339us
I20260709 12:21:28.832366  3916 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:28.833559  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:28.833827  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.834435  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.834784  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.835094  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:28.836956  3850 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:28.841223  6135 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:28.844228  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:28.812832  6103 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.853636  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:28.854336  3850 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:28.849143  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.848060  6213 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:28.859910  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.862346  6217 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:28.859536  6323 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.858114  6315 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:28.864187  6225 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:28.866451  6132 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:28.870767  6324 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.876101  6292 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.894294  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.918838  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:28.919431  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50326.9us
I20260709 12:21:28.920220  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.881552  6315 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.920912  6169 tablet_copy_client.cc:538] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:28.901746  6106 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.883788  6225 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:28.919744  6318 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:21:28.929739  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.881346  6323 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.931005  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:28.934334  6320 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:21:28.916333  6331 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.893031  6328 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:21:28.902127  6329 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:28.946383  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:28.959167  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:28.938052  6321 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 12:21:28.896348  6324 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:28.966588  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.967371  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.967933  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.968196  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.967777  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.923282  6334 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.969326  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.969664  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:28.931478  6296 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:28.929888  6327 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:28.959811  6331 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:28.970690  3998 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:28.938052  6332 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:28.981621  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:28.971607  6334 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.944873  5767 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:28.959056  6237 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:28.938716  6217 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:21:28.971820  6292 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:28.997494  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:29.002852  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43818.5us
I20260709 12:21:29.003723  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.002437  3990 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:29.001341  3991 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:28.978417  6296 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:29.015357  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:28.991889  6334 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.996490  6100 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:29.015699  6292 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:29.027418  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:29.014000  6296 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.019037  3990 raft_consensus.cc:2376] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:21:29.010118  6342 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.000259  6206 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:21:29.036803  6336 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:21:29.037140  6333 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:21:29.028193  6317 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:21:28.986383  6327 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.040940  6202 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:21:29.040700  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.044392  6206 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:29.044685  6202 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:29.044822  6206 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:29.045001  6331 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:29.045219  6202 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:29.045436  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.044396  6213 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.041549  3814 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:29.031132  6329 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.051542  6225 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:29.051640  6256 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:29.053335  6256 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:29.053473  6292 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.054487  6194 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.054952  6194 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.055311  6194 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.057850  6315 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.058537  6315 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:29.058900  6315 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.058925  6084 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:29.059353  6315 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.059499  6084 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:29.060038  6206 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.060391  6084 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.061340  6206 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.061975  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1846) took 1176 ms. Trace:
I20260709 12:21:29.062419  3993 rpcz_store.cc:276] 0709 12:21:27.885047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.987552 (+102505us) service_pool.cc:224] Handling call
0709 12:21:28.033887 (+ 46335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.212993 (+179106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.061742 (+848749us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54003b56d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:29.061899 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93784832}
I20260709 12:21:29.063812  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.064391  6323 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:29.065949  3843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 1646) took 2580 ms (client timeout 2150 ms). Trace:
W20260709 12:21:29.066375  3843 rpcz_store.cc:269] 0709 12:21:26.485287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.486856 (+  1569us) service_pool.cc:224] Handling call
0709 12:21:29.065767 (+2578911us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002aab54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:29.065875 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474369920}
I20260709 12:21:29.069985  6329 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.070555  6329 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.073975  6132 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.077395  6194 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.053519  6081 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:29.086184  6338 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:21:29.096838  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.082379  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.040896  5767 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:29.102118  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 98486us
I20260709 12:21:29.102010  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.104602  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.110177  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:29.110719  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.111968  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.115943  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.103714  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.119366  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.086900  6200 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:29.047495  6189 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:21:29.126237  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:29.112123  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:29.126916  3993 raft_consensus.cc:2376] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5. Re-sending same reply.
I20260709 12:21:29.127765  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:29.128377  3993 raft_consensus.cc:2376] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7. Re-sending same reply.
I20260709 12:21:29.127820  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:29.100592  5767 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.046124  6202 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.074004  6296 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.046128  3990 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
W20260709 12:21:29.131331  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 81238.7us
I20260709 12:21:29.132920  6350 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.103855  6132 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.133931  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.103569  6322 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:29.131274  6243 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:29.137552  5767 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.136355  6324 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:29.152557  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.158147  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:29.158757  3993 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:29.144459  6223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.028s	sys 0.057s
I20260709 12:21:29.128894  6200 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.150677  6243 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.150255  6357 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.151654  6202 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.154419  6149 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:29.164424  6223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.028s	sys 0.058s
I20260709 12:21:29.175233  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.179180  3993 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:29.150059  6081 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:21:29.152552  6217 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:29.150017  6132 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.153474  6082 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:21:29.174695  6243 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.200085  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:29.204064  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54462.8us
I20260709 12:21:29.191205  6351 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:29.155843  6350 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:29.215011  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 84275.5us
I20260709 12:21:29.185999  6189 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:21:29.203624  6217 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:29.216110  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:29.219785  6339 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:21:29.221278  6302 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:29.222692  6343 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:21:29.222983  6302 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.223567  6352 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:21:29.209901  6348 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:29.214249  6327 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.181802  6357 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.233103  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 897) took 2566 ms. Trace:
I20260709 12:21:29.223385  6302 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.236891  6296 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:29.238490  6349 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:29.239233  6341 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:21:29.220659  6194 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.221433  6351 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.249624  3848 rpcz_store.cc:276] 0709 12:21:26.667030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.667204 (+   174us) service_pool.cc:224] Handling call
0709 12:21:26.667600 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:27.152350 (+484750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.232878 (+2080528us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400407254. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:29.233051 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104087808}
W20260709 12:21:29.252518  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 77355us
I20260709 12:21:29.230247  6329 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.262603  6349 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.257354  6334 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.259481  6350 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.235993  6360 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.257692  6200 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.284196  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.251538  6154 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.308784  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:29.313750  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 86718.5us
W20260709 12:21:29.316737  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 182077us
I20260709 12:21:29.319032  3999 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:29.319882  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:29.320562  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.320583  3993 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:29.294641  6349 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:29.325225  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.332774  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 185) took 2248 ms. Trace:
I20260709 12:21:29.333262  3994 rpcz_store.cc:276] 0709 12:21:27.084170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.085876 (+  1706us) service_pool.cc:224] Handling call
0709 12:21:27.086241 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:27.332344 (+246103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:27.332395 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:27.332460 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:27.332514 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.332545 (+2000031us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001987d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:29.332594 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.332712 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336851840}
I20260709 12:21:29.337527  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.341907  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.343470  3841 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:29.305791  6296 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:29.344939  3849 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:29.344880  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.345623  3850 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.343185  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.347570  3841 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:29.318640  6217 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.348591  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:29.348621  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.351058  3846 raft_consensus.cc:2410] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:29.318517  6329 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.319593  6350 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:29.348244  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.313050  6360 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:29.355583  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:29.360733  4581 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:29.357571  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.354804  6363 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:29.358887  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.296805  6356 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.188s
I20260709 12:21:29.360944  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.366966  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.250501  6348 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:29.369808  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.358250  6347 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.393406  6302 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.396147  6315 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.398427  6315 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.399014  6363 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:29.371491  6101 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:29.371884  6334 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:29.363194  6360 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.364610  6351 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.377697  6332 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.366189  6350 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:29.385205  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:29.416632  3924 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:29.387202  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:29.417912  3925 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:29.388974  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.390938  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:29.391875  6340 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 12:21:29.422575  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:29.422812  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:29.423243  3921 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.423839  3922 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:29.424799  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:29.361615  6132 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.392534  6243 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.402870  3916 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:29.404794  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:29.408416  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.431032  3919 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.431923  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.410831  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 857) took 1608 ms. Trace:
I20260709 12:21:29.432684  3997 rpcz_store.cc:276] 0709 12:21:27.802477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.802657 (+   180us) service_pool.cc:224] Handling call
0709 12:21:29.410663 (+1608006us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002f9ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:29.410772 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239050496}
I20260709 12:21:29.363649  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:29.413060  6351 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.358146  6296 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.379428  6100 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:29.428889  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:29.428313  3996 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
W20260709 12:21:29.442971  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.379535  6223 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:21:29.412611  6101 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.447165  3850 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:29.450608  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:29.400104  6363 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:29.490468  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58611.5us
I20260709 12:21:29.488305  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1848) took 1602 ms. Trace:
I20260709 12:21:29.476573  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:29.452070  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.499782  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:29.492419  3921 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:29.555168  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:29.564064  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.564841  3850 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.557101  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:29.556605  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 351603us
I20260709 12:21:29.565433  3916 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:29.413853  6135 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.555685  3992 rpcz_store.cc:276] 0709 12:21:27.885462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.991314 (+105852us) service_pool.cc:224] Handling call
0709 12:21:27.991773 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.433552 (+441779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.487912 (+1054360us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400350054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:29.488208 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995297152}
I20260709 12:21:29.547379  3919 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:29.556301  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.559469  3842 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:29.573771  3921 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:29.415639  6347 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:29.558573  3922 raft_consensus.cc:2376] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4. Re-sending same reply.
I20260709 12:21:29.605528  5521 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:29.571026  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:29.611182  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.446717  6332 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.455165  6351 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:29.620226  6101 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.620862  6100 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.621066  6256 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.427546  6325 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
I20260709 12:21:29.622198  6081 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.623189  6225 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.624851  6243 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.638685  6362 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.483088  6106 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.597396  6210 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:21:29.446946  6302 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.632342  3962 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:29.548009  6169 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:21:29.640903  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 270332us
I20260709 12:21:29.746433  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:29.641760  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 441741us
I20260709 12:21:29.747993  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.645740  3925 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:29.482947  6103 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.620666  6347 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.769183  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:29.769551  6315 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:29.651183  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:29.477833  6292 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 12:21:29.770732  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:29.652824  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.653332  4578 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:29.660218  3850 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:29.665544  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:29.713939  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.784848  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.785491  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.754040  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:29.758023  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 201756us
I20260709 12:21:29.787164  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:29.649878  6360 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:29.653512  6256 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.662873  6081 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.637778  6350 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:29.891383  6315 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.742921  6106 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:30.529484  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 783106us
I20260709 12:21:30.719184  6106 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:30.531431  6382 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:21:30.529603  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 775625us
I20260709 12:21:30.722128  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1693) took 1271 ms. Trace:
I20260709 12:21:30.722258  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.722685  3849 rpcz_store.cc:276] 0709 12:21:29.450926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.451107 (+   181us) service_pool.cc:224] Handling call
0709 12:21:29.451430 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:29.451692 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.451727 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:29.452207 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:21:29.664788 (+212581us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:29.664844 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.664972 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.721860 (+1056888us) raft_consensus.cc:1685] finished
0709 12:21:30.721887 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.722044 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":155470,"threads_started":1,"wal-append.queue_time_us":564288}
W20260709 12:21:29.815536  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 223766us
I20260709 12:21:30.724273  6256 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:30.530385  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.913802  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 157501us
I20260709 12:21:29.927981  6135 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:30.363901  6296 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.730129  6135 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.730803  6135 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:30.654147  5767 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.492s	user 0.012s	sys 0.003s
I20260709 12:21:30.732141  4577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 263) took 2037 ms. Trace:
I20260709 12:21:30.732209  5767 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.732776  4577 rpcz_store.cc:276] 0709 12:21:28.694597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.699117 (+  4520us) service_pool.cc:224] Handling call
0709 12:21:28.699487 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.771948 (+ 72461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.773452 (+  1504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:28.775167 (+  1715us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:28.787724 (+ 12557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.731728 (+1944004us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b5400452254. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:30.731789 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.731942 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139381632}
I20260709 12:21:30.727722  6391 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:30.734328  3842 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:29.664330  6225 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.736213  5767 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:30.727406  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.737159  6225 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.740819  6360 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.742568  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:30.743561  6380 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:30.744107  6380 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.744623  6380 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:30.492199  6375 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:30.057883  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.884315  6362 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:30.747885  6362 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.749758  6391 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.753763  6391 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.752017  6081 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:29.928432  6377 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.756172  6377 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.758594  6380 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:29.797848  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.761030  3844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 898) took 3688 ms (client timeout 3761 ms). Trace:
W20260709 12:21:30.761540  3844 rpcz_store.cc:269] 0709 12:21:27.072535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.576670 (+504135us) service_pool.cc:224] Handling call
0709 12:21:30.760822 (+3184152us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54002ab054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.760958 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725677824}
W20260709 12:21:30.008725  6376 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 12:21:30.765810  6324 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:30.766338  6324 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:30.767534  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 874) took 1398 ms. Trace:
I20260709 12:21:30.768011  3991 rpcz_store.cc:276] 0709 12:21:29.369166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.369294 (+   128us) service_pool.cc:224] Handling call
0709 12:21:29.369628 (+   334us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:29.370027 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.370057 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:29.371263 (+  1206us) log.cc:844] Serialized 78 byte log entry
0709 12:21:29.452155 (+ 80892us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:29.490136 (+ 37981us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.496052 (+  5916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.496190 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:30.767081 (+1270891us) raft_consensus.cc:1685] finished
0709 12:21:30.767149 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.767315 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6220,"prepare.queue_time_us":37751,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":15627,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":48861,"thread_start_us":80376,"threads_started":1,"wal-append.queue_time_us":243603}
I20260709 12:21:30.769670  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.769834  6084 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.771754  6286 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:30.773512  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:30.774868  3922 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.776208  6391 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.775620  6324 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.759487  6377 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.777422  6324 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.780036  6342 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:30.780917  6342 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:30.781880  6342 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.798247  6380 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.798543  6342 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:30.756875  3995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 194) took 1789 ms (client timeout 1616 ms). Trace:
I20260709 12:21:30.784538  6286 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.785586  3922 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:30.801100  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.800943  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:30.802615  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.802950  6391 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.803584  6391 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:30.793215  6349 consensus_meta.cc:287] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.452s	user 0.010s	sys 0.004s
I20260709 12:21:30.804895  6347 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.786579  3918 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:30.805723  6391 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.806342  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.807104  3918 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:30.808075  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.808840  3918 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:30.804922  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 268) took 2614 ms. Trace:
I20260709 12:21:30.773816  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:30.799371  3995 rpcz_store.cc:269] 0709 12:21:28.967623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.967717 (+    94us) service_pool.cc:224] Handling call
0709 12:21:30.756590 (+1788873us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540002ec54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.756786 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423833856}
I20260709 12:21:30.810410  6135 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.810894  6154 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:30.809432  3920 rpcz_store.cc:276] 0709 12:21:28.190593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.190745 (+   152us) service_pool.cc:224] Handling call
0709 12:21:28.191088 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.267984 (+ 76896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.268021 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:28.268072 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:28.268111 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.804649 (+2536538us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b540036fbd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:30.804721 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.804851 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176345984}
I20260709 12:21:30.788092  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1770) took 4523 ms. Trace:
I20260709 12:21:30.788486  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:30.812819  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 1.18045e+06us
I20260709 12:21:30.813058  3916 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:30.813994  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:30.814538  3916 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.790585  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:30.812047  6101 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:30.815912  3924 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:30.816308  6103 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.816471  6101 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.816916  6103 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.817530  3923 rpcz_store.cc:276] 0709 12:21:26.265065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.508590 (+243525us) service_pool.cc:224] Handling call
0709 12:21:28.336622 (+1828032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.337417 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.787627 (+2450210us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540024de50. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.787960 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4091571584}
I20260709 12:21:30.798702  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 300) took 1162 ms. Trace:
I20260709 12:21:30.827652  6292 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:30.827806  3842 rpcz_store.cc:276] 0709 12:21:29.636795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.636939 (+   144us) service_pool.cc:224] Handling call
0709 12:21:30.798447 (+1161508us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400343ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.798622 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215902976}
I20260709 12:21:30.755497  6328 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.828258  6292 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.829070  6328 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.830478  6292 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:30.819396  6103 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:30.833439  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:30.834326  3842 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.804709  6349 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.835347  3919 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:30.837056  6349 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.838838  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:30.715788  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.005s	sys 0.005s
I20260709 12:21:30.811609  6154 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:30.840605  6154 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:30.820083  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.843699  3917 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:30.816799  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.844751  3924 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:30.845533  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.846093  3924 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:30.821523  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.03438e+06us
I20260709 12:21:30.799682  6286 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.847987  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.849267  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.850397  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.822700  6325 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:30.852448  6135 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.793187  6207 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:30.827157  5521 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.814558  6323 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:30.853653  6323 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:30.853430  5521 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.854171  6323 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:30.856170  5521 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.856860  5521 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:30.857247  5521 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.857617  5521 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.831187  6328 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:30.796602  4547 connection.cc:256] RPC call timeout handler was delayed by -1.3660284979996504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:21:30.860185  4547 connection.cc:256] RPC call timeout handler was delayed by -1.3093284979995587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 12:21:30.834076  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:30.860611  4547 connection.cc:256] RPC call timeout handler was delayed by -1.2715284979994976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 12:21:30.847245  3923 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:30.861356  4583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 359) took 1507 ms (client timeout 1587 ms). Trace:
I20260709 12:21:30.861992  6378 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:30.861879  4583 rpcz_store.cc:269] 0709 12:21:29.353991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.354147 (+   156us) service_pool.cc:224] Handling call
0709 12:21:30.833897 (+1479750us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:21:30.861231 (+ 27334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9419136}
I20260709 12:21:30.852561  6325 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:30.862838  6378 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.863209  6325 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.863564  4574 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:30.863826  6325 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.866254  6103 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:30.866736  6103 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.867130  6103 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.870256  6378 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.859552  6207 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:30.870710  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:30.871750  6207 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.872219  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.872915  6207 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.873294  6101 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:30.874358  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.809762  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:30.888872  3918 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:30.890790  3922 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:30.874637  6101 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:30.893034  6101 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:30.893533  6101 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:30.006853  6373 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.341s	user 0.000s	sys 0.000s
W20260709 12:21:30.883672  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.006s	sys 0.005s
W20260709 12:21:30.896311  3815 connection.cc:256] RPC call timeout handler was delayed by -1.2390779749998728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 12:21:30.896380  6236 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:30.897133  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:29.867282  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:30.895114  5521 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.897406  3916 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:30.898290  4575 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:30.904031  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 315) took 1244 ms. Trace:
I20260709 12:21:30.904786  4578 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:30.905577  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 318) took 1160 ms. Trace:
I20260709 12:21:30.906144  4578 rpcz_store.cc:276] 0709 12:21:29.744779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.865345 (+120566us) service_pool.cc:224] Handling call
0709 12:21:30.904170 (+1038825us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:30.904399 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.905279 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.905509 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4216192}
I20260709 12:21:30.907207  5521 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.909641  3842 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:30.910277  6381 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.510s	user 0.001s	sys 0.006s
I20260709 12:21:30.911281  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:30.799352  6253 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:30.912563  6253 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:30.913570  6253 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.914578  6253 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.915899  6154 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:30.916656  6154 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:30.917572  6154 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:30.919924  4581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.510s	user 0.004s	sys 0.008s
W20260709 12:21:30.920295  4581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.004s	sys 0.008s
I20260709 12:21:30.919641  3745 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:30.920866  6243 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:30.921471  6243 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.922094  3745 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:30.897150  6236 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.925987  6243 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.926838  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:30.931689  4579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.572s	user 0.004s	sys 0.008s
W20260709 12:21:30.932148  4579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.004s	sys 0.009s
I20260709 12:21:30.933288  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 258) took 2353 ms. Trace:
I20260709 12:21:30.935189  6236 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:30.938302  6357 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:30.944839  3996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 196) took 1976 ms (client timeout 1582 ms). Trace:
W20260709 12:21:30.945429  3996 rpcz_store.cc:269] 0709 12:21:28.968125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.969414 (+  1289us) service_pool.cc:224] Handling call
0709 12:21:30.944639 (+1975225us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001991d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.944752 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048834816}
I20260709 12:21:30.745631  6375 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.950397  6375 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:30.950551  6286 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.952764  4576 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:30.957180  6203 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:30.961283  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 195) took 1993 ms (client timeout 1658 ms). Trace:
I20260709 12:21:30.961964  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:30.963824  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:30.961992  6390 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:21:30.964686  6390 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:30.965070  6390 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:30.966084  6390 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:30.968601  6390 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:30.961779  3998 rpcz_store.cc:269] 0709 12:21:28.967874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.967980 (+   106us) service_pool.cc:224] Handling call
0709 12:21:30.961034 (+1993054us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b540002f154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:30.961183 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4276480}
I20260709 12:21:30.724277  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.972653  6123 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:30.972886  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 248615us
I20260709 12:21:30.974336  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.975291  6123 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:30.811009  6347 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.977695  6364 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.977957  6377 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.978530  6377 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.978947  6348 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.977762  6081 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:30.979878  6081 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.981284  6377 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.978439  6364 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:30.982191  6081 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.983575  6364 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.984077  6364 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:30.985947  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 93177.7us
I20260709 12:21:30.988735  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:30.926870  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35180 (request call id 360) took 1560 ms. Trace:
I20260709 12:21:31.001421  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:30.998106  4581 rpcz_store.cc:276] 0709 12:21:29.366486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.367651 (+  1165us) service_pool.cc:224] Handling call
0709 12:21:29.373135 (+  5484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.373351 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:29.373610 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.920602 (+1546992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.920674 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:30.920733 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.926693 (+  5960us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.926809 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36364,"prepare.queue_time_us":2072,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":46970,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":19528,"thread_start_us":1510315,"threads_started":1}
W20260709 12:21:31.026953  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.904522  4575 rpcz_store.cc:276] 0709 12:21:29.659747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.668104 (+  8357us) service_pool.cc:224] Handling call
0709 12:21:30.903953 (+1235849us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:30.993707  6351 consensus_meta.cc:287] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.040s	user 0.011s	sys 0.002s
I20260709 12:21:30.933709  4579 rpcz_store.cc:276] 0709 12:21:28.580095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.582304 (+  2209us) service_pool.cc:224] Handling call
0709 12:21:29.057108 (+474804us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:29.057326 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.057556 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:29.359732 (+302176us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.932857 (+1573125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.932922 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:30.933002 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.933077 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:30.933204 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192884,"prepare.queue_time_us":201996,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":104,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":5008768,"thread_start_us":1678401,"threads_started":2,"wal-append.queue_time_us":1435741}
W20260709 12:21:31.033552  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44920.4us
I20260709 12:21:31.036095  6332 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.036890  6332 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.997076  6364 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.037376  6332 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.036352  6286 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:30.938304  6325 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.041810  6325 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:30.997722  6384 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:31.039206  6364 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.027946  6323 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.069064  6347 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.071120  6385 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.071818  6385 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.072993  6323 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.046912  6351 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.077190  6385 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.078118  6351 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:31.108446  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 211250us
I20260709 12:21:31.119882  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:31.124217  3925 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:31.125187  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.126775  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1796) took 3758 ms. Trace:
W20260709 12:21:31.114609  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.115288  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.115829  3843 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:31.128243  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:30.924451  3745 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.129711  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.131278  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.131755  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 873) took 1762 ms. Trace:
I20260709 12:21:31.133567  4576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 314) took 1482 ms. Trace:
I20260709 12:21:31.138934  5521 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.140590  6100 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:31.141120  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:31.143419  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:31.143913  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:31.151165  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.151901  3919 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:31.128345  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:31.169190  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.156078  3917 rpcz_store.cc:276] 0709 12:21:27.368567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.788755 (+3420188us) service_pool.cc:224] Handling call
0709 12:21:30.789096 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.844156 (+ 55060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.125946 (+281790us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b54002d0854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:31.126467 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125005696}
I20260709 12:21:31.174422  3846 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:31.176846  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.177399  3745 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:31.179865  3849 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:31.180131  6210 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:31.181154  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.178216  3846 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:31.189316  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.195677  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.201092  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1679) took 1863 ms. Trace:
I20260709 12:21:31.201906  3848 rpcz_store.cc:276] 0709 12:21:29.337499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.340187 (+  2688us) service_pool.cc:224] Handling call
0709 12:21:29.340461 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:29.340664 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:29.340935 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.118820 (+1777885us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b18002ba980. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:21:31.200310 (+ 81490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:31.200413 (+   103us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:31.200562 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.200658 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.200855 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28388,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3827,"raft.queue_time_us":28963,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":208,"spinlock_wait_cycles":12304768,"thread_start_us":52374,"threads_started":1}
I20260709 12:21:31.163969  4576 rpcz_store.cc:276] 0709 12:21:29.650960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.653960 (+  3000us) service_pool.cc:224] Handling call
0709 12:21:30.912017 (+1258057us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:21:30.912231 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.953301 (+ 41070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.132534 (+179233us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54005ae954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:31.133212 (+   678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103054976}
W20260709 12:21:31.210621  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.212600  6385 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.213748  6385 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.216953  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.218448  6203 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.219202  6203 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.058010  6103 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:31.225497  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97481.9us
I20260709 12:21:31.224813  3745 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 4, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.226297  6207 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:31.227713  5521 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.227403  3745 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:21:31.228978  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 88193.4us
I20260709 12:21:31.231405  6100 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.231813  6384 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.234268  6364 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:31.234578  6100 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:31.235184  6203 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.235533  6364 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.232221  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:31.238104  6364 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.115859  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.239809  6347 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:31.240049  3841 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:31.240658  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.240598  6347 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.242465  3745 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.244088  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:31.245937  6103 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.158015  3994 rpcz_store.cc:276] 0709 12:21:29.368824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.368962 (+   138us) service_pool.cc:224] Handling call
0709 12:21:29.369305 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:29.379567 (+ 10262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:29.379608 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:29.380149 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 12:21:29.638831 (+258682us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:29.646672 (+  7841us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.809268 (+1162596us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800421ea0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287 00007fdc52a0e208
0709 12:21:30.909717 (+100449us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:31.130000 (+220283us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.130715 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.130933 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.131049 (+   116us) raft_consensus.cc:1685] finished
0709 12:21:31.131080 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.131396 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4551,"prepare.queue_time_us":272626,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":1199621,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":7089,"spinlock_wait_cycles":22827008,"thread_start_us":538014,"threads_started":2,"wal-append.queue_time_us":641081}
I20260709 12:21:31.243359  6347 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.232193  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.259277  6385 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:31.272527  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.281172  5521 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:31.281891  3922 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
W20260709 12:21:31.283064  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.291914  3815 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.293550  6203 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.286032  3745 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.314184  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.298627  6323 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:31.319583  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.325137  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.325085  5521 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:31.328977  3849 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:31.332264  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 875) took 1956 ms. Trace:
I20260709 12:21:31.332839  6385 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.334259  6385 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:31.325289  6323 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.343665  3843 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:31.344786  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.353415  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:31.354676  3849 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:31.332926  3993 rpcz_store.cc:276] 0709 12:21:29.369466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.369572 (+   106us) service_pool.cc:224] Handling call
0709 12:21:30.962097 (+1592525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.987868 (+ 25771us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:31.134664 (+146796us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.209679 (+ 75015us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.210645 (+   966us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.210902 (+   257us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:31.219151 (+  8249us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.220386 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.220528 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.290589 (+ 70061us) raft_consensus.cc:1685] finished
0709 12:21:31.290609 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.325942 (+ 35333us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540002f150. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:31.326091 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62707,"prepare.queue_time_us":91396,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":73499,"raft.run_cpu_time_us":622,"raft.run_wall_time_us":21900,"spinlock_wait_cycles":3661713792,"thread_start_us":182870,"threads_started":2,"wal-append.queue_time_us":110088}
I20260709 12:21:31.346277  6323 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.362581  4578 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:31.374516  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 88528.6us
I20260709 12:21:31.340272  6385 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:31.376520  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:31.377676  6203 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:31.377691  6385 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.380249  6385 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:31.360173  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99636.9us
I20260709 12:21:31.376149  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.382870  5521 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.382201  3745 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 4, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.395715  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.396317  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.396843  5521 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.397475  6149 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.398168  6149 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.400902  6149 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.401711  6103 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:31.402273  6103 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:31.402750  6103 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:31.406257  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.406342  3849 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:31.406863  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:31.407261  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.408229  3843 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:31.409165  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.410187  3842 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:31.410122  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.413553  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.421221  5521 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.422881  6384 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:31.423494  6384 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:31.425021  6384 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.428177  6384 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.431005  4579 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:31.432152  6351 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.433295  6351 consensus_queue.cc:1243] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:31.434227  6351 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:31.434788  6351 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:31.436100  6351 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.436537  6390 consensus_queue.cc:1059] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:31.437664  6351 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:31.438676  6347 raft_consensus.cc:3055] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:31.439093  6347 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:31.440267  6347 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.439985  3745 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 5, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.441736  6347 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:31.442461  3745 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.444520  6332 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.446116  6342 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:31.446978  6363 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:31.447768  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:31.448880  6253 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.449627  6390 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.450139  6149 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:31.450078  6203 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.450736  6100 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:31.454162  6101 consensus_meta.cc:287] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.010s
I20260709 12:21:31.427064  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.467870  3849 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:31.473945  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.481235  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.485556  3842 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:31.490477  3846 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:31.491521  6332 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:31.492063  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65194us
I20260709 12:21:31.492734  6332 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:31.493260  6332 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:31.493786  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.495146  6323 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.495652  6100 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.496573  3745 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.497640  6323 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.497777  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.498946  6351 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:31.499540  6351 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:31.499989  6351 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:31.493636  3962 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.504925  6101 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.505927  6324 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:31.493656  6332 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.506754  6363 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.507961  3847 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:31.509727  6363 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.510689  6207 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:31.513298  5993 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:31.514629  6169 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:31.483355  6390 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.516045  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:31.517290  6203 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:31.517927  6203 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:31.518114  6390 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.487534  6149 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:31.519685  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 160945us
I20260709 12:21:31.520870  6101 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.521389  6149 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:31.522261  6286 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:31.522874  6286 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:31.523996  6286 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.519095  6203 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:31.529583  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 153707us
I20260709 12:21:31.529850  6347 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.530601  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.517302  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.524394  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:31.535549  3842 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:31.499178  3745 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 4, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.550493  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:31.552587  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59097us
I20260709 12:21:31.497887  6100 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.557730  3849 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:31.485563  6342 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.567227  3846 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:31.570915  6206 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:31.571507  6206 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:31.571970  6206 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.571625  6351 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.575594  6324 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:31.576360  6325 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.580355  3745 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:21:31.582230  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 57977.7us
W20260709 12:21:31.585336  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54738us
I20260709 12:21:31.581976  3745 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:31.598209  3745 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 4, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:21:31.600458  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.599737  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 169639us
I20260709 12:21:31.602813  3845 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:31.600819  6169 tablet_bootstrap.cc:492] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:21:31.621891  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.621996  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.622872  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.605149  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.627959  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.632342  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.633163  3847 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.601502  6324 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:31.636518  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:31.601217  6103 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.643738  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.600659  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:31.649945  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.650357  6351 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.668038  6385 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:31.670929  6148 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:21:31.671132  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 108205us
I20260709 12:21:31.672019  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.671774  6385 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:31.674324  6385 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:31.676955  6351 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.678728  6351 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:31.678377  3745 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:31.679972  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 43552.6us
I20260709 12:21:31.691606  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:31.680601  6324 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.680702  3745 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.650322  6365 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:21:31.684674  6342 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.686074  6101 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:31.686846  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.687428  6323 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:31.687892  6325 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:31.707258  3847 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:31.728037  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.735039  6384 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:31.736088  6149 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:21:31.735948  3745 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.737700  6103 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.738617  6169 ts_tablet_manager.cc:1403] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 2.291s	user 0.044s	sys 0.035s
I20260709 12:21:31.737071  6149 consensus_queue.cc:1243] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:31.710637  6207 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:31.747414  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.748489  6363 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:31.748600  3888 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:31.738132  3745 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 3, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 3 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.713776  6101 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:31.756011  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64608.5us
I20260709 12:21:31.756527  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.761823  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:31.764103  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.751744  6100 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:31.771023  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84274.5us
I20260709 12:21:31.768725  6351 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.795542  3745 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 4, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:31.804641  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.798651  6210 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:31.799815  6351 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:31.799535  6100 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:31.799265  6347 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:31.771482  6206 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.815604  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:31.818451  3745 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 4, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 4 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:31.801440  6325 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:31.863881  6363 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:31.864060  6081 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:21:31.865338  6363 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.803144  6332 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:31.870581  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 122063us
I20260709 12:21:31.876289  3847 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:31.876749  6169 raft_consensus.cc:359] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:31.877717  6169 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:21:31.878084  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.878463  6169 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:31.855243  6149 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.854281  6351 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.877728  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:31.887758  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:31.888311  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.889499  6149 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.890678  6103 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:31.891258  6103 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:31.891394  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.891938  6342 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:31.892467  6103 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.893888  3849 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:31.897621  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 135933us
I20260709 12:21:31.898837  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:31.900465  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:31.901340  3848 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:31.887349  6384 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:31.917927  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:31.918522  3925 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:31.921376  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 119332us
I20260709 12:21:31.879887  6325 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.906071  6149 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.935798  6148 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:31.880293  6101 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.876534  6100 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:31.940819  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:31.960944  6420 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:31.930737  6332 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.936609  6148 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:31.943822  6206 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:31.969264  6325 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:31.943264  6169 ts_tablet_manager.cc:1434] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.204s	user 0.007s	sys 0.002s
I20260709 12:21:31.990172  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:31.993257  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:31.996634  3850 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:31.998816  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:31.999835  3921 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:31.983520  4579 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.999168  4576 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:31.937259  6384 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.009121  6148 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.014753  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.015519  6390 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:32.015692  6385 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:32.016949  3841 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:32.023384  6210 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:32.024067  6210 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:32.025159  6210 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.026795  6210 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.016095  6390 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:32.030661  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 112868us
I20260709 12:21:32.030957  6081 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.031253  6390 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.032684  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.036016  3921 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:32.043874  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.043895  3916 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:32.051098  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43718.4us
I20260709 12:21:32.023398  6385 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:32.056875  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.031430  6081 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:32.141929  3918 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:32.095911  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.144800  6081 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.145344  3922 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.111335  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.064666  6390 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.146768  6162 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:32.116181  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:32.106110  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:32.087273  6207 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:21:32.070808  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:32.148064  4575 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:32.062206  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.114248  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-f3bacd87db564c3ba5256af726514f84 received from {username='slave'} at 127.0.0.1:46046
I20260709 12:21:32.147405  3919 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:32.115963  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:32.169906  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-f3bacd87db564c3ba5256af726514f84 on tablet f3bacd87db564c3ba5256af726514f84 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:32.175391  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.162248  6206 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.096149  6253 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:21:32.185066  3848 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:32.187247  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.187811  6100 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.195057  6431 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:21:32.195701  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79870.4us
I20260709 12:21:32.200193  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.201160  6253 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:32.198426  3923 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:32.205703  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.222677  3924 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.206684  6332 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:32.208235  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3998900309998135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 12:21:32.230461  3964 connection.cc:256] RPC call timeout handler was delayed by -1.2768651679998584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:21:32.230930  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0587900309997167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 12:21:32.230499  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:32.207361  6292 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:32.209293  6424 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.210317  6101 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.211055  6384 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:32.211634  4579 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
W20260709 12:21:32.215418  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.180655  6206 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:32.230832  5521 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:32.234844  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:32.227240  3922 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:32.244868  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:32.249428  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.259379  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:32.259841  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:32.260146  3998 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:32.260773  3994 raft_consensus.cc:2410] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:32.259038  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:32.262689  3993 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.265345  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.266214  3990 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:21:32.266350  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:32.267545  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.268322  6342 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:32.269155  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.269025  6342 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.270094  3995 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:32.273033  6342 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.256137  3923 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
W20260709 12:21:32.289588  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50506.3us
I20260709 12:21:32.221663  6253 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:32.291625  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.293208  3998 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:32.209437  6428 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.294714  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.279763  6206 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.295571  6332 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.297561  6427 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:32.300099  3995 raft_consensus.cc:2410] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:32.294997  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.247174  6347 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.305213  3993 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:32.306219  6428 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.306910  3991 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:32.307862  6384 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.308948  6428 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.309559  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.310205  3921 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.310369  6384 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.311380  6101 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.312501  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.313640  6101 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.313709  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.301311  6424 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.314884  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.315686  3919 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:32.303901  6347 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.317425  6347 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.316481  6424 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.321209  6332 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.283070  6323 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:32.322024  6323 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:32.323092  6323 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.324193  6323 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.324996  6149 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.325556  6149 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.326098  6347 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.326731  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:32.327960  6149 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.328634  6203 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:32.328641  6347 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.329383  6203 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:32.330742  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:32.330447  6203 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.288134  6342 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.342108  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.351153  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.352852  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.354246  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.355732  3990 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:32.357609  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:32.358135  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:32.360380  4576 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:32.358369  3995 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.361985  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.233665  6100 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.362640  3923 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.363524  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.369431  3921 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:32.355325  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:32.289170  6351 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.339160  6427 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:32.291596  6292 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:32.300854  6207 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:21:32.380080  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.405437  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.406664  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.407287  3924 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:32.409644  3924 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:21:32.410054  3924 pending_rounds.cc:85] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 3
I20260709 12:21:32.410337  3924 pending_rounds.cc:107] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:32.410687  3924 raft_consensus.cc:2889] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.411267  4576 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:32.413132  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:32.413709  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.404048  6426 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:32.416524  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:32.417732  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.414892  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:32.381789  6424 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.420514  3919 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.374370  6385 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:32.423321  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:32.425784  3995 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:32.450760  6351 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.434577  3994 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.435393  3923 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:32.416254  6426 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:32.427533  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.427786  3924 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:21:32.431237  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.432909  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.365757  6342 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:32.431434  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 76210.8us
I20260709 12:21:32.439572  3921 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.508299  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.465013  3848 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:32.510303  3850 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:32.436076  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.434754  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.454818  3922 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:21:32.498481  4547 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.553s (SENT)
I20260709 12:21:32.512406  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:32.521587  3919 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:32.447701  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:32.445602  6440 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:32.429692  6385 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:32.523301  3843 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
W20260709 12:21:32.559639  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 144271us
I20260709 12:21:32.512734  6100 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:32.568657  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:32.570011  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.504161  6081 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:32.582093  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:32.579677  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.726s (SENT) [suppressed 21 similar messages]
I20260709 12:21:32.601132  3994 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:32.603040  3847 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:32.440404  6253 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.445118  6427 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:32.656790  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.672925  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 175943us
I20260709 12:21:32.593922  6100 raft_consensus.cc:2764] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:32.603366  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:32.665899  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:32.688014  3844 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:32.688150  3921 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:32.688450  3844 raft_consensus.cc:614] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:32.670569  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 112726us
I20260709 12:21:32.676730  6451 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:21:32.666741  6423 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:21:32.698974  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:32.682603  6384 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.702847  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99554.7us
I20260709 12:21:32.700153  6384 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:32.709926  6445 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:32.706581  3919 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:32.711295  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:32.710306  6384 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:32.606164  6323 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:21:32.706756  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:32.726626  3918 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:32.712930  6100 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:32.697502  6203 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:32.745877  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.746920  3846 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:32.749711  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.748080  3999 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:32.750996  5521 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.752432  3849 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:32.733232  6384 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:32.734464  6154 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.702185  6385 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:32.759408  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48201.7us
I20260709 12:21:32.737973  6100 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.737473  6103 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.748596  6081 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:32.769197  5521 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:32.755214  6384 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:32.742990  6210 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:21:32.786041  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:32.789388  6424 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:32.789961  6385 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.832967  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:32.768977  6100 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:32.838738  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 158216us
W20260709 12:21:32.841182  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49575us
I20260709 12:21:32.776842  6426 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:32.782176  6384 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:32.855572  6455 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:21:32.860203  6452 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 12:21:32.862251  6292 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:32.863499  6453 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:21:32.891055  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:32.908458  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.911597  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:33.022557  3844 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:32.912459  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:32.972178  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 132359us
W20260709 12:21:32.840108  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 131091us
I20260709 12:21:33.070279  3843 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:32.925850  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.977955  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:33.072820  3847 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:32.953325  4547 leader_election.cc:336] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.582s (SENT)
W20260709 12:21:33.063418  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 110775us
I20260709 12:21:33.079416  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:33.041718  6206 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.002s
I20260709 12:21:32.965131  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:32.971786  6459 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:21:32.986140  6210 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:33.089005  6323 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.082504  6286 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.994380  6332 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:33.084718  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 119704us
I20260709 12:21:32.997599  6342 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:33.098857  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.099603  6332 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.089006  6106 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:32.986756  6465 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:21:33.092142  6210 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:33.094867  6323 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:33.116084  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 272876us
I20260709 12:21:33.085935  6206 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:33.103812  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 231997us
I20260709 12:21:33.105726  6384 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.125651  6465 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.970543  6428 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:21:33.126283  6465 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:33.129143  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:33.129516  6465 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:33.131023  3889 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.521s (SENT)
I20260709 12:21:33.131577  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:33.108705  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.133425  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.133703  6384 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:33.134202  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.101172  6081 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:33.124109  6106 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:33.119966  6323 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.135402  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:33.145931  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:33.146173  4547 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.616s (SENT)
W20260709 12:21:33.139878  3889 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.625s (SENT)
I20260709 12:21:33.147702  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:33.144101  3993 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:33.140416  3845 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.143471  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.117237  6332 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.155344  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:33.135659  6081 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:33.139621  6384 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.143926  6451 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.140244  6342 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:33.141872  6206 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:33.180456  6206 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:33.137338  6106 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:33.183933  3997 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:33.186210  6253 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.188575  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:33.188896  5521 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.189620  3848 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:33.189814  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:33.191413  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:33.173645  3992 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:33.174594  3990 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:33.175487  3996 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:33.175339  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.193868  3991 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:33.199826  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75496.9us
I20260709 12:21:33.200268  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:33.200608  4547 leader_election.cc:336] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.658s (SENT)
I20260709 12:21:33.201013  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:33.201486  6451 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.202384  6207 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:33.202785  6207 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:33.203691  6207 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.204200  6081 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:33.205140  6203 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:33.205663  6203 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:33.206728  6203 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.208663  6468 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:33.210228  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70287.5us
I20260709 12:21:33.159039  6351 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.176398  3995 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:33.138386  6426 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:21:33.219635  3847 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:33.156095  6469 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:33.205379  6081 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.221737  5521 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:21:33.140367  6100 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.214921  3844 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:33.259178  3991 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.208626  6203 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:33.275780  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 120528us
W20260709 12:21:33.277860  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.278482  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.278986  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.279462  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.279824  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.271517  6477 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.064s	user 0.002s	sys 0.003s
I20260709 12:21:33.255475  6286 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:33.324131  3996 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:21:33.325289  6439 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:21:33.403285  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 78475.5us
I20260709 12:21:33.267674  6469 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:33.400731  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 111609us
I20260709 12:21:33.404314  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.405422  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:33.406347  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 205787us
I20260709 12:21:33.413420  3990 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:33.409623  3889 leader_election.cc:336] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.683s (SENT)
I20260709 12:21:33.410885  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.418443  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.222535  6384 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.419018  3997 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:33.418391  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:33.269771  6103 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 12:21:33.408660  6101 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.296060  6385 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 12:21:33.437259  3995 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:33.447193  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.447628  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.448298  3996 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.448712  3997 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.449254  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.449889  3996 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:33.449986  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.450578  3991 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:33.450750  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.450851  3997 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:33.451638  3996 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.451751  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.452461  3991 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:33.452232  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.453441  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.454072  3990 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:33.455006  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.455792  3999 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.457330  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.459766  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.461570  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.462970  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.464190  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.464625  3991 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:33.464979  3990 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:33.465756  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.466424  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:33.466276  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.469362  3997 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:33.470739  3994 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:33.469082  3990 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:33.472898  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63345.1us
W20260709 12:21:33.473592  3889 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.778s (SENT)
I20260709 12:21:33.407938  6451 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:33.485347  3889 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.324s (SENT)
I20260709 12:21:33.478896  3996 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:33.467417  6351 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:33.467687  6490 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.325793  6210 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.495229  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:33.496078  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 43707.9us
W20260709 12:21:33.502664  6464 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.590s	user 0.008s	sys 0.003s
I20260709 12:21:33.441259  6101 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.513815  3990 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:33.514330  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80764.4us
I20260709 12:21:33.519956  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:33.578560  3841 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:33.581103  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.590860  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.562028  3990 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:33.544873  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.597893  3996 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:33.610870  3999 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:33.494223  6323 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:33.673095  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64517.2us
I20260709 12:21:33.472508  6469 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:33.707665  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.662053  3990 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:33.697340  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.713595  3995 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:33.713999  3990 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:33.674785  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 373671us
I20260709 12:21:33.715588  3992 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
W20260709 12:21:33.713122  3843 consensus_meta.cc:287] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.001s
I20260709 12:21:33.716749  3843 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:33.719115  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:21:33.704149  6464 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:21:33.720386  3848 raft_consensus.cc:606] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:33.727324  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:33.728299  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 243079us
W20260709 12:21:33.729059  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.730319  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:33.711385  6100 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.744020  3918 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:21:33.744431  6487 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:21:33.660207  6365 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:21:33.755470  3995 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:33.760916  3923 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:33.760605  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:33.605974  6490 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:33.762451  3921 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:21:33.731626  6351 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.766832  3917 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:33.763861  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:33.769152  3925 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:33.771050  6489 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:33.775429  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.775687  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:33.776512  3995 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.750072  6384 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.777679  4578 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:33.774296  6472 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:33.781739  6323 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:33.797663  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.798561  3995 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:33.789839  4576 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:33.776326  6351 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:33.809274  6253 consensus_meta.cc:287] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 12:21:33.811478  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.811862  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.812258  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.817250  3998 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:33.817545  3997 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.817621  3996 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.818452  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.812564  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.820086  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.820827  3996 raft_consensus.cc:2368] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:33.820688  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.821283  3997 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.821617  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.822748  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.823354  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.824869  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.826227  3991 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.826957  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.831496  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.832299  3991 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.834431  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.835043  3998 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:33.835981  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.836243  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.837620  3919 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:33.821285  6490 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.844388  3998 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:21:33.840140  3993 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:21:33.843930  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.846395  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.847692  3997 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:33.848930  3998 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:33.850044  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.850682  3995 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:33.857242  3998 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.859092  3998 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:33.860276  3996 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:33.863651  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.865393  3998 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:33.846300  6101 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:33.884392  3995 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:33.889905  3990 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:21:33.890551  3990 pending_rounds.cc:85] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 3
I20260709 12:21:33.890928  3990 pending_rounds.cc:107] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:21:33.891356  3990 raft_consensus.cc:2889] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:33.892284  6496 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:21:33.893781  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:33.893936  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.898620  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.900861  6351 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:33.906378  6101 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:33.907126  6101 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:33.908341  6207 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.909737  6101 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:33.908383  3996 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:33.915894  6210 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:33.921334  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.950269  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.950057  3841 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
W20260709 12:21:33.950670  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.950951  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.951155  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.951416  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.956972  3925 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:33.963066  3814 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.813s (SENT)
I20260709 12:21:33.965476  3849 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:33.964665  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:33.973111  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:33.976401  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:33.977913  3841 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.975236  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:33.969734  6203 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.003s
I20260709 12:21:33.980401  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:33.985599  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:33.987917  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:33.994395  3841 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:34.001350  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.002336  3998 raft_consensus.cc:2368] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:34.006515  6486 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.975708  6501 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.010565  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:34.014014  6494 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:34.019088  6478 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.603s	user 0.004s	sys 0.007s
I20260709 12:21:34.019212  6494 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.019953  6154 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:34.020394  6154 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:33.984174  6292 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:34.021302  6154 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.021900  6292 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.022300  6292 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.022667  6154 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.023761  6501 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.026108  6501 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.026508  6503 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:34.027035  6503 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:34.028294  6503 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.030992  6503 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:34.031613  6081 consensus_meta.cc:287] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.001s
I20260709 12:21:34.036577  3996 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.037175  3991 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:34.037302  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.037967  3990 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:34.038132  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:34.038206  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.038641  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.039278  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.039294  3997 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:21:34.015359  3993 raft_consensus.cc:2376] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7. Re-sending same reply.
I20260709 12:21:34.045142  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.045218  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.047763  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.053783  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.057971  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.058938  3995 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:34.060719  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.063750  3996 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:34.073357  6081 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:34.074160  6081 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.085682  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:34.091084  3996 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.100782  3919 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:21:34.101516  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.102133  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.102610  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.103140  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.111881  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:34.113864  3889 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.339s (SENT)
I20260709 12:21:34.114601  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.112807  3920 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:34.083127  6210 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:34.121457  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.122455  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:34.105886  6501 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:34.124667  3995 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:34.117795  6474 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.020404  6494 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.125623  3995 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:34.126318  3814 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.626s (SENT)
W20260709 12:21:34.127817  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.128141  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.128700  3995 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.129936  3995 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.130960  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.133543  6495 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.134793  6081 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.142084  3995 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:21:34.145812  3995 pending_rounds.cc:85] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 3
I20260709 12:21:34.146276  3995 pending_rounds.cc:107] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:21:34.146700  3995 raft_consensus.cc:2889] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.151384  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.157823  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.158990  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.159756  3995 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:34.160112  3814 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.957s (SENT)
I20260709 12:21:34.149137  6495 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.165692  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:34.166538  3843 raft_consensus.cc:606] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.167121  3843 raft_consensus.cc:614] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:34.156157  6081 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.128166  6210 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.169730  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.144109  6501 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.178877  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.180955  6210 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:34.183391  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.164539  6469 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.188077  6203 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.188476  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.189983  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.196148  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.197039  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.173633  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.211474  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:34.209931  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.220239  3919 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:34.223817  3993 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:34.225504  3995 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:21:34.222410  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51013.9us
I20260709 12:21:34.175571  6081 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.251963  3923 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.235831  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.237298  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.237984  3849 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:34.234376  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.241181  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:34.247150  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.238768  6469 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.247726  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.248864  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.249112  6466 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:34.249413  6365 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:34.250104  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.255013  3924 raft_consensus.cc:2410] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:34.265398  3814 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.080s (SENT)
I20260709 12:21:34.266618  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.252002  6445 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:34.268138  6445 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.268551  6445 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.268694  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:34.264272  3991 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:34.251547  6292 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:34.282168  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47916.2us
I20260709 12:21:34.289758  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.285029  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:34.292136  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59309.1us
I20260709 12:21:34.281873  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:34.292815  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.293251  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.255317  6081 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.252633  6472 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.294502  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.304304  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:34.311549  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.312480  3923 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:34.297312  6486 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.328009  6292 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:34.328584  6486 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:34.331362  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.335501  6501 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.336285  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.338233  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.339023  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.339416  3916 raft_consensus.cc:2410] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:34.340436  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.340724  6101 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:34.341269  6101 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:34.341378  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.341686  6101 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:34.341845  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:34.318033  3922 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:34.313795  6378 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:21:34.319823  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.302996  6485 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:34.345912  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.354367  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.354650  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.329694  6486 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.356509  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:34.315755  6472 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:34.368134  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135756us
I20260709 12:21:34.352597  6485 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:34.377036  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.380081  3923 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:34.382107  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.355958  6292 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:34.374825  6514 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:21:34.357472  4579 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:34.376348  6497 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:34.377068  6485 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.378639  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:34.419121  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.421450  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 130105us
I20260709 12:21:34.396111  6203 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:34.438691  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62216.6us
W20260709 12:21:34.440560  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 60798.6us
I20260709 12:21:34.443768  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.445577  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.442080  3888 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.433349  6210 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:34.459518  6428 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:34.459594  6472 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.442255  6497 raft_consensus.cc:2764] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:21:34.463855  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.473699  6351 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.480159  6351 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:34.481192  6351 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:34.486562  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.470815  6428 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.437199  6203 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.434731  4576 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.490571  6485 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.440495  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.507195  3990 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:34.507752  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.510067  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 69664.1us
I20260709 12:21:34.512084  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:34.512766  3843 raft_consensus.cc:606] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:34.513105  3843 raft_consensus.cc:614] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:34.484539  6081 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.513618  6465 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.521231  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:34.520931  6428 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.528352  3997 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:34.505393  6469 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.506630  6292 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.538461  3814 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.544119  6469 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.547026  3814 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:34.548445  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:34.549307  4576 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:34.549444  6486 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:34.550151  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:34.551141  6486 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:34.551714  6486 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:34.552132  6486 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.555609  6495 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:34.556102  6495 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:34.556478  6495 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:34.560343  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 183701us
I20260709 12:21:34.528403  6101 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.570104  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:34.542965  6428 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:34.574214  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83855.2us
I20260709 12:21:34.539947  6525 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:21:34.610885  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.612627  6485 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.613083  6385 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.612464  6529 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.567829  6472 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:21:34.615693  6206 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:34.576752  6469 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.619300  6292 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:34.646590  6536 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:34.652837  6537 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:34.653996  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.656054  6203 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.657537  6495 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.659293  6101 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:34.660612  6081 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.641940  6106 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:34.676647  6494 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:21:34.666482  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45234.6us
I20260709 12:21:34.678838  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.664642  6469 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:34.679589  3746 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.608790  6207 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:21:34.668758  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:34.672185  6486 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.618871  6426 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:21:34.680413  6469 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.682729  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:34.683564  4579 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:34.667932  6472 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:34.684444  6472 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:34.685281  6472 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.686494  6472 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.645138  6529 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.692286  6253 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.693014  6253 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:34.667290  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57486.5us
I20260709 12:21:34.695434  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.696125  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.699671  6206 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.700191  6206 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.700588  6206 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.700678  6106 raft_consensus.cc:2764] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:34.700903  6253 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.703725  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.704520  6494 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:34.704921  6494 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:34.705294  6494 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:34.706847  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.708166  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:34.708909  4577 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.711644  6323 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.655206  6445 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.713966  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:34.714804  3841 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:34.715014  6426 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:34.715478  6426 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:34.715982  3842 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.716295  6426 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.717546  6426 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:34.721697  6351 consensus_queue.cc:1175] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:21:34.722287  6501 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:34.722713  6501 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:34.726048  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:34.728248  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:34.730871  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51929.7us
W20260709 12:21:34.731093  3745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 212) took 14552 ms (client timeout 15000 ms). Trace:
I20260709 12:21:34.731706  6537 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.732013  6523 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:34.733150  6537 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:34.682545  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:34.733546  6537 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:34.733809  6523 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.734513  6537 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.736277  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.737141  6523 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.738487  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.739522  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.716327  6495 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.741544  6486 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.742406  6501 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.763497  6469 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.765846  6469 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.768569  4577 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:34.768848  6501 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:34.772779  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.773540  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.774149  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:34.715237  6445 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:34.732487  3746 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 5, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:34.694029  6529 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.750963  6101 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:34.752048  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57412.8us
I20260709 12:21:34.736413  6537 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.774803  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:34.794162  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 195627us
I20260709 12:21:34.795666  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.797534  3846 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:34.785719  6428 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:34.803188  3848 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.809818  3845 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:34.752926  3745 rpcz_store.cc:269] 0709 12:21:20.179333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.179677 (+   344us) service_pool.cc:224] Handling call
0709 12:21:34.730985 (+14551308us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:32.196683 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:32.200728 (+  4045us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:32.200814 (+    86us) write_op.cc:435] Acquired schema lock
0709 12:21:32.200865 (+    51us) tablet.cc:662] Decoding operations
0709 12:21:32.347850 (+146985us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:32.347974 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:32.348020 (+    46us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:21:32.350437 (+  2417us) tablet.cc:701] Row locks acquired
0709 12:21:32.350490 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:32.350681 (+   191us) write_op.cc:270] Start()
0709 12:21:32.350854 (+   173us) write_op.cc:276] Timestamp: P: 1783599692350617 usec, L: 0
0709 12:21:32.350878 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:21:32.398673 (+ 47795us) log.cc:844] Serialized 8606 byte log entry
0709 12:21:33.130797 (+732124us) op_driver.cc:464] REPLICATION: finished
0709 12:21:33.485594 (+354797us) write_op.cc:301] APPLY: starting
0709 12:21:33.498037 (+ 12443us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:33.502835 (+  4798us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:33.503042 (+   207us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:33.746539 (+243497us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:33.770717 (+ 24178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:21:33.770790 (+    73us) write_op.cc:312] APPLY: finished
0709 12:21:33.771350 (+   560us) log.cc:844] Serialized 152 byte log entry
0709 12:21:33.771610 (+   260us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:33.771833 (+   223us) write_op.cc:454] Released schema lock
0709 12:21:33.771923 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:33.772467 (+   544us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:33.772501 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":337158,"apply.run_cpu_time_us":8932,"apply.run_wall_time_us":304116,"num_ops":22,"prepare.queue_time_us":211613,"prepare.run_cpu_time_us":54890,"prepare.run_wall_time_us":380149,"raft.queue_time_us":369103,"raft.run_cpu_time_us":16849,"raft.run_wall_time_us":197573,"replication_time_us":779603,"thread_start_us":745676,"threads_started":4,"wal-append.queue_time_us":197287,"wal-append.run_cpu_time_us":23573,"wal-append.run_wall_time_us":2136024}]]}
I20260709 12:21:34.811299  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.813683  6528 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:34.814970  6502 raft_consensus.cc:1064] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:21:34.782670  6469 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.783635  6490 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.799731  3746 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 8, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:34.781631  6543 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.783988  6351 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:21:34.826994  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.787576  6523 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:21:34.818964  6384 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:34.829007  6497 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.824714  6445 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:34.837013  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64354.2us
I20260709 12:21:34.832963  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:34.840359  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.837474  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.838654  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:34.829825  6543 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:34.832401  6469 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:34.840615  3746 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 4, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 4 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:34.849242  6292 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.840763  6529 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.849576  6428 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.865471  6542 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:34.872274  6494 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.853629  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.836423  6384 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.859558  6551 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:34.859858  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:34.861049  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89378.6us
W20260709 12:21:34.881712  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.849239  6546 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:34.849409  6548 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.842739  6490 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.851701  6543 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.893788  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.897310  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.897454  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:34.898578  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:34.904557  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:34.899725  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65556.2us
I20260709 12:21:34.910784  3845 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:34.887275  6292 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.895694  6385 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.859864  6523 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:21:34.889799  6551 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:34.905654  6495 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.935561  6541 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:34.946314  6541 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:34.946835  6541 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:34.928273  6351 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:21:34.936115  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:34.951666  6531 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.952979  6551 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.954403  6551 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.955754  6207 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.956295  6207 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:34.956714  6207 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.958823  6384 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.959726  6210 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:34.937726  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 97432.6us
I20260709 12:21:34.907195  6528 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:34.960507  6384 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.965075  6490 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.913108  6428 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.895965  6529 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:34.923019  6486 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:34.943209  6323 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.943423  6292 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:34.944862  6502 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:34.938287  6497 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:34.951749  6540 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:35.030725  6549 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.031495  6549 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.034392  6549 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:34.974443  6426 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:21:35.043363  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.978430  6495 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.003733  6351 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:35.002664  6253 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.899863  6548 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.073293  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:35.080478  6547 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:21:34.937852  6469 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.080641  4579 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:35.040501  6540 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:35.084934  3889 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.563s (SENT)
I20260709 12:21:35.089931  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:35.091035  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 186592us
I20260709 12:21:35.092466  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.092828  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:35.071687  6351 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:35.102137  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:35.099135  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.107105  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.109921  6351 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.111310  6351 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.114128  6385 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.071131  6495 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.115746  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:35.116379  6206 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.116804  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:35.116307  6207 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.118533  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.118988  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:35.120240  6426 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:35.120726  6426 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.121146  6426 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:35.125324  6548 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.126000  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.125873  6529 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.079176  6253 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.128153  6540 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.129588  6540 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:35.135566  6549 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:35.136044  6549 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:35.137158  3848 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:35.136919  6549 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.138195  6549 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.119357  3916 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:35.139659  6494 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:35.083994  6451 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.140522  6451 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.141393  6365 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:35.142256  6365 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:35.142570  6365 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:35.143496  6365 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.144721  6365 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:35.116436  3922 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:35.148078  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:35.148705  3922 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:35.149528  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.150444  3922 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:35.048309  6497 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:21:35.103595  6384 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:35.162779  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51137.5us
I20260709 12:21:35.166764  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:35.168170  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.175879  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.151839  6207 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:35.239884  3889 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.726s (SENT)
W20260709 12:21:35.240406  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64608.6us
I20260709 12:21:35.240504  3889 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.156539  6323 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.237239  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:35.237546  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.241253  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.165506  6531 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.248741  3922 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:35.249377  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:35.255293  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:35.264201  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.256302  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.255483  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.182792  6494 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.266183  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.266633  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.257318  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.264552  3996 raft_consensus.cc:2376] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4. Re-sending same reply.
I20260709 12:21:35.261466  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:35.264489  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.267392  3990 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.267380  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.274941  3997 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:35.271360  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.279186  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.280707  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.282747  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.277688  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.279899  3999 raft_consensus.cc:2376] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9. Re-sending same reply.
I20260709 12:21:35.267922  6207 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.285934  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.285776  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.286384  6501 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:35.286648  3992 raft_consensus.cc:2376] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7. Re-sending same reply.
I20260709 12:21:35.286983  6501 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.287232  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.276772  6445 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.276772  6525 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:35.287606  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.244915  6384 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.290915  3992 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:35.287523  6501 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:35.302050  3845 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:35.304313  6558 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:35.306267  3992 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:35.307046  6451 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:35.299942  3990 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:35.296666  6559 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.321970  6559 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.326433  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.326494  6559 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.320823  6253 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.293603  6106 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:35.288311  6081 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:35.299371  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.349737  3993 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:35.339411  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.346407  3916 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:21:35.363091  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.373160  6445 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.378947  6445 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.381148  3921 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:35.381664  6445 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.372725  6559 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.384470  6555 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:35.294270  6531 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:21:35.386626  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.388378  6206 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:35.383960  6559 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.391340  6559 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.393224  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.252365  6554 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:21:35.395327  3995 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:35.396422  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.397429  6486 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:35.397686  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.399771  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.400437  3995 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:35.413487  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 173620us
I20260709 12:21:35.349570  6081 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.417764  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.435374  3922 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:35.443169  3995 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:35.445312  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.444833  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.447777  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.448879  3995 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:35.408910  6466 raft_consensus.cc:1027] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: attempt to promote peer 328b0b7296c545ff8ea6f7c70f93f2c5: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:21:35.450414  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.453454  6253 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:35.440809  6502 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:35.454066  6253 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:35.454195  6502 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:35.460506  3993 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:35.464653  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.461508  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.471676  3995 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.476864  3845 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:35.479275  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.447526  6081 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.433722  6206 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:21:35.513520  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.514041  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:35.521868  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.522266  4578 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:35.525949  3920 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:35.464692  6472 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:35.488576  6545 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:21:35.467768  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:35.530345  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:35.539088  4581 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.531188  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.518689  3996 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:35.532829  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.542765  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.537233  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:35.544577  3845 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:35.510931  6559 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:35.547878  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.548697  4578 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:35.554682  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:35.523172  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:35.482156  6525 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:21:35.558665  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.559412  3995 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:35.559276  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.478293  6426 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.477819  6542 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.538090  6523 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:35.571379  6543 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.000s
I20260709 12:21:35.571740  6445 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:35.559544  6559 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.560714  6351 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:35.578583  3995 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:35.554339  6451 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:35.593843  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 56719.6us
I20260709 12:21:35.594985  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.582626  3845 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:35.558349  6546 consensus_meta.cc:287] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.003s
I20260709 12:21:35.560779  6384 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.589815  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63618.7us
I20260709 12:21:35.511093  6502 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.557842  6497 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:35.602231  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:35.510193  6253 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.612689  3995 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:21:35.605756  4547 leader_election.cc:336] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.742s (SENT)
I20260709 12:21:35.616268  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:35.585925  6541 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.004s
I20260709 12:21:35.593472  6351 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:35.632128  6549 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:35.592734  6451 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.629667  6541 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.610570  6546 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:35.652426  4581 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:35.653981  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:35.656138  3925 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:35.612808  6548 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:21:35.694404  3916 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:35.706573  6286 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.644670  6207 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.706801  6571 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:35.660887  6569 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.637553  6351 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:35.649538  6451 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:35.577901  6542 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.612236  6384 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:35.701601  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.645148  6549 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:35.586086  6543 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.661062  6556 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:35.660678  6385 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:35.729302  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 152118us
I20260709 12:21:35.708572  6148 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:35.709590  6546 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.704777  6573 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.661043  6550 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 12:21:35.765988  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.779500  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.780570  3995 raft_consensus.cc:2368] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:35.738265  6549 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.786365  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.793426  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:35.794283  6563 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:21:35.794598  6560 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:21:35.794870  6561 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:21:35.795843  6566 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:21:35.797214  6575 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:35.725736  6207 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.718355  6286 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:35.817832  6574 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:35.730866  6501 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.892149  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.763829  6573 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.748153  6546 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.955403  4576 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:35.984516  6546 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.985991  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:35.986593  3995 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:21:35.988479  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.990626  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.992818  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.003564  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.012647  3995 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:35.976493  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:35.954952  6384 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.022356  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:36.023577  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.741148  6525 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:35.994304  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.977270  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:35.998919  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 396798us
I20260709 12:21:35.969503  6207 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:35.974996  6451 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.028329  6525 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.029322  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.030094  3846 raft_consensus.cc:2368] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:36.030514  6451 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:36.030596  6525 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.000499  6541 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.004096  6580 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:35.979893  6549 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.034801  6580 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:35.982671  6573 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:35.980458  6501 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.980408  6351 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.036948  6580 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:36.037086  6549 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.036967  6495 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.038249  6351 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:36.004366  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 261654us
I20260709 12:21:35.959270  6559 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:35.960615  6385 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.008849  6474 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:36.040795  6568 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:36.041054  6385 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:35.957278  6567 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.211s	user 0.000s	sys 0.008s
I20260709 12:21:36.049716  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.051465  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.011505  6582 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:35.954685  6542 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:35.958882  6081 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:35.959708  3917 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.970276  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:35.973160  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 176035us
I20260709 12:21:35.957289  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:36.064913  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.031770  6502 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.067648  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:36.068461  4581 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:36.017513  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:35.976883  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:35.958599  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.071290  3916 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:36.071818  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 114621us
I20260709 12:21:36.072607  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:36.073076  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:35.927459  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 321703us
I20260709 12:21:35.972349  6286 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:35.950775  3992 raft_consensus.cc:2410] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:36.040999  6474 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:36.008560  6426 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:36.087682  4581 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:35.957016  6543 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.057591  3843 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:36.087116  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.058343  6551 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.058447  6549 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.059741  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.098609  3995 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:21:35.958755  3921 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:36.074091  3916 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:36.076944  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.077076  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.100087  3994 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:36.077950  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.100004  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.081146  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.081835  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.076577  6568 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:36.092433  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.092954  6286 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.074095  6428 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:36.062377  6582 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.094405  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.106439  3992 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:36.079806  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.101651  3916 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:36.089423  6541 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:36.105096  3849 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:36.108187  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.098645  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:36.109510  3995 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:36.109937  4577 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:36.111397  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:36.111639  6154 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.114849  4581 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:36.115126  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.120674  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.103648  6497 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.076074  6502 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.117846  6286 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:36.126303  6502 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.128180  6081 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.130334  6582 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:36.130443  6584 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.132s	user 0.004s	sys 0.000s
I20260709 12:21:36.135458  6586 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.137133  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:36.137292  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:36.137859  4579 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:36.100896  6551 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.138778  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:36.140687  3925 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:36.123202  3916 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:36.117365  6495 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:36.140235  6551 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.146282  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:36.117929  6541 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.148245  4583 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:36.148756  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:36.153227  3993 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:21:36.157379  3994 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:36.165711  3921 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.167124  3994 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:21:36.167688  3994 pending_rounds.cc:85] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 3
I20260709 12:21:36.168025  3994 pending_rounds.cc:107] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:21:36.168344  3994 raft_consensus.cc:2889] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:36.146282  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:36.159060  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.170142  3991 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:36.161036  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:36.171048  3922 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:36.158818  4579 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:36.167335  3814 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:36.171531  6206 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:21:36.159966  6495 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.207692  6495 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.208990  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:36.209616  3924 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:36.214314  6564 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.592s	user 0.000s	sys 0.001s
I20260709 12:21:36.198380  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.216506  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:36.216706  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.217370  3925 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:36.218408  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.219725  6502 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:36.220300  6502 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.177160  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.177891  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:36.221189  3916 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:36.124306  6474 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.180239  6541 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.181156  3922 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:36.124025  6385 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:21:36.191681  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.236660  3923 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:36.237046  6598 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:36.237572  6474 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.239194  3919 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:21:36.192066  6588 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.209s	user 0.000s	sys 0.004s
I20260709 12:21:36.192811  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.198527  3921 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:36.202426  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:36.204136  3889 leader_election.cc:400] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:36.217433  6486 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:36.221225  3849 raft_consensus.cc:606] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:36.247875  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45541.8us
I20260709 12:21:36.176753  3990 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:36.248669  3919 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:36.223687  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:36.225518  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 120864us
I20260709 12:21:36.226496  6206 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:36.226603  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59376.2us
I20260709 12:21:36.232013  3924 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:36.245886  3889 leader_election.cc:403] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:21:36.245999  3921 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:36.252121  3921 pending_rounds.cc:85] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 3
I20260709 12:21:36.252385  3921 pending_rounds.cc:107] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:36.252619  3921 raft_consensus.cc:2889] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:36.244555  3920 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:36.248023  3849 raft_consensus.cc:614] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:36.223925  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.227501  6501 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:36.255715  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.258283  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:36.262640  3845 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:21:36.263029  3845 pending_rounds.cc:85] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 3
I20260709 12:21:36.263243  3845 pending_rounds.cc:107] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:21:36.263484  3845 raft_consensus.cc:2889] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:36.265067  6472 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:36.265787  3846 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:36.266372  3846 pending_rounds.cc:85] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 3
I20260709 12:21:36.266676  3846 pending_rounds.cc:107] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:36.267000  3846 raft_consensus.cc:2889] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:36.251565  6547 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:36.268793  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64898.9us
I20260709 12:21:36.253542  6486 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.274379  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.246218  6466 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:36.276477  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.282021  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:36.283598  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.284809  6551 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.269178  6451 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:36.288959  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.268333  6501 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.255513  6490 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:21:36.257124  6106 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:21:36.298446  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 228) took 1038 ms. Trace:
I20260709 12:21:36.327188  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.287227  6472 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.291764  6549 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:36.268296  6207 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:21:36.332480  3998 rpcz_store.cc:276] 0709 12:21:35.260030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.289626 (+ 29596us) service_pool.cc:224] Handling call
0709 12:21:35.303034 (+ 13408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.409821 (+106787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.409866 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:35.707504 (+297638us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:35.707943 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:21:35.982787 (+274844us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:35.983086 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.005410 (+ 22324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.005487 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.191265 (+185778us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:36.298141 (+106876us) raft_consensus.cc:1685] finished
0709 12:21:36.298166 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.298362 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142700,"prepare.queue_time_us":315,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":129002,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":23210,"spinlock_wait_cycles":80451712,"thread_start_us":274381,"threads_started":1,"wal-append.queue_time_us":274219}
I20260709 12:21:36.280545  6547 raft_consensus.cc:697] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:36.294238  6451 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:36.348462  6451 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.349177  6580 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:36.296139  6445 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:36.347226  6529 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.346104  6558 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.352372  6529 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.268702  6502 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.355831  6501 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.296788  6385 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:21:36.327553  4577 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:36.364763  6106 consensus_queue.cc:1243] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:36.395208  6547 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:36.399848  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103213us
I20260709 12:21:36.389351  6549 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:36.389694  6523 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:36.404763  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 75538.8us
I20260709 12:21:36.373804  6580 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:21:36.404870  6562 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.830s	user 0.009s	sys 0.003s
I20260709 12:21:36.378836  6495 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.421381  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1861) took 1318 ms. Trace:
I20260709 12:21:36.377686  6486 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.427597  3918 rpcz_store.cc:276] 0709 12:21:35.102773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.103176 (+   403us) service_pool.cc:224] Handling call
0709 12:21:35.112275 (+  9099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.112678 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.112711 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:35.113247 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:21:35.492052 (+378805us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:35.492123 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.492223 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.399539 (+907316us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b20001fea78. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc525a1b91 00007fdc525c3a19 00007fdc5258e8c3 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169 00007fdc52597131 00007fdc5259642d 0000000000388634
0709 12:21:36.420954 (+ 21415us) raft_consensus.cc:1685] finished
0709 12:21:36.420987 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.421271 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1770,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":120622464,"thread_start_us":378365,"threads_started":1,"wal-append.queue_time_us":414039}
I20260709 12:21:36.445163  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:36.443660  6490 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.448853  6490 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.451905  6490 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.458895  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:36.459692  3921 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:36.463269  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.464169  3846 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:36.442144  6529 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.461786  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.467072  6385 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:36.467553  6543 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.469744  3888 leader_election.cc:400] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:36.478384  3888 leader_election.cc:403] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:36.444877  6551 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.471657  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.455240  6540 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.473498  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:36.477356  6610 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:36.482125  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:36.482614  6426 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 3. Current term is 4.
I20260709 12:21:36.482987  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.426342  6549 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.487993  6570 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:36.488510  6570 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.488895  6570 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.490008  6540 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.496874  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.473292  6385 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.504927  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.505681  3848 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:36.493855  6610 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:36.502826  6525 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:36.506336  6385 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.517647  6610 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:36.484551  6543 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.512984  6502 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:36.547241  6502 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.508443  6451 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.538553  6490 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.549937  6502 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.552209  6525 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.568615  6618 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:36.569299  6618 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.573375  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.574344  3842 raft_consensus.cc:2410] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:36.574743  3847 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:36.577302  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 111) took 5633 ms. Trace:
I20260709 12:21:36.583577  6495 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:36.584059  6557 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:36.554919  6490 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.584872  6557 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:36.586086  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.586443  6490 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.586709  6557 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:36.587085  6557 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:36.587606  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.588181  6451 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.587934  6557 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.588928  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.589387  6469 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:36.589505  6557 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:36.589617  6543 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.589855  6469 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.590266  6543 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.595480  6542 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.595642  6523 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:36.596077  6542 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.597172  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1859) took 1495 ms. Trace:
I20260709 12:21:36.597561  3917 rpcz_store.cc:276] 0709 12:21:35.102061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.102180 (+   119us) service_pool.cc:224] Handling call
0709 12:21:35.111786 (+  9606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.062901 (+951115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.596914 (+534013us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400077454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:36.597108 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534242560}
I20260709 12:21:36.598192  6542 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.598773  6542 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.599190  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.601502  6207 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:36.601931  6207 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.599113  6542 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:36.609189  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.614326  3841 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:36.583693  6323 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:36.612185  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.617169  3844 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:36.612867  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.611975  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.616384  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.618633  3842 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:36.618960  3847 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:36.615962  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.624183  6494 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:36.624115  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:36.631788  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.635222  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.624812  6494 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.615334  6542 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.613539  6618 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.602900  6207 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.577709  3746 rpcz_store.cc:276] 0709 12:21:30.944138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.944366 (+   228us) service_pool.cc:224] Handling call
0709 12:21:36.577205 (+5632839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:35.073835 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:35.108763 (+ 34928us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:35.108804 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:21:35.108827 (+    23us) tablet.cc:662] Decoding operations
0709 12:21:35.109563 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:35.109630 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:35.109668 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:35.110274 (+   606us) tablet.cc:701] Row locks acquired
0709 12:21:35.110299 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:21:35.110466 (+   167us) write_op.cc:270] Start()
0709 12:21:35.110594 (+   128us) write_op.cc:276] Timestamp: P: 1783599695110411 usec, L: 0
0709 12:21:35.110617 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:35.111324 (+   707us) log.cc:844] Serialized 2054 byte log entry
0709 12:21:36.195755 (+1084431us) op_driver.cc:464] REPLICATION: finished
0709 12:21:36.336024 (+140269us) write_op.cc:301] APPLY: starting
0709 12:21:36.339923 (+  3899us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:36.349678 (+  9755us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:36.349814 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:36.350402 (+   588us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:36.350614 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:36.350658 (+    44us) write_op.cc:312] APPLY: finished
0709 12:21:36.350901 (+   243us) log.cc:844] Serialized 47 byte log entry
0709 12:21:36.351097 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:36.351208 (+   111us) write_op.cc:454] Released schema lock
0709 12:21:36.351248 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:36.351692 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:36.351719 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":470525,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":96824,"apply.run_cpu_time_us":2426,"apply.run_wall_time_us":48552,"num_ops":5,"prepare.queue_time_us":153363,"prepare.run_cpu_time_us":15413,"prepare.run_wall_time_us":428201,"raft.queue_time_us":105327,"raft.run_cpu_time_us":7464,"raft.run_wall_time_us":84607,"replication_time_us":1084950,"thread_start_us":431900,"threads_started":4,"wal-append.queue_time_us":607147}]]}
I20260709 12:21:36.616796  6323 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:36.641247  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.649413  3993 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:36.614773  6523 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.640654  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.652590  3990 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:36.590919  6469 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.633339  6529 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.639683  6494 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:36.655359  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.671027  3993 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:36.683663  3843 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:21:36.666932  6523 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:36.677829  6469 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:36.658924  6529 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:36.693876  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 83365.2us
I20260709 12:21:36.695268  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.699715  3990 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:36.693193  6614 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:21:36.699836  3888 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.693326  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.656461  6525 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:36.708142  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 211337us
I20260709 12:21:36.707492  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.710835  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.737002  6622 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:36.726783  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.696805  6523 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.742700  3815 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:36.743247  6548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.018s	sys 0.011s
I20260709 12:21:36.692693  6323 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.748804  6627 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:21:36.750895  6384 consensus_queue.cc:1175] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: [7.7-7.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:36.762373  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.750756  6323 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.763654  6572 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.764019  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:36.750991  6548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.018s	sys 0.011s
W20260709 12:21:36.765462  6623 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:36.765709  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.766731  6106 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.767409  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.768250  3990 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:36.771183  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.772125  3993 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:36.775136  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.779350  6531 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.779779  6531 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.780148  6531 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.780411  6292 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:36.775802  6106 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:36.749488  6081 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:36.783666  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.784576  6385 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.785092  6106 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:36.786265  6625 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:21:36.788496  6626 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:36.766913  6610 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.787009  6385 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.812613  6610 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.749274  6622 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.744318  6466 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:21:36.768105  6630 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.821717  6622 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.822644  6630 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.823087  6630 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.810441  6542 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.792001  3849 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:21:36.791752  6626 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.816036  6558 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:36.756196  6540 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.807221  6529 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.798229  6633 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:36.796723  6501 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:36.817233  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 179765us
W20260709 12:21:36.819847  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 112628us
W20260709 12:21:36.795904  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53336.4us
I20260709 12:21:36.794245  6081 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:36.846765  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:36.847210  3923 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:36.824702  6494 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:36.848771  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53251.3us
I20260709 12:21:36.829003  6626 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:36.828058  6558 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:36.855996  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:36.833810  6501 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.862891  6540 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:36.864527  6569 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:36.864989  6543 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:36.851970  6494 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:36.825755  6570 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.859724  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:36.861682  6106 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:36.888747  6569 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:36.853780  6492 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:36.850237  6490 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:21:36.881063  6501 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:36.927527  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65678us
I20260709 12:21:36.881537  6540 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.881592  6523 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.873183  6292 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:21:36.904482  6502 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.959774  3848 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:36.929150  6492 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.962119  6543 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:36.962734  6543 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:36.963811  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.965067  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.965194  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.965823  3995 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.965930  3998 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:36.966820  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.968093  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.968608  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:36.969801  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.970259  3994 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:36.970872  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:36.971954  6628 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:21:36.972702  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:36.972954  3994 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:36.919466  6531 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.944250  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:36.919916  6569 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:36.968832  3992 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:36.975844  3990 raft_consensus.cc:2410] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:21:36.976909  3997 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:36.967372  3998 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:36.922958  6558 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:36.952551  6540 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.984233  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:36.938235  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 161070us
I20260709 12:21:36.961033  6502 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.000942  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.003526  6106 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:37.018185  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.003758  3923 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:37.003918  6570 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:37.003598  6525 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:37.020325  3995 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:37.006618  6542 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:36.996973  6292 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:21:37.007392  6642 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:37.009881  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:36.925165  6081 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.013902  4579 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:37.014986  6569 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:37.018457  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:37.036365  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 92004.7us
I20260709 12:21:37.044755  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.065306  3917 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.019537  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:37.066958  3992 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:37.036896  6630 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.050022  3846 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:37.055908  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.062474  3998 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:37.063978  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.072345  3923 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:37.070959  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c0e62036464a72858695d542f42a18"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:37.078514  6626 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.080224  6531 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:37.016897  6492 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:37.081256  6626 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.084895  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:37.085942  4577 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:37.102101  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:37.113023  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.108084  6627 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.122542  6627 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.123239  6542 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:37.121876  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.108711  6525 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.135876  3843 raft_consensus.cc:606] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:37.139144  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.126454  6569 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:37.124984  6573 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.162647  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.131721  6466 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:21:37.148227  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:37.150352  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:37.153005  6551 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:37.198098  6551 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:37.161605  3917 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:37.163530  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:37.196249  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:37.140738  6644 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.201776  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:37.213809  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63524.8us
W20260709 12:21:37.240052  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 76645.6us
I20260709 12:21:37.195220  6640 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:37.198596  6551 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.209120  6542 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:37.195463  6573 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:37.324362  6612 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:21:37.325897  6651 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 12:21:37.328400  6647 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:37.148527  6486 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:21:37.212136  6547 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:21:37.245393  6610 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:37.360325  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.378034  6645 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.174s	user 0.004s	sys 0.002s
I20260709 12:21:37.249068  6557 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:37.251936  6384 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:21:37.388046  6630 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.142478  6626 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:21:37.397730  6502 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:37.400475  6543 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:37.248662  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.404072  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:37.347393  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 145689us
I20260709 12:21:37.406567  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.444192  3846 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:37.413064  4577 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:37.410391  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:37.415098  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:37.408249  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.396955  6558 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:37.448926  6492 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:37.416205  6501 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.449481  6573 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:37.418145  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.451294  6501 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.451743  3847 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.455408  6557 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:37.458376  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50217.1us
I20260709 12:21:37.397411  6474 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:37.404098  6627 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.400521  6540 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.462854  6540 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.462993  6638 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:37.463711  3922 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:37.449535  6492 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.465739  6492 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:37.468418  6547 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.469017  6547 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.470110  6549 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:37.471838  6547 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.442724  6502 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:37.473714  6502 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.474670  6502 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.475771  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:37.476251  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.476882  3842 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.478484  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:37.476563  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.482779  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:37.483741  6630 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:37.484589  6630 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:37.488288  4577 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:37.490553  6609 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:37.492224  6650 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:37.502696  3846 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:37.504388  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:37.506150  3842 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:37.507486  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:37.508522  6633 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:37.509238  6633 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:37.510327  6633 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.511663  6548 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:37.512218  6548 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:37.512521  3847 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:37.513149  6548 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.513732  3888 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:37.514809  6630 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:37.515297  6630 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:37.516348  6207 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.516149  6630 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.532326  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.533247  3923 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:37.536405  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.537468  3921 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:37.539178  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.558337  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.568742  3921 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:37.572408  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.573427  3917 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:37.576263  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:37.576378  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.581180  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.585107  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.585841  3916 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.585309  3917 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:37.588582  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.563162  6638 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:37.547922  6529 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:37.600183  3917 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:37.591729  3921 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:37.614212  3918 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:37.617149  3918 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:37.623390  3916 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:37.596341  6531 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.629992  3916 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:37.626609  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.631327  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.653748  3917 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:21:37.642782  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 394191us
I20260709 12:21:37.653719  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:37.657825  3916 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:37.661378  3916 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:37.626561  6640 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:37.669492  3916 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:37.671928  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:37.672675  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:37.604635  6253 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:21:37.611498  6529 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.680964  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:37.682003  3996 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:37.683216  3997 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:37.644238  6531 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:37.660331  6551 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.692376  6551 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:37.696480  3919 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:37.696614  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.698510  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:37.699144  3847 raft_consensus.cc:606] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:37.699618  3847 raft_consensus.cc:614] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:37.678643  6549 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.700309  6549 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.706636  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:37.707607  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a268ae9485472a8208827344502203"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:37.708425  3847 raft_consensus.cc:606] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:37.709095  6540 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:37.709791  6540 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.667618  6472 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.711197  6472 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.680181  6640 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:37.722265  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:37.723214  3847 raft_consensus.cc:606] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:37.723663  3847 raft_consensus.cc:614] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:37.750954  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:37.692291  3923 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:37.777894  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1821) took 1300 ms. Trace:
W20260709 12:21:37.786481  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.778533  3849 rpcz_store.cc:276] 0709 12:21:36.477932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.478112 (+   180us) service_pool.cc:224] Handling call
0709 12:21:36.482488 (+  4376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.827976 (+345488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.777482 (+949506us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540011bcd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:37.777803 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697123072}
I20260709 12:21:37.788319  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:37.791815  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:37.793900  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.794374  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:37.795498  3843 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:37.674400  6569 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:37.801064  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:37.802258  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:37.814929  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:37.815856  3996 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:37.801251  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:37.818540  3994 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.853614  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:37.862794  3996 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:37.780117  6253 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:37.891611  3994 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:37.891721  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:37.907651  3843 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:37.848380  4576 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:37.947182  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:37.941274  6610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.023s	sys 0.045s
I20260709 12:21:37.829636  6569 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:37.937026  6557 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:38.003384  3992 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:38.017757  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:37.967139  6612 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:37.942644  6492 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:37.781049  6638 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:37.991345  6490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.033s
I20260709 12:21:38.039746  3990 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:37.947127  6626 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:38.037756  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:38.115605  3994 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:37.967573  6292 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:37.915318  6253 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:38.099130  3924 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.026s	sys 0.032s
W20260709 12:21:38.126561  3924 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.026s	sys 0.032s
I20260709 12:21:37.936124  6081 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 12:21:38.026876  6642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.028s	sys 0.059s
I20260709 12:21:37.976490  6669 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:38.045339  6640 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.138797  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 1827) took 1565 ms. Trace:
I20260709 12:21:37.974679  6610 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:38.107525  6490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.020s	sys 0.037s
I20260709 12:21:37.994761  6551 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
W20260709 12:21:38.135046  3920 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.546s	user 0.015s	sys 0.009s
I20260709 12:21:38.043560  6557 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:38.131798  6642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.028s	sys 0.059s
I20260709 12:21:38.178472  3920 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:38.139303  3848 rpcz_store.cc:276] 0709 12:21:36.573202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.575592 (+  2390us) service_pool.cc:224] Handling call
0709 12:21:36.575906 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.960253 (+384347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.138515 (+1178262us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54000a4bd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:38.138731 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882178304}
I20260709 12:21:38.111728  6492 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:38.203068  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 328534us
W20260709 12:21:38.183166  6207 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.666s	user 0.016s	sys 0.008s
I20260709 12:21:38.155966  6531 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.159760  6474 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:38.125936  6626 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:38.190524  6660 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:38.129575  6292 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:38.213600  6502 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.010s
I20260709 12:21:38.200871  6549 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:38.222653  4577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.018s	sys 0.013s
W20260709 12:21:38.248059  4577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.019s	sys 0.013s
I20260709 12:21:38.212644  6529 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:38.219980  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35180 (request call id 377) took 1065 ms. Trace:
I20260709 12:21:38.219035  6540 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.177767  6669 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.261459  6148 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.325940  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 333605us
I20260709 12:21:38.223982  6474 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.325671  6502 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.329919  6670 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.327366  6679 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:38.344121  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 403704us
W20260709 12:21:38.345436  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.335421  6569 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.329677  6148 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.364002  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:38.367717  6531 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.368415  6531 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.371097  6531 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:38.372177  6492 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:38.344888  6502 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.374714  6148 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.376053  6490 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:21:38.390051  6673 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:21:38.396220  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:38.396756  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.398124  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:38.400584  6669 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.402278  6474 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.352182  6679 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.405555  6679 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.412817  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:38.411032  6618 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.414251  6641 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:38.416283  6557 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.265252  4579 rpcz_store.cc:276] 0709 12:21:37.150646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.150781 (+   135us) service_pool.cc:224] Handling call
0709 12:21:37.151159 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:37.151636 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.151683 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:37.152349 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 12:21:37.200096 (+ 47747us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.597874 (+397778us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.112783 (+514909us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.155747 (+ 42964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.181067 (+ 25320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.189740 (+  8673us) raft_consensus.cc:1685] finished
0709 12:21:38.189767 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.216201 (+ 26434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6072,"prepare.queue_time_us":511529,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":6256,"raft.queue_time_us":128767,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":25953,"thread_start_us":721668,"threads_started":3,"wal-append.queue_time_us":161787}
I20260709 12:21:38.420547  6643 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:38.383848  6253 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:38.377342  6678 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:21:38.377444  6292 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:38.322530  6610 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:38.378587  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 360900us
I20260709 12:21:38.385933  6626 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:38.386444  6681 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:38.388536  6502 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:38.430498  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85601.9us
I20260709 12:21:38.436350  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:38.423369  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:38.427739  6543 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.428593  6474 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.435242  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:38.433442  6692 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.442397  6474 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.442723  6692 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.421967  6618 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:38.449821  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:38.493132  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58015.8us
I20260709 12:21:38.494917  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.496086  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:38.498929  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51950.9us
I20260709 12:21:38.434020  6696 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:38.511996  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.045s
W20260709 12:21:38.513212  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.014s	sys 0.046s
W20260709 12:21:38.444885  6677 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 12:21:38.591148  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.512646  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:38.494242  6531 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.457623  6618 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:38.448988  6549 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:38.493502  6253 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:38.591300  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 95301.8us
W20260709 12:21:38.592590  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80032.8us
I20260709 12:21:38.451768  6666 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.451136  6502 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.594380  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:38.623114  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 186880us
I20260709 12:21:38.631278  3922 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:38.631417  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:38.632378  3920 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:38.600411  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:38.633517  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:38.633780  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:38.514273  6696 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:38.589864  6627 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.634929  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 265021us
I20260709 12:21:38.596969  6207 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:38.588553  6692 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.682966  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:38.672299  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45997.7us
I20260709 12:21:38.677950  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:38.600718  6569 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.602981  6474 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.596725  6700 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:38.645506  6640 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.648238  6642 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:21:38.510402  6689 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 12:21:38.590667  6641 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:21:38.638392  6253 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.686825  6627 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.623999  6292 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:38.686348  6385 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:38.634230  6466 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:21:38.627033  6549 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.632794  6502 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 12:21:38.733882  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48645.5us
I20260709 12:21:38.699980  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.715255  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1901) took 1140 ms. Trace:
I20260709 12:21:38.733179  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.700373  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.736043  3919 rpcz_store.cc:276] 0709 12:21:37.575282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.575423 (+   141us) service_pool.cc:224] Handling call
0709 12:21:37.575823 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.697041 (+121218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.714965 (+1017924us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400077954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:38.715185 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274625920}
I20260709 12:21:38.728077  3842 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:21:38.739156  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61303.8us
W20260709 12:21:38.688288  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 175151us
I20260709 12:21:38.729144  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.697857  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1614) took 1163 ms. Trace:
I20260709 12:21:38.739321  3845 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:38.742553  3924 rpcz_store.cc:276] 0709 12:21:37.534623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.534762 (+   139us) service_pool.cc:224] Handling call
0709 12:21:37.535049 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:37.565163 (+ 30114us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:38.132248 (+567085us) log.cc:844] Serialized 14 byte log entry
0709 12:21:38.360441 (+228193us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.361107 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.361258 (+   151us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:38.361296 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.361372 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.697610 (+336238us) raft_consensus.cc:1685] finished
0709 12:21:38.697638 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.697786 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31395,"prepare.queue_time_us":618723,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":22237,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12636,"spinlock_wait_cycles":45367168,"thread_start_us":687673,"threads_started":2,"wal-append.queue_time_us":413306}
W20260709 12:21:38.758414  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 124715us
I20260709 12:21:38.697854  6690 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 12:21:38.707468  6696 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.789686  6696 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.791589  6474 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:38.600823  6666 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.799330  6474 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.738250  6569 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.799928  6474 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.690712  6669 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.712463  6106 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:38.716434  6695 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:21:38.717036  6684 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:21:38.690640  6207 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:38.718231  6292 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.754833  6469 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:38.814131  6426 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.709383  6634 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:38.709529  6683 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:38.685349  6693 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.715358  6627 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.723214  6549 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.749413  6385 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:38.814961  3847 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:38.804463  6706 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:21:38.827351  6106 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:38.832696  3850 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:38.710055  6253 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.843583  6709 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:38.856050  6385 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.705506  6618 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.856703  6106 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.864563  6709 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.864821  6207 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.857658  6469 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:38.887876  6469 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.888772  6472 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.865942  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 297) took 1406 ms. Trace:
I20260709 12:21:38.889631  4581 rpcz_store.cc:276] 0709 12:21:37.459702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.459861 (+   159us) service_pool.cc:224] Handling call
0709 12:21:37.460193 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:37.913390 (+453197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.913425 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.939968 (+ 26543us) log.cc:844] Serialized 26 byte log entry
0709 12:21:38.346904 (+406936us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:38.346945 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.347024 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:38.865580 (+518556us) raft_consensus.cc:1685] finished
0709 12:21:38.865612 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.865850 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25241,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":772423,"threads_started":2,"wal-append.queue_time_us":477478}
I20260709 12:21:38.833277  6692 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:38.899705  6692 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.846817  6426 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.902354  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 1013) took 1495 ms. Trace:
I20260709 12:21:38.863021  6683 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.902841  3850 rpcz_store.cc:276] 0709 12:21:37.406503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.406625 (+   122us) service_pool.cc:224] Handling call
0709 12:21:37.414073 (+  7448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:38.847965 (+1433892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.902080 (+ 54115us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001199d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:38.902276 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3262042368}
I20260709 12:21:38.692204  6700 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.858351  6634 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.927912  6618 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.958983  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:38.959782  3924 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:38.963116  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:38.968458  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:38.936478  6630 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.962198  6580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.507s	user 0.010s	sys 0.007s
I20260709 12:21:38.984525  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:38.987418  3848 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:38.987844  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:38.988799  3845 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
W20260709 12:21:38.994215  6711 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:21:38.994078  6710 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:38.994742  6627 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.994978  6710 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.995296  6627 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:38.996549  6385 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.975009  6551 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:38.997651  6627 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.997855  6551 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:38.998590  6706 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.998908  6551 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:38.981060  6580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.531s	user 0.010s	sys 0.007s
I20260709 12:21:38.999224  6706 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.981266  6630 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.997400  6710 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.991012  6549 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:21:38.975720  6638 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:39.035548  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.001648  6706 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.047184  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.047950  3998 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:39.037134  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.029624  6630 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.029486  6292 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.032821  6700 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.033437  6474 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:38.998027  6713 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.052086  6714 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.054826  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.072090  3990 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:39.073212  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.073640  3996 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:39.056334  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:39.074784  3994 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.034081  6669 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.062261  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.064988  3992 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:39.065671  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.066360  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.033681  6683 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.070070  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.070312  6713 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:38.987058  6569 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:38.998664  6709 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.060621  6693 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.071177  6710 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.078928  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.036540  6638 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.082324  3999 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:39.080888  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.068715  6586 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.051252  4581 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:39.138064  3994 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:39.103638  6701 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.103756  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.141201  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.101872  6630 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.104911  6715 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:39.105499  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.106673  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:39.107120  6713 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.059669  6627 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.071283  6549 consensus_queue.cc:1243] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:39.035555  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:39.117265  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:39.129068  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48464.1us
I20260709 12:21:39.143931  3994 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:39.143318  3996 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:39.141855  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.130817  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.109349  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.089726  6669 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.077198  6714 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.273754  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.143569  3999 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:39.274253  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:39.275830  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.275910  3992 raft_consensus.cc:2410] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:21:39.283847  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 248383us
I20260709 12:21:39.291465  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:39.157871  6531 consensus_meta.cc:287] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.009s
W20260709 12:21:39.336400  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50587.1us
I20260709 12:21:39.141147  6638 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.141463  6541 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.311681  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:39.338060  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58265.3us
I20260709 12:21:39.352586  3995 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:39.340965  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.126447  6666 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.126719  6385 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:39.355949  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.359869  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:39.288524  6670 consensus_meta.cc:287] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.929s	user 0.016s	sys 0.004s
I20260709 12:21:39.227293  6640 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.286713  6492 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.221922  6686 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.283234  6609 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.295600  6547 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.130671  6693 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.159193  6551 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.355106  6668 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:39.149963  6586 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.350315  6531 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.375240  6670 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.391398  6661 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.335254  6704 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.363989  6713 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:39.415117  3991 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:39.345387  6474 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:21:39.172777  6634 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.390841  6722 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.289279  6630 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.145334  6426 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.168232  6701 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.382840  6547 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.405011  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:39.406203  6586 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.398840  6668 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.447094  6668 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.408895  6551 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.375118  6385 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.409308  6704 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.410926  6490 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:39.141817  6710 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.374820  6106 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:21:39.416594  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1976) took 1433 ms. Trace:
I20260709 12:21:39.466681  3997 rpcz_store.cc:276] 0709 12:21:37.983106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.983402 (+   296us) service_pool.cc:224] Handling call
0709 12:21:37.983996 (+   594us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:38.598804 (+614808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:38.598833 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:38.648725 (+ 49892us) log.cc:844] Serialized 52 byte log entry
0709 12:21:38.833069 (+184344us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:38.833122 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:38.835008 (+  1886us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.416360 (+581352us) raft_consensus.cc:1685] finished
0709 12:21:39.416378 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.416528 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275889,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9824,"spinlock_wait_cycles":2816,"thread_start_us":603005,"threads_started":2,"wal-append.queue_time_us":255693}
I20260709 12:21:39.420145  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.379794  6640 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.386236  6609 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.390079  6492 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.475818  6704 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.463725  6490 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:39.476951  6492 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.385960  6686 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.479604  6686 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.434429  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.288532  6627 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:39.439011  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 93779.8us
I20260709 12:21:39.481029  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.482010  6627 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.482636  6627 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:39.483019  6627 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.483078  6640 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.483513  6627 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:39.407212  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.362462  6541 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.447584  6622 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.448407  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.449193  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.449893  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.498653  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.499711  3846 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:39.500946  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.450570  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.448436  6694 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.453564  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.419486  6713 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.416767  6661 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.455745  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.459676  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.436800  6634 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.433722  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.453384  6547 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:39.480872  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46545.8us
I20260709 12:21:39.527698  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.485981  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.454648  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.506963  3848 raft_consensus.cc:2393] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 3: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:39.439198  6722 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.529131  3844 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:39.536355  3842 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:39.493955  6686 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.487224  6618 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:39.561398  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 105982us
I20260709 12:21:39.569754  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:39.503947  6640 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.570858  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:39.577867  3846 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.544973  6704 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:39.585297  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.587003  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.588102  3848 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:39.590770  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:39.578881  6723 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:21:39.555083  4574 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:39.512248  6622 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.511984  6701 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.574605  6714 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.575831  6669 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.600940  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.536839  6634 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:39.612686  3963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.024s	sys 0.018s
W20260709 12:21:39.613133  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 185350us
I20260709 12:21:39.589564  6704 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.594034  6492 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:39.647015  3963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.024s	sys 0.020s
I20260709 12:21:39.647468  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.578917  6618 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.648370  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.694676  3888 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.579794  6640 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.609030  6693 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.698797  3997 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:39.698661  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:39.699414  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52069.4us
W20260709 12:21:39.699465  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.700531  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.642002  6445 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.708660  6445 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.709270  6713 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.648535  6704 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:39.709620  6586 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:39.705535  6683 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.712615  6106 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:39.713213  6106 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.714294  6323 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.642007  6701 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.714823  6323 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.723892  3846 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:39.725381  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.725643  6323 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.716938  6640 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.718581  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.719513  6694 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.721761  6106 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.722294  6713 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:39.723373  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.726624  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:39.727312  6724 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:21:39.727824  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:39.726492  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.791707  3846 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:39.728590  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.729630  6634 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.733946  6469 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:39.776760  6712 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.816s	user 0.001s	sys 0.006s
W20260709 12:21:39.745416  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 607850us
I20260709 12:21:39.746374  6725 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.700908  6723 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 12:21:39.748515  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.786981  6661 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.695048  6492 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:39.753873  6710 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.753998  6490 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.756603  6474 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.757652  6609 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.723838  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.760591  6727 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:39.768800  3964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.822s (SENT) [suppressed 37 similar messages]
I20260709 12:21:39.823722  6727 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:39.809113  6501 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:39.714989  6701 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.799314  6106 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:39.801486  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78200.1us
W20260709 12:21:39.829027  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 167968us
I20260709 12:21:39.830541  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.831389  6710 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.802769  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.804908  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.792932  6713 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.806109  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.767102  6385 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.741942  6692 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.809263  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.835289  4578 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:39.810701  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.813225  3847 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:39.751140  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.823153  6490 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.706849  6630 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.808153  6726 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:39.835343  3846 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:39.771312  6722 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.818634  6492 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.834137  3888 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.842792  3847 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:39.814265  6469 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.816210  6725 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.885279  6725 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.858886  6547 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.893141  6622 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.893404  6547 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.894280  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.897809  6445 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:39.899633  6638 consensus_meta.cc:287] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 12:21:39.900115  6638 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.901468  4575 raft_consensus.cc:2368] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
I20260709 12:21:39.902758  6638 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.905788  6725 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.907644  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.910605  6725 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:39.911017  6725 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.911373  6725 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:39.912195  6541 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.916316  6627 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.918864  6627 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.921831  6725 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.924225  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.852049  6466 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:39.852808  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:39.933876  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99864.3us
W20260709 12:21:39.934151  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81402.5us
I20260709 12:21:39.855756  6701 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.856509  4579 raft_consensus.cc:2410] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:39.857930  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.963909  3925 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:39.858316  6543 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:39.846323  6630 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:39.841625  6106 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.969153  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.862012  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.969921  3921 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:39.825412  6474 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:39.830399  6727 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.864339  6713 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:39.864503  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.977908  3922 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:39.979084  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:39.979898  3922 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.865356  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.869419  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.982154  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.982275  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.982820  3920 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:39.866464  6469 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:39.873070  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.874886  6618 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:39.875233  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.834581  6501 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.003829  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:40.004997  6501 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:40.005200  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.849635  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.006239  3924 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:40.006340  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:40.007519  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.008626  3924 raft_consensus.cc:2410] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:21:39.937198  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.939047  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.940263  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.944469  4577 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:39.950879  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.010878  3848 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:39.937983  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:39.967077  6731 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.964479  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.971078  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.017927  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.018654  3921 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 3.
I20260709 12:21:39.966223  6704 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:39.966281  6323 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.871537  3916 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:39.969709  6292 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:39.984380  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.988303  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.037343  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:39.996141  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:39.998128  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.997429  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:39.945482  6733 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:39.933674  6466 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:39.995414  6631 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:21:40.007076  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:39.955000  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:39.956815  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:40.053224  3923 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:40.013854  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.054694  3924 raft_consensus.cc:2410] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:40.007190  3847 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:40.020255  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:40.021322  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56928us
I20260709 12:21:39.994369  6531 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:21:40.029956  3922 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:39.984014  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.031414  6627 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:40.031692  6323 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.038761  3918 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:40.068327  3924 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:39.999065  3917 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
W20260709 12:21:40.040189  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55931.9us
W20260709 12:21:40.041510  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44195.4us
I20260709 12:21:40.043375  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.044131  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.070863  3916 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:40.014183  6622 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:40.014328  6640 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:21:40.073211  3917 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:40.047286  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51271.5us
I20260709 12:21:40.074003  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.049288  4576 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:40.017354  6731 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.056891  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:39.968209  6543 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:40.000370  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:40.037410  3925 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:40.032001  6729 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.973251  6630 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.058925  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.087507  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:40.080664  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:40.052474  6541 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:39.999892  6547 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:21:40.000102  6445 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:21:40.078562  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.042032  6733 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:40.064213  6696 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.274s	user 0.015s	sys 0.006s
I20260709 12:21:40.056677  6710 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:40.065141  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.057598  6737 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:40.079926  6549 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:40.058830  6610 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:40.049713  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:40.072940  6323 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:40.156222  6738 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:21:40.050853  6501 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:21:40.068069  6627 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:40.157563  6610 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:40.157773  6627 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.158068  6610 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:40.159044  6610 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.173321  6667 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.173967  6667 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.042642  6292 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.110699  3923 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:40.080511  6731 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.121713  6466 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.098208  3962 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:40.192302  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 94184.4us
I20260709 12:21:40.195374  6667 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:40.084532  6644 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:40.087738  6701 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:40.123574  6710 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:40.124823  6558 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:40.112206  6426 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.132421  6728 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:21:40.135761  6543 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.137009  6630 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:40.139297  6106 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:40.144065  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:40.149101  6704 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.149732  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:40.106923  6661 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:40.107488  6733 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:40.061945  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 293186us
I20260709 12:21:40.238413  6668 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:40.253437  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:40.186892  6725 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:40.262247  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.248281  6701 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:40.238200  6710 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:40.265573  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 186769us
W20260709 12:21:40.266610  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 188125us
I20260709 12:21:40.272105  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.107285  6692 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:21:40.248926  6426 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.283211  3991 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:40.283362  3996 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:40.284240  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.302527  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.285363  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.285542  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.306911  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.308346  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.309101  3994 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:40.310645  3994 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:40.311734  3997 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:40.287761  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.253222  6644 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:40.320755  3993 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:40.322134  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.327208  3998 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:40.329968  3995 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:40.277493  6668 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.334684  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.289992  6543 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:40.353859  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 58899.3us
W20260709 12:21:40.354511  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59124us
I20260709 12:21:40.289698  6666 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.373468  6666 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.375874  6666 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.327749  6622 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:21:40.381794  3996 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:40.385330  6644 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.358529  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.299582  6466 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.294214  6661 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:40.371968  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.297608  6586 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:40.319985  6426 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.328824  6474 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.405624  3995 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:21:40.576340  3995 pending_rounds.cc:85] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 3
I20260709 12:21:40.576880  3995 pending_rounds.cc:107] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:21:40.577247  3995 raft_consensus.cc:2889] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:40.434448  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.578377  3994 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 2.
I20260709 12:21:40.365427  6668 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:40.583308  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.458886  3991 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:40.591028  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:40.594662  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 222798us
I20260709 12:21:40.596071  6474 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.595898  6661 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.498958  6662 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:40.595532  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:40.600250  6292 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:40.406139  6725 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 12:21:40.600798  6474 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.601593  6474 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.602000  6474 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:40.602258  6492 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.004s
I20260709 12:21:40.602735  6492 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.586508  6701 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.621411  6323 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.622741  3990 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:40.542199  6618 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:40.627934  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.626718  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.657343  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.581395  6627 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.664429  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:40.665179  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 77604.2us
I20260709 12:21:40.668099  3916 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:40.630708  6618 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:40.654587  6466 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:40.682739  6755 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:40.683017  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.689816  3921 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:40.697211  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.692453  6466 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.718627  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.788486  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:40.717182  6761 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.811842  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:40.814298  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.819589  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.820951  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.822154  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.822790  3923 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:40.823902  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:40.824373  6753 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:21:40.825147  6492 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:40.826723  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.827354  3923 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:40.827092  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.828197  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.828410  3918 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:40.828768  3923 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:40.829355  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.829661  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.830261  3923 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:21:40.834617  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.836380  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.837549  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.839907  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.840631  3918 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:40.841499  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.720208  6618 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:40.871272  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:40.802858  6761 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.839661  6492 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.845333  6323 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:40.874630  6733 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.004s
I20260709 12:21:40.894090  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.895318  3991 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:40.897671  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.899863  3991 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:40.900854  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.865386  6622 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:40.888639  6609 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:40.906893  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:40.926357  3991 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:40.896384  6618 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.928332  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.900137  6627 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.889595  6474 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.892781  6492 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.900645  6733 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:40.963665  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.948966  6771 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:40.955595  6640 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:40.945019  6763 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:21:40.955193  6741 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.716s	user 0.000s	sys 0.002s
I20260709 12:21:40.969023  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:40.981153  3925 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:40.981266  3991 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 2.
I20260709 12:21:40.968336  6771 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:40.970048  6640 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:40.974692  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67886.8us
I20260709 12:21:40.976723  6733 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.977032  6772 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:40.968940  6727 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.991s	user 0.014s	sys 0.000s
I20260709 12:21:40.977245  3922 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:40.964020  6725 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.986398  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:40.999414  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:40.989606  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:40.955235  6761 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:40.993366  6640 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:40.993708  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:40.997089  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:41.003727  3995 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.006258  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:40.997162  6543 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:21:41.008504  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:41.009091  3918 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:41.011288  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:41.012969  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:41.015425  6474 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.016640  6771 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.018004  6771 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:41.015550  6469 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.990641  6466 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.020296  3923 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:41.444361  6765 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:41.471724  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:41.477272  3850 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
W20260709 12:21:41.409755  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:41.483139  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.484149  4583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 365) took 1519 ms. Trace:
W20260709 12:21:41.323585  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 236440us
W20260709 12:21:41.115330  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.118135  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:41.111594  6426 consensus_meta.cc:287] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 12:21:41.484586  4583 rpcz_store.cc:276] 0709 12:21:39.965195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.965326 (+   131us) service_pool.cc:224] Handling call
0709 12:21:39.967430 (+  2104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.967665 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:40.188802 (+221137us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.438623 (+249821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.438676 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:40.438731 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.438798 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.878054 (+439256us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18003b9ce0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8d42a6 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4
0709 12:21:41.483955 (+605901us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b54004b6c50. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:41.484092 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290452,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":616,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":125,"spinlock_wait_cycles":44676736,"thread_start_us":443557,"threads_started":2,"wal-append.queue_time_us":476779}
W20260709 12:21:41.007238  6731 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.006s
I20260709 12:21:41.119158  3997 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:41.491707  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:41.161666  6764 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.442s	user 0.001s	sys 0.001s
I20260709 12:21:41.002030  6727 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.004681  6725 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:41.498669  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:41.464031  6644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.012s	sys 0.008s
I20260709 12:21:41.509975  3918 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:41.503012  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:41.553027  3850 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:41.511338  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:41.524595  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:41.037339  6253 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:41.020617  6772 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:41.061975  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:41.112836  6776 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:21:41.564378  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:41.507596  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1998) took 1220 ms. Trace:
I20260709 12:21:41.565202  3997 rpcz_store.cc:276] 0709 12:21:40.287270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.118441 (+831171us) service_pool.cc:224] Handling call
0709 12:21:41.118785 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.497288 (+378503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.507472 (+ 10184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:41.053874  6609 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:41.555372  3847 raft_consensus.cc:1217] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:21:41.571280  3847 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:41.012739  6445 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:41.453651  6713 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:41.162024  6756 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.560s	user 0.002s	sys 0.000s
W20260709 12:21:41.250478  6759 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
W20260709 12:21:41.158021  6767 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:21:41.476539  6469 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:41.106773  6668 consensus_meta.cc:287] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.002s
W20260709 12:21:41.114099  6710 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.002s
W20260709 12:21:41.410935  6768 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 12:21:41.563501  6733 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:41.560947  6253 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:41.491464  6549 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.568372  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:41.513841  6781 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:21:41.510293  6426 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.497829  6474 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.516489  6207 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:41.624619  6207 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.627053  6207 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.487460  6466 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:41.627686  6466 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.629791  6466 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.569514  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:41.630650  6687 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:41.510946  6769 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 12:21:41.631273  6687 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.271292  3995 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:21:41.551864  6644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.013s	sys 0.016s
I20260709 12:21:41.064826  6729 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:41.087584  6662 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:41.337512  6661 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:41.060633  6492 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:41.588637  3923 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:41.622207  6253 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.538920  6683 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:41.606187  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:41.613154  6640 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:41.488790  6765 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.563532  6772 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.578271  6713 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:41.575798  6445 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:41.520304  6731 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.624675  6474 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.487469  6771 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:41.610321  6469 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:41.648269  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 147751us
I20260709 12:21:41.650256  6661 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.577260  6609 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.703675  6609 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:41.622352  6733 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.642468  6729 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:41.708293  6729 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.709442  6729 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.633425  6549 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.647652  6662 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:41.651738  6646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.009s
I20260709 12:21:41.619802  6710 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.614837  6668 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:41.696182  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44966.8us
I20260709 12:21:41.696321  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2004) took 1330 ms. Trace:
I20260709 12:21:41.663751  6683 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.695833  6771 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:41.702363  6765 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.727137  6549 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:41.725963  6646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.009s
I20260709 12:21:41.727671  6710 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:41.727965  6426 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.619166  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:41.617944  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:41.607923  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:41.631132  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:41.603066  3919 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:41.636833  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1635) took 1760 ms. Trace:
I20260709 12:21:41.661926  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1919) took 1034 ms. Trace:
I20260709 12:21:41.657430  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2008) took 1227 ms. Trace:
I20260709 12:21:41.651876  3994 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.730127  6474 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.691916  6445 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.036880  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.084705  3992 rpcz_store.cc:276] 0709 12:21:40.430510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.430735 (+   225us) service_pool.cc:224] Handling call
0709 12:21:40.572509 (+141774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.572762 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:40.657294 (+ 84532us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.863600 (+206306us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.976542 (+112942us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800353fe0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f906522 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:21:41.157378 (+180836us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:41.656898 (+499520us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b1800353fe0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287 00007fdc52a0e208
0709 12:21:41.657063 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.657119 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:41.657170 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.657241 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.657366 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":770569,"prepare.queue_time_us":132869,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":98,"raft.queue_time_us":796826,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":11603,"spinlock_wait_cycles":15515648,"thread_start_us":276351,"threads_started":2,"wal-append.queue_time_us":252429}
I20260709 12:21:42.087809  3845 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:42.085662  6474 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:41.733820  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.089150  6474 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.050709  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.093106  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.093346  6474 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.094151  6474 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:41.715232  3998 rpcz_store.cc:276] 0709 12:21:40.365825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.366030 (+   205us) service_pool.cc:224] Handling call
0709 12:21:40.392104 (+ 26074us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:40.392725 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.392769 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:40.393632 (+   863us) log.cc:844] Serialized 52 byte log entry
0709 12:21:41.119852 (+726220us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800412600. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1
0709 12:21:41.120023 (+   171us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:41.120353 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.161401 (+ 41048us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:41.695968 (+534567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.696056 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:41.696099 (+    43us) raft_consensus.cc:1685] finished
0709 12:21:41.696112 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:41.696259 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580439,"prepare.queue_time_us":5019,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":579919,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6006,"spinlock_wait_cycles":71569024,"thread_start_us":16887,"threads_started":1,"wal-append.queue_time_us":207437}
I20260709 12:21:42.089159  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.039773  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1654) took 1205 ms. Trace:
W20260709 12:21:42.138828  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.055083  3920 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:41.731807  3999 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:42.056805  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1945) took 1239 ms. Trace:
W20260709 12:21:42.016634  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.020s
I20260709 12:21:42.058859  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1921) took 1429 ms. Trace:
I20260709 12:21:42.037657  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.100823  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:42.034801  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.026808  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.096263  3918 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:42.179035  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.005s	sys 0.028s
I20260709 12:21:42.171617  3917 rpcz_store.cc:276] 0709 12:21:40.834353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.644272 (+809919us) service_pool.cc:224] Handling call
0709 12:21:41.644552 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.035691 (+391139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.035762 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.035823 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:42.035857 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.039056 (+  3199us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001cf054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:42.039143 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.039406 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897855360}
I20260709 12:21:42.034373  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.036990  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.188820  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2007) took 1724 ms. Trace:
I20260709 12:21:42.175282  3923 rpcz_store.cc:276] 0709 12:21:40.817504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.508615 (+691111us) service_pool.cc:224] Handling call
0709 12:21:41.509081 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.646718 (+137637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.056033 (+409315us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54000212d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:42.056527 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182004992}
W20260709 12:21:42.183254  3889 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.009s
W20260709 12:21:42.190198  3991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.005s
I20260709 12:21:42.072520  3993 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:42.203789  3922 rpcz_store.cc:276] 0709 12:21:40.627178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.629874 (+  2696us) service_pool.cc:224] Handling call
0709 12:21:40.660317 (+ 30443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.996143 (+335826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.661689 (+665546us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540036f6d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:41.661859 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728394112}
W20260709 12:21:42.205343  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.212024  6754 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.213095  6754 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.214545  6531 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.215883  6573 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:42.215569  6531 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.216678  6573 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.218434  6531 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.189424  3996 rpcz_store.cc:276] 0709 12:21:40.420045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.420199 (+   154us) service_pool.cc:224] Handling call
0709 12:21:40.420625 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:40.663161 (+242536us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:40.876791 (+213630us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.658229 (+781438us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.658762 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:21:41.658924 (+   162us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:41.658957 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.659022 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:41.662681 (+  3659us) raft_consensus.cc:1685] finished
0709 12:21:41.662699 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.084069 (+421370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739977,"prepare.queue_time_us":57992,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":741826,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":261014,"threads_started":3,"wal-append.queue_time_us":90463}
I20260709 12:21:42.095923  6385 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.099774  3921 rpcz_store.cc:276] 0709 12:21:39.875966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.069326 (+193360us) service_pool.cc:224] Handling call
0709 12:21:40.069660 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.690456 (+620796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.636580 (+946124us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003f5054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:41.636759 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425572608}
I20260709 12:21:41.690904  6640 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.219394  6573 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.222389  6638 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:42.246236  6638 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.959887  6668 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.249325  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1626) took 2399 ms. Trace:
I20260709 12:21:42.249488  6638 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.220100  3848 raft_consensus.cc:2410] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:42.231402  6385 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.250753  3843 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
W20260709 12:21:42.222468  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.16034e+06us
I20260709 12:21:42.252280  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.252444  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:42.223055  6722 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:41.710597  6704 consensus_queue.cc:1175] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 12:21:42.176808  3925 rpcz_store.cc:276] 0709 12:21:40.629471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.629583 (+   112us) service_pool.cc:224] Handling call
0709 12:21:40.667999 (+ 38416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.981722 (+313723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.058128 (+1076406us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002440d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:42.058602 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719703808}
W20260709 12:21:42.239674  3991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.003s	sys 0.005s
I20260709 12:21:42.142958  6736 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:42.253213  3843 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:42.096275  6426 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.095353  6474 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:41.691671  6772 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:42.254712  3889 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.000s	sys 0.010s
I20260709 12:21:42.240514  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.134646  6543 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:42.483610  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.249789  3919 rpcz_store.cc:276] 0709 12:21:39.849524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.849644 (+   120us) service_pool.cc:224] Handling call
0709 12:21:39.849943 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.248194 (+2398251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.248933 (+   739us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400340654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:42.249151 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3989353856}
W20260709 12:21:42.230609  3999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1993) took 1944 ms (client timeout 1984 ms). Trace:
I20260709 12:21:42.336635  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.239106  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 393) took 1122 ms. Trace:
I20260709 12:21:42.019018  3747 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 4 to 5, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:42.242194  6754 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.481156  3922 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:42.499697  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.220275  6610 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.500617  3843 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.306542  3845 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:21:42.352115  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 244086us
W20260709 12:21:42.495301  3999 rpcz_store.cc:269] 0709 12:21:40.286084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.287386 (+  1302us) service_pool.cc:224] Handling call
0709 12:21:42.229966 (+1942580us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002f8ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:42.230262 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3256718080}
I20260709 12:21:41.801234  6661 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.967305  6725 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.496177  3916 rpcz_store.cc:276] 0709 12:21:41.116557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.647906 (+531349us) service_pool.cc:224] Handling call
0709 12:21:41.648315 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.237181 (+588866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.237223 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.237280 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:42.237319 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.238655 (+  1336us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003043d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:42.238705 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.238895 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353310464}
I20260709 12:21:41.960553  6687 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.475315  6385 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:41.921644  6727 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.238888  6640 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:41.920425  6731 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.260581  6722 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:42.425796  6701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.569s	user 0.007s	sys 0.012s
I20260709 12:21:41.731177  6683 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:41.953572  6733 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.523514  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:42.523739  6785 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.796824  6713 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.526391  3747 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.527745  3917 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:21:42.527678  3920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1650) took 2637 ms (client timeout 2068 ms). Trace:
I20260709 12:21:42.250291  6445 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.529055  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:42.530278  3924 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.005s	sys 0.004s
W20260709 12:21:42.533463  6609 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.008s
I20260709 12:21:42.534525  3843 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:42.558557  6609 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.517926  3994 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:42.559165  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.559866  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 1020) took 1498 ms. Trace:
I20260709 12:21:42.560053  3843 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:42.560214  3994 rpcz_store.cc:276] 0709 12:21:41.061225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.564910 (+503685us) service_pool.cc:224] Handling call
0709 12:21:42.559763 (+994853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:42.540057  6736 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.541649  6644 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.561352  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.561481  6644 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.562633  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.563859  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.564052  6644 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.565055  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.566041  3847 raft_consensus.cc:2393] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:21:42.550472  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 298211us
W20260709 12:21:42.552158  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 919230us
I20260709 12:21:42.563189  6736 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.554327  3841 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:42.565713  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:42.555011  3920 rpcz_store.cc:269] 0709 12:21:39.889744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.983767 (+ 94023us) service_pool.cc:224] Handling call
0709 12:21:42.509365 (+2525598us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400215f54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:42.527564 (+ 18199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4579916672}
I20260709 12:21:42.351380  6771 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:42.569716  3924 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.005s	sys 0.005s
I20260709 12:21:42.565846  3843 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:42.522437  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:42.552561  6701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.932s	user 0.011s	sys 0.019s
I20260709 12:21:42.547307  6722 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.573119  6501 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.571640  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.573447  6785 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.578336  3848 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.555415  6385 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:42.579120  6445 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.570583  6668 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:42.587227  6501 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.587513  6385 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.588120  3747 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 3, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 3 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:21:42.573503  6713 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.596024  6687 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:42.577834  6662 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.846s	user 0.002s	sys 0.017s
I20260709 12:21:42.558043  6754 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:42.613540  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.621268  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.631093  6662 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:42.618734  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99444.3us
I20260709 12:21:42.636569  6662 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.608462  6668 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:42.569500  6426 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.646967  6704 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:42.648105  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:42.639302  6573 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.651314  6609 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:42.659606  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.660238  6573 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.662523  6754 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.664057  6573 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.664916  6754 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.668551  6385 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.656013  6704 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.669987  6704 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.677969  6501 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.680896  6785 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.681589  6618 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.677605  6469 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.983s	user 0.009s	sys 0.011s
I20260709 12:21:42.682250  6618 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.644536  6668 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:42.690174  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.634366  6771 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.623021  6722 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.700591  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.704257  3843 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.616828  6543 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:42.679590  6253 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.021s	user 0.017s	sys 0.002s
I20260709 12:21:42.715927  6618 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.716595  6253 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:42.724999  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81062.2us
I20260709 12:21:42.725497  6662 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:42.725996  6662 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.726444  6662 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:42.729681  3993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 2002) took 2397 ms (client timeout 1926 ms). Trace:
W20260709 12:21:42.730237  3993 rpcz_store.cc:269] 0709 12:21:40.332748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.334332 (+  1584us) service_pool.cc:224] Handling call
0709 12:21:42.729373 (+2395041us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400002154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:42.729541 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3943132544}
I20260709 12:21:42.732663  6474 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.733017  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.734308  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.736260  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.736505  6573 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:42.737084  6573 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.737728  6573 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:42.734373  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.739903  6710 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:42.740582  6710 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:42.741065  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 1059) took 1133 ms. Trace:
I20260709 12:21:42.741837  6710 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:42.743203  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 130012us
I20260709 12:21:42.744447  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:42.745512  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.747471  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.748435  3849 raft_consensus.cc:2410] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:21:42.750984  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:42.753659  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 98750.6us
I20260709 12:21:42.741642  3847 rpcz_store.cc:276] 0709 12:21:41.607530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.607666 (+   136us) service_pool.cc:224] Handling call
0709 12:21:42.740749 (+1133083us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54002ad354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:42.740959 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070546304}
I20260709 12:21:42.691632  3747 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.709069  6771 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.759891  6754 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:42.719362  6253 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.778589  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.779379  3843 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:42.701735  6469 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.789570  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.799500  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.800415  3843 raft_consensus.cc:2410] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:21:42.801191  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.802211  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.807070  3850 raft_consensus.cc:2368] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9.
I20260709 12:21:42.775149  6662 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.812381  6662 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.815995  6426 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.816880  6771 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.822172  6668 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.822793  6722 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.823923  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1016) took 1800 ms. Trace:
I20260709 12:21:42.825213  6722 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.824357  3997 rpcz_store.cc:276] 0709 12:21:41.023379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.566425 (+543046us) service_pool.cc:224] Handling call
0709 12:21:41.566915 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:41.714433 (+147518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.714470 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:41.774011 (+ 59541us) log.cc:844] Serialized 52 byte log entry
0709 12:21:42.374164 (+600153us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:42.777774 (+403610us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.786733 (+  8959us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.794032 (+  7299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.804605 (+ 10573us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.809612 (+  5007us) raft_consensus.cc:1685] finished
0709 12:21:42.809628 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.823734 (+ 14106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154230,"raft.queue_time_us":232710,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":445,"thread_start_us":342820,"threads_started":2,"wal-append.queue_time_us":298441}
I20260709 12:21:42.825917  6722 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.789281  6618 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:42.827831  6618 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.828961  6731 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:42.829458  6731 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.829859  6731 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.831523  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1950) took 1278 ms. Trace:
I20260709 12:21:42.832911  6543 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.831919  3924 rpcz_store.cc:276] 0709 12:21:41.528279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.653620 (+125341us) service_pool.cc:224] Handling call
0709 12:21:41.653922 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.654073 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:42.578849 (+924776us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.753448 (+174599us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.765128 (+ 11680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.770750 (+  5622us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:42.770835 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.782721 (+ 11886us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.806667 (+ 23946us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62970,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":23610,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":95,"spinlock_wait_cycles":8003456,"thread_start_us":977331,"threads_started":2,"wal-append.queue_time_us":203537}
W20260709 12:21:42.833639  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.835336  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.810375  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:42.838348  6765 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:42.841931  6469 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:42.842694  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:42.843958  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65448.7us
I20260709 12:21:42.844964  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:42.847944  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:42.849565  6426 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:42.850569  6426 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:42.852376  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 47067.6us
I20260709 12:21:42.855939  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:42.856635  3843 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.808936  3848 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:42.860908  3849 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:42.847045  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.843087  6573 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:42.863660  3747 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 5, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:42.881613  6573 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.885051  3845 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:42.887112  6543 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:42.887816  6543 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:42.888316  6543 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.888748  6722 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.891166  6668 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:42.876016  6426 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:42.913666  6426 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.926715  3843 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:42.929275  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.931526  4583 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:42.920086  6426 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.943596  3842 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:42.943876  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1013) took 1939 ms. Trace:
I20260709 12:21:42.948558  3848 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.945261  3747 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:42.960582  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.967094  3848 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:42.947362  3991 rpcz_store.cc:276] 0709 12:21:41.004458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.004890 (+   432us) service_pool.cc:224] Handling call
0709 12:21:41.005226 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.660591 (+655365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.660631 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.661055 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.541117 (+880062us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:42.899543 (+358426us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.924224 (+ 24681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.934601 (+ 10377us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.937001 (+  2400us) raft_consensus.cc:1685] finished
0709 12:21:42.937024 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.943793 (+  6769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1141322,"raft.queue_time_us":710428,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":29597,"thread_start_us":1160840,"threads_started":2,"wal-append.queue_time_us":562997}
I20260709 12:21:42.976380  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.981887  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:42.982873  6729 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:42.983551  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:42.984339  4576 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:42.983547  6729 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:42.986205  6729 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:42.989929  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:42.994302  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 250026us
I20260709 12:21:42.996510  6644 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:42.997077  6644 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.997439  6644 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.993088  6426 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.000384  6426 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.000782  6426 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.004803  6610 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:42.993186  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:43.009343  6618 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.009393  6808 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:43.011760  6807 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:43.012224  6807 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:43.013298  6807 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.016533  4583 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:43.020516  6807 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:43.025146  3747 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.032847  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.036672  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:43.039896  6469 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:43.041286  6618 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:43.041677  6618 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:43.042689  6618 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.043814  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.044513  3850 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.045168  6618 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:43.048758  6808 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:43.049234  6808 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:43.049664  6808 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:43.050048  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.050925  3846 raft_consensus.cc:2368] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:43.053047  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.053898  3843 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:43.058210  6808 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.076690  3850 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
W20260709 12:21:43.077065  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83321.4us
W20260709 12:21:43.078886  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 69882.5us
I20260709 12:21:43.080183  3962 leader_election.cc:400] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9.
I20260709 12:21:43.080489  3962 leader_election.cc:403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:21:43.088327  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51876.8us
I20260709 12:21:43.089545  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:43.090531  6253 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:43.091315  6253 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:43.085879  6722 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.098286  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:43.099287  6785 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:43.099803  6785 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:43.100198  6785 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:43.102700  4575 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:43.102964  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:43.102875  6609 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:43.105875  6573 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:43.106925  6811 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:43.085603  6469 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:21:43.108177  6253 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:42.980772  6772 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.036686  6704 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:43.134590  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:43.135133  3747 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.150837  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:43.133822  6385 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:43.117604  6710 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:43.110270  6785 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:43.158908  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69552.5us
I20260709 12:21:43.155094  3747 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.171211  6731 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.175261  3888 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:43.175729  6725 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.156886  6385 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.176679  6385 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:43.178201  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.154942  6445 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:43.183239  6661 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.183528  3844 raft_consensus.cc:2368] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5.
I20260709 12:21:43.134191  6713 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:21:43.188838  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54008us
W20260709 12:21:43.196360  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44834.3us
I20260709 12:21:43.198753  3962 leader_election.cc:400] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:43.199218  3962 leader_election.cc:403] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:21:43.181190  6731 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.163707  6736 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:43.190266  6445 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:43.209487  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:43.202692  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:43.208490  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.206226  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:43.217201  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.206478  6808 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:43.208518  6701 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:43.212730  6445 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.250092  6809 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:43.248739  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:43.263586  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.268784  6701 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:43.264731  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69754.4us
I20260709 12:21:43.269279  6807 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:43.270017  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:43.269851  6701 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.271540  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:43.268536  6809 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:43.266278  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.273734  6785 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:43.275215  6772 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.276055  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:43.245947  6736 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.268476  6426 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.266534  6646 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.265844  6704 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.212921  6811 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:43.220378  3747 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.323993  6820 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:43.324165  6825 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:43.325079  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 141120us
W20260709 12:21:43.326109  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 105455us
W20260709 12:21:43.330518  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.332556  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:43.209717  6543 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.271394  6807 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:43.342110  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 66221.8us
I20260709 12:21:43.348194  3917 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:43.220257  6661 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:43.354367  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:43.356866  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:43.357638  3921 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:43.361346  3747 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 1 to 2, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:43.362222  6661 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:43.364490  6543 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.367910  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.327607  6646 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:43.293587  6644 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.333436  6820 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:43.389076  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.377617  3747 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.366833  6385 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:43.347548  6725 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:43.392205  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.389897  3846 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:43.273772  6809 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.552091  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:43.461836  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 123098us
I20260709 12:21:43.585162  6668 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:43.585690  6668 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:43.585837  6426 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.590503  3921 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:43.591840  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.593509  3850 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:43.492882  3844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 1061) took 1874 ms (client timeout 2086 ms). Trace:
W20260709 12:21:43.595129  3844 rpcz_store.cc:269] 0709 12:21:41.618790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.618912 (+   122us) service_pool.cc:224] Handling call
0709 12:21:43.473070 (+1854158us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000a46d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:43.492816 (+ 19746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436748160}
W20260709 12:21:43.442791  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.470199  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 125030us
I20260709 12:21:43.595929  3922 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.490676  3747 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:43.469295  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 100198us
I20260709 12:21:43.529464  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:43.539330  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.605006  3918 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:43.604799  3917 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:43.564703  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:43.491600  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:43.607909  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.608839  3921 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:43.408084  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:43.521658  6815 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:21:43.605793  3923 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:43.600994  3888 connection.cc:256] RPC call timeout handler was delayed by -1.3534227690001899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 12:21:43.538622  6713 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.380262  4575 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:43.617671  3747 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 4, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.468773  6722 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9.
I20260709 12:21:43.391705  6820 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:43.470410  6817 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:43.618450  6725 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.633620  6710 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:43.634373  6754 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:43.586794  6668 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:43.617846  3919 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:43.642390  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:43.699775  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 62389.4us
I20260709 12:21:43.615957  6807 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:21:43.700803  6818 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.708653  6818 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.709105  6818 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.465090  6646 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:43.653085  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 263964us
I20260709 12:21:43.379675  6253 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.269s
I20260709 12:21:43.691779  6817 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:43.696187  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.697576  6609 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:43.685012  6754 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:43.616015  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.642819  6644 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:43.934230  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.900550  3888 leader_election.cc:400] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5.
I20260709 12:21:43.942831  3888 leader_election.cc:403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:21:43.892532  3919 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:43.871701  3922 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
W20260709 12:21:43.948978  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.675731  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:43.952108  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:43.954595  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.954900  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:43.950284  3925 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:43.709357  6736 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:43.958921  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.971881  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.713743  6710 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:43.722563  6825 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:43.947427  6640 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.978020  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 172125us
I20260709 12:21:43.981060  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:43.985476  3916 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:43.990564  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.992551  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:43.962656  6668 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:43.990552  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:43.999861  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 378817us
I20260709 12:21:43.655509  6713 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.037254  3918 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:21:43.998238  6640 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.037113  3916 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
W20260709 12:21:43.998787  6811 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.002s
I20260709 12:21:44.039497  6811 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 3. Current term is 4.
I20260709 12:21:44.040385  6618 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:44.040879  6618 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:44.042025  6618 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.044281  6808 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.045132  6808 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.062074  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:44.055778  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74038.6us
I20260709 12:21:44.047622  6618 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:43.986114  6825 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:43.977061  6609 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.124228  6640 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:44.282917  6808 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.080874  6385 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:44.289108  6808 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:44.051203  6826 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5.
I20260709 12:21:44.290982  6825 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:44.136483  6754 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:44.141901  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46428.7us
I20260709 12:21:44.295902  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:44.060434  6646 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:44.245378  4547 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.746s (SENT)
I20260709 12:21:44.298020  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:44.310875  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 284209us
I20260709 12:21:44.310590  3845 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:44.313301  6713 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.331362  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:44.343686  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53525.6us
I20260709 12:21:44.315210  6609 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:44.364109  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.334342  6725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.022s	sys 0.034s
I20260709 12:21:44.314188  6710 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:44.366961  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 121640us
W20260709 12:21:44.366621  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 66356.9us
W20260709 12:21:44.378571  4547 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.969s (SENT)
I20260709 12:21:44.404810  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.405795  6662 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:44.399574  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:44.378185  6725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.022s	sys 0.035s
I20260709 12:21:44.352496  6713 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.477519  6840 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:21:44.480065  6850 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:21:44.476339  6845 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:21:44.472352  6833 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:21:44.478838  6847 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:44.432870  3845 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:44.434003  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.459827  3841 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:44.427271  6836 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:44.437601  6820 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.744s	user 0.000s	sys 0.011s
W20260709 12:21:44.432571  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109597us
I20260709 12:21:44.442067  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.511282  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1954) took 1336 ms. Trace:
W20260709 12:21:44.513293  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71342.8us
I20260709 12:21:44.512323  3920 rpcz_store.cc:276] 0709 12:21:43.175125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.184788 (+  9663us) service_pool.cc:224] Handling call
0709 12:21:43.201763 (+ 16975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.340116 (+138353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.340147 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.407740 (+ 67593us) log.cc:844] Serialized 26 byte log entry
0709 12:21:43.684404 (+276664us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:43.684456 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.684546 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.510897 (+826351us) raft_consensus.cc:1685] finished
0709 12:21:44.510933 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.511201 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118641,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":246274,"threads_started":2,"wal-append.queue_time_us":664235}
I20260709 12:21:44.514036  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.515758  6841 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:44.517094  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.518054  6253 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:44.518540  6253 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:44.518970  6253 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:44.450930  6609 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:44.520457  6609 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.522579  6609 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:44.523934  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:44.525406  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:44.490638  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.495226  6835 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.175s	user 0.003s	sys 0.000s
W20260709 12:21:44.494390  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.515139  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:44.450070  6843 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:44.490404  6662 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.502475  6445 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.180s	user 0.010s	sys 0.003s
W20260709 12:21:44.555725  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65178.1us
I20260709 12:21:44.548040  6848 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:44.554628  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.560900  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.581645  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:44.582167  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 202590us
I20260709 12:21:44.588800  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.584790  3814 leader_election.cc:336] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.601s (SENT)
I20260709 12:21:44.586778  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.579871  6609 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:44.610729  3889 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.516s (SENT)
I20260709 12:21:44.511503  6820 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.646473  6820 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.577425  6701 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:44.650774  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 380) took 1297 ms. Trace:
I20260709 12:21:44.651225  4579 rpcz_store.cc:276] 0709 12:21:43.353596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.359634 (+  6038us) service_pool.cc:224] Handling call
0709 12:21:43.360012 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.050090 (+690078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.080165 (+ 30075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:44.092623 (+ 12458us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:44.151287 (+ 58664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.650490 (+499203us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400631354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:44.650541 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.650685 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408614656}
I20260709 12:21:44.612506  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:44.591259  6644 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:44.587144  6661 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:21:44.590541  6638 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:21:44.620246  6609 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:44.620790  6729 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:44.679093  6729 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:44.680127  6668 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:21:44.626288  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:44.586241  6725 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:44.628007  4547 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.141s (SENT)
I20260709 12:21:44.682961  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.630883  6818 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.921s	user 0.014s	sys 0.000s
I20260709 12:21:44.631682  6843 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.633131  6828 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:44.633574  6618 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:21:44.561569  6713 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.636437  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:44.643816  6855 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:44.559613  6445 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.655200  3850 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:44.673635  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88854.2us
I20260709 12:21:44.673839  3889 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.678021  6638 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:44.582930  6662 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.683190  6609 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:44.656309  6644 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:44.714660  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 131766us
W20260709 12:21:44.717304  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 282825us
W20260709 12:21:44.720391  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 133686us
I20260709 12:21:44.726145  3843 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:44.736104  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1974) took 1128 ms. Trace:
I20260709 12:21:44.736697  3917 rpcz_store.cc:276] 0709 12:21:43.607735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.964219 (+356484us) service_pool.cc:224] Handling call
0709 12:21:43.985775 (+ 21556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.223460 (+237685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.223502 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.284152 (+ 60650us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.428293 (+144141us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.428331 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.428400 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.655342 (+226942us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b2400277328. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f944fb0 00007fdc525bb488 00007fdc525bbbe8 00007fdc52593398 00007fdc5258e76a 00007fdc5258dbb6
0709 12:21:44.729005 (+ 73663us) raft_consensus.cc:1685] finished
0709 12:21:44.729024 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.736010 (+  6986us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116531,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":19604,"spinlock_wait_cycles":91782016,"thread_start_us":85000,"threads_started":1,"wal-append.queue_time_us":87432}
I20260709 12:21:44.592216  6841 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:44.728755  3814 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.612s (SENT)
I20260709 12:21:44.730268  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:44.716750  6729 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:44.729965  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 116318us
W20260709 12:21:44.740293  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 156211us
I20260709 12:21:44.741999  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.721302  6855 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:44.722391  6828 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:44.726224  6638 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:44.748203  3845 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:44.742743  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:44.750620  3847 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:44.754575  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 126605us
I20260709 12:21:44.743300  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:44.752683  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.734465  6644 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:44.765599  6609 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.766693  6638 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.768889  6662 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.753897  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:44.770049  6853 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.313s	user 0.000s	sys 0.002s
W20260709 12:21:44.756381  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 160946us
W20260709 12:21:44.770330  6838 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 12:21:44.770761  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.556s (SENT) [suppressed 48 similar messages]
I20260709 12:21:44.743806  6668 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.765870  6825 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:44.772109  6842 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:21:44.771893  6668 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.773409  6825 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:44.774051  6668 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.751768  6661 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:44.774784  6618 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:44.774972  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52320.6us
I20260709 12:21:44.760775  6445 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:44.776415  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.718258  6818 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:44.777326  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.778357  6818 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:44.779573  6646 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.749011  6855 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:44.780231  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:44.780385  6646 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.780740  6754 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:44.780894  3849 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:44.782801  6646 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:44.777223  6817 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:44.771556  3889 leader_election.cc:336] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.568s (SENT)
I20260709 12:21:44.792732  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.792930  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51004.2us
I20260709 12:21:44.773962  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 1968) took 1244 ms. Trace:
I20260709 12:21:44.764254  6843 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:44.785580  3814 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.655s (SENT)
I20260709 12:21:44.802520  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:44.788261  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:44.790511  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:44.731742  6640 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:44.808490  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:44.800391  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:44.800112  6828 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.801163  6445 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:44.807876  3848 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:44.828583  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.755389  6848 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:44.794610  3921 rpcz_store.cc:276] 0709 12:21:43.529957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.616939 (+ 86982us) service_pool.cc:224] Handling call
0709 12:21:43.641876 (+ 24937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.938549 (+296673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.938579 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.963695 (+ 25116us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.249410 (+285715us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:44.249477 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.249583 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.771547 (+521964us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:44.773629 (+  2082us) raft_consensus.cc:1685] finished
0709 12:21:44.773652 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.773893 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25682,"raft.queue_time_us":287655,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11293,"spinlock_wait_cycles":40828288,"thread_start_us":222835,"threads_started":1,"wal-append.queue_time_us":379596}
I20260709 12:21:44.809191  3850 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:44.802976  6722 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:44.835227  6701 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:44.829602  6609 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:44.838719  6862 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:44.839660  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54147us
W20260709 12:21:44.855969  3814 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.725s (SENT)
I20260709 12:21:44.827966  6445 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.840173  6725 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:44.841166  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:44.859407  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 111263us
W20260709 12:21:44.859510  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71987us
I20260709 12:21:44.860309  3814 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:44.869343  6253 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.842514  6722 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:44.872236  3845 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:44.860176  6445 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:44.859684  6646 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:44.881439  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 128908us
I20260709 12:21:44.881870  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.861860  6704 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:44.865355  6856 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:44.886166  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:44.886284  6618 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.889325  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:44.891937  6844 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:21:44.893774  6854 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:21:44.895109  6854 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:44.895735  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:44.873615  6722 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:44.864984  6841 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.890244  6809 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:44.914018  6809 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:44.914433  6809 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:44.903537  3849 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:44.885478  6704 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.907734  6870 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:44.907750  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:44.919992  6704 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:44.918313  4579 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:44.923383  4575 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:44.902477  6848 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.901729  6618 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.891386  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:44.917906  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 146332us
I20260709 12:21:44.920684  6870 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:44.912261  6253 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:44.922768  6837 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.810s	user 0.004s	sys 0.000s
I20260709 12:21:44.906437  6854 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:44.939216  6618 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:44.939529  6573 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:44.940341  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:44.941406  6861 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:44.935549  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44246.3us
I20260709 12:21:44.917514  6844 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:44.959583  4575 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:44.961063  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:44.917891  6646 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:44.932296  6736 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:44.965956  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:44.967675  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:44.969056  6844 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:44.942504  6854 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:44.970480  6638 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:44.970764  6855 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:44.971421  3814 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.926s (SENT)
I20260709 12:21:44.975656  3922 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:44.978331  3889 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.663s (SENT)
I20260709 12:21:44.983069  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:45.014487  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:45.013406  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73182.3us
I20260709 12:21:44.980485  6754 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:45.020345  6848 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:44.980743  6736 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.026983  6754 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:45.031803  6854 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:45.042645  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71281.2us
W20260709 12:21:45.046164  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.052016  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 73728.9us
I20260709 12:21:45.041457  6543 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.013538  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:45.046164  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:45.056494  3849 raft_consensus.cc:606] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:45.056923  3849 raft_consensus.cc:614] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:45.053764  3889 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.741s (SENT)
W20260709 12:21:45.061338  3814 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.984s (SENT)
I20260709 12:21:45.062668  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.064288  6868 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:45.065009  6868 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.067031  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:45.070122  3850 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:45.038266  6848 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:45.073164  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:45.044039  6870 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.080021  6859 raft_consensus.cc:2764] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:45.082317  6573 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:45.082839  6573 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.083266  6573 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.050675  6754 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:45.088011  3814 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.003s (SENT)
I20260709 12:21:45.092116  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.039999  6644 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.067277  6868 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:45.150468  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.154632  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 100910us
W20260709 12:21:45.155704  3889 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.805s (SENT)
I20260709 12:21:45.157207  6844 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.158332  6644 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.158535  6848 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.159952  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:45.155171  6704 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.163151  6704 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.165144  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c0e62036464a72858695d542f42a18"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:45.147722  6736 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.166285  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:45.168658  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80681.6us
I20260709 12:21:45.169246  6713 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:45.169299  3814 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.004s (SENT)
I20260709 12:21:45.170550  6855 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:45.192729  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 159801us
W20260709 12:21:45.172389  3814 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.075s (SENT)
I20260709 12:21:45.198421  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:45.199301  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:45.199956  3920 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.202713  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:45.203800  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:45.204476  3847 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:45.202598  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:45.214744  3923 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:45.215590  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.226524  3922 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:45.152290  6859 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.070938  6646 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.245941  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:45.250381  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.154052  4579 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:21:45.255381  3850 raft_consensus.cc:606] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.257308  3850 raft_consensus.cc:614] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:45.270364  3920 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:45.152478  6725 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:21:45.312830  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:45.315155  3916 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:45.317534  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.253749  6771 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:45.256500  6609 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:45.329028  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:45.329228  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 156873us
W20260709 12:21:45.334733  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.335500  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:45.341535  3916 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:45.342372  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:45.312435  6807 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:45.346781  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:45.349607  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 107299us
I20260709 12:21:45.357281  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:45.366043  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.350422  6866 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:45.367666  6729 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:45.374733  6887 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:45.377455  6855 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:45.362226  6445 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.399988  3847 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:45.401891  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:45.394861  6809 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.415853  6618 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:45.393383  6722 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.416935  6445 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.418916  6722 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:45.420692  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.424542  6844 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.424913  6754 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.425891  6844 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:45.427193  6754 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.393514  6866 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:45.435811  3922 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:45.435628  6866 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.439340  6870 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.393078  6887 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.439998  6887 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.439927  6870 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.442219  6870 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.444602  6618 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:45.445875  6618 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.395397  6729 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:45.448168  6729 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.450588  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:45.451030  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:45.451341  3925 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:45.452862  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.478080  3922 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:45.487286  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:45.492309  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69169.5us
I20260709 12:21:45.492506  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:45.493614  3889 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.535s (SENT)
I20260709 12:21:45.494086  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.497786  6841 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:45.499531  6892 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:45.500561  6892 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:45.500900  6892 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:45.503690  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:45.512804  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59223.8us
I20260709 12:21:45.505203  6889 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 12:21:45.532254  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.541813  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44144.4us
I20260709 12:21:45.542208  3922 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:21:45.544266  3814 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.150s (SENT)
I20260709 12:21:45.513460  6836 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:45.544773  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:45.548079  3889 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.590s (SENT)
I20260709 12:21:45.518833  6841 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:45.558035  6543 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:45.525801  6868 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:45.568413  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:45.554939  6713 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:21:45.582136  6855 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:45.582605  6855 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:45.587754  6809 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.553105  6836 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:45.593895  3925 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:45.601177  3964 leader_election.cc:400] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
I20260709 12:21:45.601569  3964 leader_election.cc:403] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:45.593041  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63332us
W20260709 12:21:45.617115  3814 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.210s (SENT)
I20260709 12:21:45.614528  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:45.587054  6573 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.623397  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.591280  6856 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:45.608512  6841 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.632591  6893 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:45.634297  6892 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.636210  4579 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:45.637454  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:45.631054  6854 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:45.626794  6895 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:45.646881  6836 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.648134  6895 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:45.648651  6836 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.649168  6895 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:45.651602  3889 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.687s (SENT)
I20260709 12:21:45.652714  6573 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.653379  3844 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.653801  3844 raft_consensus.cc:614] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:45.653873  3889 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.696s (SENT)
W20260709 12:21:45.654369  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.622090  6855 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.656306  6855 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:45.656886  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 55909.4us
I20260709 12:21:45.657668  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.623629  6385 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:21:45.659561  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.660291  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:45.662371  6844 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:45.662869  6844 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.663331  6892 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.654379  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.666270  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.667129  6701 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.668355  3993 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:45.672086  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.672235  6887 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.653111  6710 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:45.674547  6887 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.674706  3993 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:45.663270  6844 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.702358  3847 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:45.703634  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:45.717137  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 164388us
I20260709 12:21:45.721728  3993 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:21:45.747210  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:45.748615  3842 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:45.753108  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.753837  3994 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:45.755946  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.720419  6855 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.719892  6820 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.762283  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 145190us
W20260709 12:21:45.765017  3814 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.811s (SENT)
I20260709 12:21:45.767426  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.769479  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.771461  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:45.778509  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.720182  6701 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:21:45.771497  3847 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:45.792305  3996 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:45.793303  4547 leader_election.cc:336] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.648s (SENT)
I20260709 12:21:45.793759  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.795897  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.799515  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.800182  3994 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:45.796547  3996 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:45.802809  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.802726  6862 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:45.803618  3994 raft_consensus.cc:2376] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11. Re-sending same reply.
I20260709 12:21:45.768767  6855 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:45.807168  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.807888  6855 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.773967  6820 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.813634  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.814915  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.813853  6820 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:45.815680  3922 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:45.815786  3998 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:45.816403  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.817167  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.817519  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.802313  6841 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:45.818125  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.818866  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.819365  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.817245  3995 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:45.821640  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:45.822386  3920 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:45.823414  3745 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 6, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:45.825227  3999 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:45.771057  6887 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.818317  3998 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:45.829123  4547 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.673s (SENT)
I20260709 12:21:45.824900  3745 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 9, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 9 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.836053  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:45.837193  3745 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 8, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:45.838661  3745 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 5, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.843240  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:45.801571  6866 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.862428  6856 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:45.868644  6854 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6.
I20260709 12:21:45.842237  6887 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:45.862948  3747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 189) took 20719 ms (client timeout 15000 ms). Trace:
W20260709 12:21:45.863303  6902 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:45.818317  6844 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:45.844885  3745 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:21:45.900233  3889 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.910s (SENT)
I20260709 12:21:45.900862  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.898942  3745 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 7, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:45.907388  3745 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 4, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:45.916925  3996 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:45.917114  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88025.9us
I20260709 12:21:45.929314  3920 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:45.921815  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.921794  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:45.921940  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:45.941018  3998 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:45.914508  6887 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.947526  3842 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:45.949306  6725 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:45.947531  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.952765  3842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:21:45.953202  3814 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.889s (SENT)
I20260709 12:21:45.953361  3842 raft_consensus.cc:606] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:45.953872  3842 raft_consensus.cc:614] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:45.953783  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:45.954921  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.962108  3922 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:21:45.964253  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64068.2us
I20260709 12:21:45.933117  3745 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 3 to 5, term changed from 3 to 4, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:21:45.872109  3747 rpcz_store.cc:269] 0709 12:21:25.143067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.143242 (+   175us) service_pool.cc:224] Handling call
0709 12:21:45.862756 (+20719514us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:44.457778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:44.458748 (+   970us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:44.458814 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:21:44.458859 (+    45us) tablet.cc:662] Decoding operations
0709 12:21:44.628706 (+169847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:44.628783 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:44.628807 (+    24us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:21:44.629956 (+  1149us) tablet.cc:701] Row locks acquired
0709 12:21:44.630003 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:21:44.630179 (+   176us) write_op.cc:270] Start()
0709 12:21:44.630335 (+   156us) write_op.cc:276] Timestamp: P: 1783599704630117 usec, L: 0
0709 12:21:44.630356 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:44.631113 (+   757us) log.cc:844] Serialized 5601 byte log entry
0709 12:21:45.049660 (+418547us) op_driver.cc:464] REPLICATION: finished
0709 12:21:45.403434 (+353774us) write_op.cc:301] APPLY: starting
0709 12:21:45.448940 (+ 45506us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:45.449251 (+   311us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:45.449397 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:45.498883 (+ 49486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:45.499271 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:21:45.499314 (+    43us) write_op.cc:312] APPLY: finished
0709 12:21:45.499765 (+   451us) log.cc:844] Serialized 101 byte log entry
0709 12:21:45.499969 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.500132 (+   163us) write_op.cc:454] Released schema lock
0709 12:21:45.500201 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:45.500740 (+   539us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:45.500770 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":52,"spinlock_wait_cycles":28672,"child_traces":[["op",{"apply.queue_time_us":329048,"apply.run_cpu_time_us":6499,"apply.run_wall_time_us":106450,"num_ops":14,"prepare.queue_time_us":176709,"prepare.run_cpu_time_us":17535,"prepare.run_wall_time_us":344485,"raft.queue_time_us":138690,"raft.run_cpu_time_us":42938,"raft.run_wall_time_us":258313,"replication_time_us":419074,"spinlock_wait_cycles":57600,"thread_start_us":517010,"threads_started":4,"wal-append.queue_time_us":232692}]]}
W20260709 12:21:45.981561  3889 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.912s (SENT)
I20260709 12:21:45.960001  6817 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:21:45.982112  6701 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.982721  6701 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:45.983498  6844 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:45.982399  3745 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.985164  6701 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:45.975909  6704 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:21:45.988646  3992 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:45.989207  3889 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:45.992769  3991 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:45.992144  6892 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:45.997681  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a268ae9485472a8208827344502203"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:45.998410  3845 raft_consensus.cc:606] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:45.998780  3845 raft_consensus.cc:614] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:46.007500  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.021953  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.014964  6701 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:46.060182  6912 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:21:46.087132  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.170490  6844 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:46.225451  6913 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 12:21:46.253873  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.314299  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:46.315274  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.316057  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 334531us
W20260709 12:21:46.325328  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 372115us
I20260709 12:21:46.365322  6807 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:46.362740  6888 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.248883  6844 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:46.368337  3889 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.020s (SENT)
I20260709 12:21:46.377802  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:46.365967  6807 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:46.385238  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.386823  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:46.380537  6888 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:46.356319  6736 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:46.395062  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67155.4us
I20260709 12:21:46.393829  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:46.404770  3889 leader_election.cc:336] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.142s (SENT)
I20260709 12:21:46.405269  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:46.389751  6841 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:46.431612  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 369041us
I20260709 12:21:46.440338  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:46.440901  6844 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:46.428653  6911 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:21:46.473196  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.406936  6736 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:46.473740  6640 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:46.513144  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.552479  6807 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:46.567694  6888 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:46.600595  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.604697  4575 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:46.584580  6841 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:46.611652  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:46.613879  6915 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:21:46.612317  4576 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:46.619855  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 215078us
I20260709 12:21:46.622148  3922 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:46.624787  6926 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:46.625430  6914 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:21:46.631093  3847 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:46.621008  6888 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:46.621246  6918 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.626369  6926 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 12:21:46.637053  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 237147us
I20260709 12:21:46.637817  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:46.641703  3916 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:46.649339  3917 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:46.649514  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:46.651088  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:46.655275  3848 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:46.658067  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:46.662881  3889 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.220s (SENT)
I20260709 12:21:46.659076  3917 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:46.636320  6888 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:46.671248  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 140474us
W20260709 12:21:46.683056  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63444.2us
I20260709 12:21:46.670047  6736 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:46.640573  6918 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:46.702579  4547 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.140s (SENT)
W20260709 12:21:46.739976  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50322.7us
I20260709 12:21:46.758337  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:46.758595  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 105779us
W20260709 12:21:46.759716  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57202.3us
W20260709 12:21:46.765116  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 102289us
W20260709 12:21:46.766335  3889 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.292s (SENT)
I20260709 12:21:46.706686  6866 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:21:46.766952  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:46.756937  6913 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:21:46.640200  6841 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:46.738117  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:46.762567  6856 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.673460  6925 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 12:21:46.772948  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.772607  6701 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:46.784945  3889 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.422s (SENT)
I20260709 12:21:46.788434  4575 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:46.790228  4576 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.791630  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:46.792223  4579 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:46.761258  6927 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:21:46.773097  6929 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:46.806453  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46697.4us
I20260709 12:21:46.780786  6856 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.809695  6856 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:46.811998  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.780725  6925 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:46.816637  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:46.818588  3889 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.556s (SENT)
I20260709 12:21:46.820305  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:46.825273  3889 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.603s (SENT)
I20260709 12:21:46.810994  6888 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:46.832746  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:46.827386  6921 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:46.856848  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:46.858958  6918 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:46.862915  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:46.864717  3922 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:46.826809  6841 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:21:46.863852  3889 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.031s (SENT)
I20260709 12:21:46.866047  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:46.867930  6701 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:46.869076  6701 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:46.870496  3889 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.041s (SENT)
I20260709 12:21:46.870769  4576 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.874131  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:46.877740  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:46.883755  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:46.884764  3922 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:46.886278  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:46.889892  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37296 (request call id 246) took 1230 ms. Trace:
I20260709 12:21:46.890496  3991 rpcz_store.cc:276] 0709 12:21:45.659427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.665972 (+  6545us) service_pool.cc:224] Handling call
0709 12:21:46.889638 (+1223666us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54002fa3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:46.889807 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465904512}
I20260709 12:21:46.893999  3997 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:46.908728  6936 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.909459  6936 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.909927  6936 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.911707  6918 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:46.915089  6860 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.915652  6860 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.916046  6860 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:46.937491  4547 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.766s (SENT)
W20260709 12:21:46.971233  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.971206  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:46.974537  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.989488  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:46.993019  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 251) took 1321 ms. Trace:
W20260709 12:21:46.995712  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65730.6us
I20260709 12:21:46.995739  3997 rpcz_store.cc:276] 0709 12:21:45.671396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.675204 (+  3808us) service_pool.cc:224] Handling call
0709 12:21:46.889826 (+1214622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.894589 (+  4763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.978015 (+ 83426us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002fa3d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:46.992924 (+ 14909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2792515968}
I20260709 12:21:46.978619  6870 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:47.016363  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 182327us
W20260709 12:21:47.030315  3814 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.508s (SENT)
I20260709 12:21:46.976773  6939 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:47.037770  3814 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.519s (SENT)
I20260709 12:21:47.038748  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:47.046060  3814 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.547s (SENT)
W20260709 12:21:47.064150  3814 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.592s (SENT)
I20260709 12:21:47.064786  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:47.066663  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.070253  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 199795us
W20260709 12:21:47.105016  3889 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.086s (SENT)
I20260709 12:21:47.108376  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.109053  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.110468  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.111219  3922 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:47.112752  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.113802  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.112888  3925 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:47.121698  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:47.122823  4579 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
W20260709 12:21:47.133505  4547 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.088s (SENT)
I20260709 12:21:47.133841  6860 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:47.131013  6936 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.107247  6856 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:47.137250  6936 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:47.137656  6856 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:47.138837  3844 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:47.145136  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:47.112656  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:47.151160  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 87055.7us
W20260709 12:21:47.151993  3814 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.603s (SENT)
W20260709 12:21:47.153419  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100141us
W20260709 12:21:47.155159  3814 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.672s (SENT)
I20260709 12:21:47.155929  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:47.156034  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:47.157316  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:47.154844  6888 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:47.159540  6949 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.160233  6949 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.162665  6949 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:47.163237  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 129267us
W20260709 12:21:47.159739  6940 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.164s	user 0.000s	sys 0.004s
W20260709 12:21:47.165679  3814 leader_election.cc:336] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.689s (SENT)
I20260709 12:21:47.179579  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.184401  3917 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:47.184636  3814 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.857s (SENT)
I20260709 12:21:47.185837  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.186192  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:47.185864  3814 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.908s (SENT)
I20260709 12:21:47.188113  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:47.190341  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45307.4us
I20260709 12:21:47.192504  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:47.193614  4583 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:21:47.203697  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 162877us
I20260709 12:21:47.204910  6962 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:47.205672  6962 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.207841  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.209357  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.207904  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.210999  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.213543  3917 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:47.216095  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:47.218924  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.223866  3919 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:47.224545  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.210161  6927 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.210110  6920 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:47.230116  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.230212  6919 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:47.234114  6924 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:47.234488  6924 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:47.237063  6807 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:47.237653  6807 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.238080  6936 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.239838  6860 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.241582  6888 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.230290  6959 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.260021  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:47.270804  3814 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.892s (SENT)
I20260709 12:21:47.235280  6924 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:47.272629  6959 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.275118  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.228901  6920 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:47.211942  6887 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:21:47.284372  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.293658  6956 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.285324  6807 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.295691  6962 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.302807  6924 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:47.286026  6920 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:47.291307  6887 consensus_queue.cc:1243] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:47.311722  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.314513  3924 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:47.294261  6956 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.316547  6807 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:47.321570  6807 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.324544  6807 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.328796  6959 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.331073  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.331817  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.332321  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.334542  3919 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:21:47.340505  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.347405  3924 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.349860  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.345995  6920 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:47.351744  3924 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:47.353777  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:47.354310  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:47.355195  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:47.355926  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:47.336359  6962 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:47.357249  3991 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.355871  3848 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:47.359987  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.360282  6966 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.360715  3992 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:47.360285  3997 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:47.365741  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.367368  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.367957  3916 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.369971  3917 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.370678  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:47.374009  6964 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:47.373994  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.374621  6964 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.374802  3997 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.374986  6964 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.380597  6956 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.385213  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:47.385603  6962 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:47.386956  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.388054  6962 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:47.392874  3923 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:21:47.394058  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:47.398597  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.403049  3917 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:47.406327  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.407038  3992 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:47.412528  3916 raft_consensus.cc:2410] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:21:47.360996  6966 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.420307  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.430415  3992 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.433368  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:47.434204  3847 raft_consensus.cc:2368] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:47.435272  3888 leader_election.cc:400] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:47.435621  3888 leader_election.cc:403] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:47.435933  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.436211  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.436257  6701 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:47.436579  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.437676  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.438364  3992 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.445567  3991 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.448681  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:47.465911  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:47.451086  3814 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.017s (SENT)
I20260709 12:21:47.454079  6966 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:47.454401  6964 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.467797  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.468017  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.456038  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.459491  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.468704  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.468554  3994 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
W20260709 12:21:47.464619  3889 leader_election.cc:336] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.227s (SENT)
I20260709 12:21:47.470301  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.470252  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:47.469228  3992 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6. Re-sending same reply.
I20260709 12:21:47.472398  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.477711  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 112) took 5328 ms. Trace:
I20260709 12:21:47.478174  3992 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.479148  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.467732  6929 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:47.479398  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.480938  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.481166  3998 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.481532  3994 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:47.482178  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.482784  3998 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:47.475811  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.484545  3991 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:47.484889  3995 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.485409  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.478092  3745 rpcz_store.cc:276] 0709 12:21:42.141203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.141683 (+   480us) service_pool.cc:224] Handling call
0709 12:21:47.469363 (+5327680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:46.524334 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:46.608831 (+ 84497us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:46.609763 (+   932us) write_op.cc:435] Acquired schema lock
0709 12:21:46.610445 (+   682us) tablet.cc:662] Decoding operations
0709 12:21:46.791635 (+181190us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:46.791732 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:46.791762 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:21:46.792607 (+   845us) tablet.cc:701] Row locks acquired
0709 12:21:46.792629 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:21:46.792796 (+   167us) write_op.cc:270] Start()
0709 12:21:46.792943 (+   147us) write_op.cc:276] Timestamp: P: 1783599706792742 usec, L: 0
0709 12:21:46.792978 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:21:46.852155 (+ 59177us) log.cc:844] Serialized 3636 byte log entry
0709 12:21:47.241738 (+389583us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54003d4da0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc5296a6b8 00007fdc5296a2fa 00007fdc529ee965 00007fdc529eee09 00007fdc56429581 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901
0709 12:21:47.251756 (+ 10018us) op_driver.cc:464] REPLICATION: finished
0709 12:21:47.352904 (+101148us) write_op.cc:301] APPLY: starting
0709 12:21:47.352992 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:47.353205 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:47.353225 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:47.354344 (+  1119us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:47.354603 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:21:47.354651 (+    48us) write_op.cc:312] APPLY: finished
0709 12:21:47.354952 (+   301us) log.cc:844] Serialized 71 byte log entry
0709 12:21:47.355115 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:47.355240 (+   125us) write_op.cc:454] Released schema lock
0709 12:21:47.355290 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:47.372822 (+ 17532us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:47.403518 (+ 30696us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32731,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":100890,"apply.run_cpu_time_us":2821,"apply.run_wall_time_us":8859,"num_ops":9,"prepare.queue_time_us":462256,"prepare.run_cpu_time_us":22651,"prepare.run_wall_time_us":737508,"raft.queue_time_us":156508,"replication_time_us":458597,"spinlock_wait_cycles":158383744,"thread_start_us":713891,"threads_started":4,"wal-append.queue_time_us":155435}]]}
I20260709 12:21:47.485803  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.479761  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.487048  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.499064  3995 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.479852  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:47.475983  3748 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 4 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:47.480340  6929 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:47.475822  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.477349  6964 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:47.489197  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.490025  6701 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:47.482376  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:47.493412  3889 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.825s (SENT)
I20260709 12:21:47.489084  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.496963  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.486012  3991 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.503105  3997 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:47.504067  3848 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.505467  3999 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:47.509820  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.510113  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.510428  3991 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.510676  3999 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.511284  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.509057  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.512534  3997 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:47.511420  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.516016  3999 raft_consensus.cc:2376] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4. Re-sending same reply.
I20260709 12:21:47.516573  3748 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 3 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.521201  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.521898  3994 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.524514  3997 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:21:47.526839  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.527681  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.518457  3748 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 3 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.528295  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.506282  3993 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:47.529575  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.507856  3998 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:47.529673  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.530362  3994 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.512368  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.530596  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.531104  3991 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.531405  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.531158  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.531952  3993 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6. Re-sending same reply.
I20260709 12:21:47.532187  3994 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:47.532857  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.533510  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.479737  3992 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.507578  3990 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.533432  3995 raft_consensus.cc:2376] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9. Re-sending same reply.
I20260709 12:21:47.535997  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.536346  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.536583  3999 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.536926  3993 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:47.542258  3848 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:47.542454  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.543154  3990 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.543350  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:47.543617  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.545702  3992 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.546725  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.515033  6929 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:47.547951  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.547565  3748 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 5 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.548559  3995 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.549456  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.550132  3995 raft_consensus.cc:2368] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:47.549485  3748 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 5 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.550890  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.551433  3995 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.553282  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.553823  3995 raft_consensus.cc:2376] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12. Re-sending same reply.
I20260709 12:21:47.555997  3994 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.551919  3748 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 4 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:21:47.560660  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67280.1us
I20260709 12:21:47.561568  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:47.562484  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.563259  3997 raft_consensus.cc:2376] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12. Re-sending same reply.
I20260709 12:21:47.563947  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.564510  3995 raft_consensus.cc:2376] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4. Re-sending same reply.
I20260709 12:21:47.567834  3991 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:47.571076  3994 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:47.544536  6920 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:47.573850  3994 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:47.551644  6964 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:47.584982  6964 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:47.585923  6964 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.591266  3995 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:47.592392  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.593573  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.574805  3748 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 4 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.601702  3748 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 6 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.576593  3998 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:47.581722  3993 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:47.604522  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.604797  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.605159  3999 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:47.605253  3991 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.604522  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.606403  3993 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:47.607486  3993 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:47.608237  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46878.7us
I20260709 12:21:47.603317  3748 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 2 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.608912  3993 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:21:47.609043  3994 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:21:47.604650  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.594655  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.612349  3995 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.613636  3994 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:47.605356  3998 raft_consensus.cc:2376] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7. Re-sending same reply.
I20260709 12:21:47.610509  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:47.608946  3889 leader_election.cc:336] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.655s (SENT)
I20260709 12:21:47.614952  3996 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.628093  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:47.615425  3994 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:47.617506  3992 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.628655  3997 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:21:47.629472  3889 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.763s (SENT)
I20260709 12:21:47.629974  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:47.630753  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.632346  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.633769  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.634665  3990 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:21:47.635754  3889 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.526s (SENT)
I20260709 12:21:47.635839  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.636356  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:47.647037  3992 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:47.655170  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.650482  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:47.660023  3994 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.674490  3997 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:47.675665  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.632233  6826 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:47.684674  3924 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.688028  3997 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:47.689395  3990 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:21:47.649204  6701 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.684840  6736 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.671838  6725 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:47.694264  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.701095  3917 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:47.702023  3994 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:47.703398  3996 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:47.703524  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.705227  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.726506  3919 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.726799  3992 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:47.705040  3748 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 5 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:47.727424  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.728516  3996 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:47.728649  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.729521  3992 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:47.729450  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:47.730265  3918 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:47.706828  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.713047  3924 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:47.741330  3990 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:47.708683  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.742072  3993 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:47.720800  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.743952  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:47.744979  3917 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:47.725749  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.748871  3997 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:47.801076  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:47.705547  6736 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:47.835354  3919 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:47.839819  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:47.915807  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.895785  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:47.943598  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.895483  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:47.895530  3814 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.058s (SENT)
I20260709 12:21:47.907599  6936 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.085798  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:48.089900  3995 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:48.093803  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.085762  3993 raft_consensus.cc:2376] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:21:48.099761  3999 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.102229  6736 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.103343  3923 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:48.106423  6933 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:48.123884  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.130120  3918 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:48.128615  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.135808  3999 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8.
I20260709 12:21:48.139895  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:48.143226  3889 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.929s (SENT)
I20260709 12:21:48.143971  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:48.145905  3889 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.947s (SENT)
I20260709 12:21:48.146453  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.146433  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.113013  6936 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:48.150660  3889 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.998s (SENT)
I20260709 12:21:48.156165  6736 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.183081  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.185004  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.186110  3993 raft_consensus.cc:2368] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:21:48.148303  6869 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.196609  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.202239  3847 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:48.211802  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.213016  3993 raft_consensus.cc:2393] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:48.222105  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.223026  3999 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.228425  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.230260  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.231431  3995 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.229357  3993 raft_consensus.cc:2376] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:21:48.254582  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.259183  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.260336  3995 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:48.265432  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.209645  6956 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:21:48.267979  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 372494us
I20260709 12:21:48.271040  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:48.275367  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.277875  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:48.279861  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 126844us
I20260709 12:21:48.283732  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:48.284206  3889 leader_election.cc:336] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.052s (SENT)
I20260709 12:21:48.284513  3991 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:48.285432  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.292954  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.290210  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.293897  3998 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.295023  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.295423  3993 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.295861  3995 raft_consensus.cc:2368] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 4. Current term is 5.
I20260709 12:21:48.294384  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:48.298062  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:48.300797  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.301607  3995 raft_consensus.cc:2368] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10.
I20260709 12:21:48.309522  6984 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:48.313714  6985 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:48.314313  6985 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:48.319100  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:48.319882  3889 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.169s (SENT)
I20260709 12:21:48.320017  3995 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:48.319976  4547 leader_election.cc:336] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 3.037s (SENT)
I20260709 12:21:48.320468  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.320613  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.321863  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:48.323395  3889 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.202s (SENT)
I20260709 12:21:48.325536  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.320139  6725 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:48.335197  3993 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:48.324266  6921 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.331709  6988 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.316879  6985 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.422250  6985 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.356369  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.357676  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.358125  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.358644  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.424731  3993 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:48.425572  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.426610  3994 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.358975  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.359247  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.427244  3991 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.427811  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.359699  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.429149  3997 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:48.429178  3999 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:48.403978  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.430029  3992 raft_consensus.cc:2376] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:21:48.430269  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.407071  3849 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:48.335814  6936 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.342410  6868 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.338795  6640 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:48.402395  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.424222  3998 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:48.437438  3996 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.438000  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:48.438855  3814 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.547s (SENT)
I20260709 12:21:48.439512  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:48.451265  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.452477  3995 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:48.468200  6936 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:48.473227  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.480684  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.486892  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.487612  3993 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:48.488726  3996 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:21:48.491772  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 168411us
W20260709 12:21:48.492496  3889 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.234s (SENT)
I20260709 12:21:48.492919  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:48.496116  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 199244us
I20260709 12:21:48.496973  6868 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.499711  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.482173  6923 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:48.500504  3999 raft_consensus.cc:2376] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:21:48.501006  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:48.501192  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.499675  3996 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:48.502241  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.502556  6991 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:48.503003  6991 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.502746  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.503432  6991 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:48.505903  3889 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.860s (SENT)
I20260709 12:21:48.505743  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.506794  3994 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:48.506420  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.492687  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.502283  3995 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:48.508498  3889 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.877s (SENT)
I20260709 12:21:48.509057  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.502838  3990 raft_consensus.cc:2376] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:21:48.448797  6640 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:48.515914  3889 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.882s (SENT)
I20260709 12:21:48.515416  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.517010  3995 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8. Re-sending same reply.
W20260709 12:21:48.514704  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 188551us
I20260709 12:21:48.517866  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.518451  3990 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8. Re-sending same reply.
W20260709 12:21:48.520646  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.520959  3889 leader_election.cc:336] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.655s (SENT)
I20260709 12:21:48.513629  6868 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.514081  6701 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.526481  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:48.529287  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:48.535245  6640 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:48.542936  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.552336  3889 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 3.917s (SENT)
I20260709 12:21:48.553071  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.574244  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:48.576017  6923 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.581918  3916 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:48.576587  6923 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:48.598640  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.600855  3993 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:21:48.604508  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.577159  6992 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.635583  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:48.636965  3993 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:48.640501  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88206us
W20260709 12:21:48.648699  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.652052  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:48.659576  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.660480  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.661533  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:48.660539  3889 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.639s (SENT)
I20260709 12:21:48.675705  3921 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:21:48.661274  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.675725  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.677549  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.678704  3916 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:21:48.668380  6989 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:21:48.679339  6917 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:48.681090  6936 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.652130  6923 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.680454  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:48.666491  6985 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:21:48.682546  6923 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:48.671962  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 145569us
I20260709 12:21:48.700835  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.701867  3920 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
W20260709 12:21:48.703114  3814 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.817s (SENT)
I20260709 12:21:48.682982  6923 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.688403  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:48.683111  6985 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:48.715682  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.716599  3924 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:48.715684  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:48.668637  6988 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:21:48.719579  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:48.672118  6991 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.724452  3919 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.712960  6923 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:48.749519  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:48.750344  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.750365  3921 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:48.752858  3919 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
W20260709 12:21:48.739778  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67534.8us
I20260709 12:21:48.754535  3814 leader_election.cc:400] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:48.754877  3814 leader_election.cc:403] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:48.753870  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65595.2us
I20260709 12:21:48.757802  6990 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:48.757023  6984 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:48.696022  6983 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:21:48.760983  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:48.759277  7003 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:21:48.724694  6985 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:48.770207  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:48.776857  6543 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:48.779842  7006 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:21:48.760926  4547 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.602s (SENT)
I20260709 12:21:48.783201  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.784941  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.781863  7001 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:48.792232  3921 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:48.806813  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45920us
W20260709 12:21:48.786159  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.801309  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.812860  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.815878  6543 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:48.816351  6543 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.816742  6543 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:48.822063  3964 connection.cc:256] RPC call timeout handler was delayed by -1.359238441999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:21:48.822535  3964 connection.cc:256] RPC call timeout handler was delayed by -1.359238441999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:21:48.822867  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3160384419998081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 12:21:48.823191  3964 connection.cc:256] RPC call timeout handler was delayed by -1.2998384419997819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:21:48.823515  3964 connection.cc:256] RPC call timeout handler was delayed by -1.23683844199968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:21:48.823827  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1306384419999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:21:48.824141  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1279384419999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:21:48.824437  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1279384419999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:21:48.824738  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1198384419999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:21:48.825048  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0874384419998933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 12:21:48.825356  3964 connection.cc:256] RPC call timeout handler was delayed by -1.07303844199987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:21:48.825672  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0352384419998089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:21:48.825984  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0343384419998074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 12:21:48.826300  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0181384419997812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 12:21:48.800967  6992 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:48.830263  6962 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.833508  6962 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:48.833935  6919 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.834523  6919 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:48.806213  6984 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:48.836062  6984 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.782160  6868 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:48.786594  6929 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.804432  6991 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.832710  6992 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:48.844027  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 89633us
I20260709 12:21:48.843923  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:48.813536  6996 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:48.851773  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 95607.3us
I20260709 12:21:48.856458  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.836961  6919 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.859692  3844 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:21:48.860514  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.803843  6985 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.861941  6985 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:48.862880  7001 consensus_queue.cc:1175] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:21:48.868134  6933 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:48.868263  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.868705  6933 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:48.869145  6966 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.869858  6966 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.869604  6933 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:48.871467  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.872229  6959 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.874166  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.874779  6933 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.879725  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.876590  6992 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.877832  6956 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:48.878007  6959 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.878594  6966 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:48.878875  6923 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:48.893435  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.894879  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.908592  6962 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:48.909914  7010 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:21:48.918468  6923 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.927842  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:48.928750  3919 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:21:48.933362  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51853.6us
I20260709 12:21:48.936492  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:48.942186  4547 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.804s (SENT)
I20260709 12:21:48.946414  3919 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:48.904124  6956 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.959957  6936 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.960481  6936 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:48.960856  6936 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.926970  6543 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:48.964088  6543 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:48.971571  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:48.970993  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:48.992806  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 111407us
I20260709 12:21:48.954910  6919 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:48.953256  6991 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:21:49.005018  6919 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:48.955269  7003 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:21:48.957754  7010 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:48.953310  6990 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:21:49.011236  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:48.987967  7014 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:49.016508  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 136854us
I20260709 12:21:48.955228  7009 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:21:48.983225  6917 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.019158  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:48.952073  7011 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 12:21:49.037781  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 146109us
I20260709 12:21:49.013748  6983 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.039340  6983 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.007432  6919 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.044272  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.040498  6983 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.049558  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.043929  7014 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:49.057134  6959 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.072402  7014 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:49.073508  3746 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:49.044783  6917 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:49.078644  6917 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.047889  7007 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:21:49.080184  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:49.084757  3746 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.055658  6956 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.092013  6966 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.063393  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.095733  6962 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.095258  3746 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 2 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.097563  3746 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.101534  6983 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.104943  3746 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.110469  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.106061  6936 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.121812  6966 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:49.122689  3842 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.124059  3746 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.125983  3746 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.126914  6936 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.126633  6701 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:49.128748  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:49.129041  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 192607us
I20260709 12:21:49.130412  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.130623  3746 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:49.131691  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139448us
W20260709 12:21:49.132921  3748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 198) took 17457 ms (client timeout 15000 ms). Trace:
I20260709 12:21:49.133054  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.132745  3746 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.134476  6959 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.134838  7017 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:49.135690  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.136358  7017 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:49.136787  7017 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:49.136950  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:49.133438  3748 rpcz_store.cc:269] 0709 12:21:31.675680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.676423 (+   743us) service_pool.cc:224] Handling call
0709 12:21:49.132830 (+17456407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:48.124110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:48.130335 (+  6225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:48.130374 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:21:48.130387 (+    13us) tablet.cc:662] Decoding operations
0709 12:21:48.259028 (+128641us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:48.265519 (+  6491us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:48.267927 (+  2408us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:21:48.337779 (+ 69852us) tablet.cc:701] Row locks acquired
0709 12:21:48.338948 (+  1169us) write_op.cc:260] PREPARE: finished
0709 12:21:48.411675 (+ 72727us) write_op.cc:270] Start()
0709 12:21:48.411853 (+   178us) write_op.cc:276] Timestamp: P: 1783599708411611 usec, L: 0
0709 12:21:48.411883 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:21:48.412661 (+   778us) log.cc:844] Serialized 4000 byte log entry
0709 12:21:48.603181 (+190520us) op_driver.cc:464] REPLICATION: finished
0709 12:21:48.731281 (+128100us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f032a 00007fdc52975f14 00007fdc52975ec3 00007fdc52975e38 00007fdc52975df3 00007fdc529750dc 00007fdc5299ee16 00007fdc52986cbb 00007fdc5297139d 00007fdc52974d75
0709 12:21:48.757889 (+ 26608us) write_op.cc:301] APPLY: starting
0709 12:21:48.758008 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:48.758233 (+   225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:48.758255 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:48.759462 (+  1207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:48.765191 (+  5729us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:21:48.770817 (+  5626us) write_op.cc:312] APPLY: finished
0709 12:21:48.771172 (+   355us) log.cc:844] Serialized 77 byte log entry
0709 12:21:48.771380 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.772250 (+   870us) write_op.cc:454] Released schema lock
0709 12:21:48.772308 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:48.775189 (+  2881us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:48.775233 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5729,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":152414,"apply.run_cpu_time_us":3356,"apply.run_wall_time_us":17244,"num_ops":10,"prepare.queue_time_us":1663,"prepare.run_cpu_time_us":46860,"prepare.run_wall_time_us":790244,"raft.queue_time_us":28154,"raft.run_cpu_time_us":20546,"raft.run_wall_time_us":154377,"replication_time_us":175430,"spinlock_wait_cycles":5622144,"thread_start_us":201551,"threads_started":3,"wal-append.queue_time_us":123691}]]}
I20260709 12:21:49.134519  3746 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.139756  3746 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.141686  3746 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.148206  3746 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:49.137989  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.155083  6933 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:21:49.155193  3746 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.157052  6959 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.139801  6962 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:49.154922  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 110846us
I20260709 12:21:49.167647  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:49.143393  6996 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.139381  6966 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.161208  3746 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.153818  6701 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.139689  6956 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.137801  7017 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.154039  7015 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.170128  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.184731  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:49.187729  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:49.171953  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:49.195910  3919 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:49.196228  6962 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.191179  6701 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.199932  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:49.200392  3922 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:21:49.192917  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:49.140789  7008 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:49.145157  7009 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:49.174223  6996 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:49.204449  3844 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:49.213164  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.166070  6933 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:49.179281  7007 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:21:49.237869  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.214807  7005 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.178615  6936 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:21:49.188982  6991 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:21:49.188169  7023 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:21:49.250691  6996 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.222841  7008 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:49.216269  7018 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:21:49.251958  7008 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.252077  6996 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.253012  7008 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.254599  7008 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:49.267897  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 129990us
W20260709 12:21:49.270076  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.271039  7009 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:49.272703  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.274416  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.241307  6868 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.276515  7015 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.280130  7007 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:49.292455  7007 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.293349  7007 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:49.294929  7007 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.281739  6991 consensus_queue.cc:1243] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:21:49.297456  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 77707.2us
I20260709 12:21:49.283140  7027 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.279561  6956 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:21:49.287703  6868 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.302081  6868 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.282990  7018 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:49.304771  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 115179us
I20260709 12:21:49.307045  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.313500  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:49.314242  6959 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.308075  7018 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.315563  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.316900  6701 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.308964  7015 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:21:49.323999  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:49.324688  3845 raft_consensus.cc:606] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:49.317462  6991 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:49.325042  3845 raft_consensus.cc:614] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:49.325392  6991 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:49.324713  6956 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.317679  7001 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:49.330849  6991 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.336488  7017 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.330588  7024 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.337445  6985 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.337446  7024 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.337960  6985 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.338989  7024 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.339148  6985 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.340922  7024 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.340943  6985 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.344262  7011 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:49.344750  7011 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.345620  7011 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.350678  7023 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.351248  7023 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.350909  6991 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.352365  7023 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:49.353691  7029 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:21:49.354169  7023 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.356210  7027 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:49.356662  7027 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:49.357559  7027 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.359047  7027 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.347005  7011 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:49.365872  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:49.343080  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:49.367129  3845 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:49.367544  3845 raft_consensus.cc:614] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:49.321288  7018 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.370245  7018 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.379843  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:49.380518  3845 raft_consensus.cc:606] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:49.380899  3845 raft_consensus.cc:614] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:49.395682  6991 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.401630  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:49.402256  3924 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.402573  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:49.403170  3845 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:49.403539  3845 raft_consensus.cc:614] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:49.404685  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.405802  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:49.412544  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:49.413450  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:49.418807  3849 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:49.429121  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:49.432615  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 116113us
I20260709 12:21:49.433447  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.435057  7015 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.439199  3924 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:49.440303  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:49.440651  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.441174  7008 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.441888  7015 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.441931  7008 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.443248  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.443260  7008 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.444855  7015 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.445657  6725 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:49.446221  6725 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.446976  6725 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.446215  3964 leader_election.cc:400] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:21:49.447821  3964 leader_election.cc:403] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:49.448992  7015 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:21:49.451313  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.452984  7015 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:49.455327  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.457628  7027 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:49.460143  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.462242  7015 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:49.458254  7027 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.463817  7027 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.464847  7015 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:49.465713  3923 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:49.468147  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.469137  3995 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.471031  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.471765  3995 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.476761  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.477442  3995 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:21:49.482077  3924 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:49.483804  6923 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:49.492394  3814 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.855s (SENT)
I20260709 12:21:49.498606  3842 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.500295  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.502930  7027 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.512912  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.513180  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.513589  3993 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:49.513877  3994 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:49.516100  7008 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:49.516975  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:49.519176  7027 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:49.533020  3993 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:49.537338  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.541934  6725 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.543634  3998 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.546453  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:21:49.552435  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.554296  3849 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.535209  6992 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.577296  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.544056  7015 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:21:49.568557  6996 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:49.608556  7036 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.593150  6959 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:21:49.592346  6701 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.609666  7017 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.610009  6701 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.610440  7017 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.610841  7017 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:49.611655  7017 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:49.576100  6992 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.612844  6701 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.613523  7015 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:49.608688  6996 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:49.616499  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:49.623495  3844 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:49.621153  3964 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:21:49.616837  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:49.625152  3964 leader_election.cc:403] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:49.612905  7017 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.617336  6868 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.626966  6868 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:49.628002  6868 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.629467  6868 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.625245  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:49.614500  6992 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.633374  7027 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:21:49.633790  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.632357  6992 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:49.634769  6992 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.635252  6992 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.639639  7027 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.635308  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:49.644361  7027 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.645498  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:49.648367  7027 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:49.653812  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:49.655124  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.658336  6725 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.659396  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:49.665489  3848 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:49.666996  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:49.667999  6725 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:49.668883  6725 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:49.666215  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:49.658774  6959 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.673432  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.673574  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.674088  3995 raft_consensus.cc:2376] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10. Re-sending same reply.
I20260709 12:21:49.674539  3998 raft_consensus.cc:2376] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8. Re-sending same reply.
I20260709 12:21:49.675041  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.675612  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.675674  3990 raft_consensus.cc:2376] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:21:49.671584  7027 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.671082  7036 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:49.677126  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.688234  3998 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.681185  3996 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:49.679935  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.689668  3997 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.690863  3814 leader_election.cc:336] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.867s (SENT)
I20260709 12:21:49.692873  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.695504  3889 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.699031  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:49.705785  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.710788  3997 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:49.712803  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.716709  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:49.718787  3925 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:21:49.720316  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:49.721235  7020 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:49.721798  7020 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.722247  7020 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.721088  3997 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:21:49.727011  3924 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:49.729027  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:49.728935  6993 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.694056  6543 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.715023  6929 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.756439  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.715265  6996 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.764077  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.765290  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.673998  6725 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.761664  7011 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:21:49.854069  7011 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.854597  7011 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:49.855618  7011 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.858407  3848 raft_consensus.cc:1217] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Deduplicated request from leader. Original: 6.3->[8.4-8.4]   Dedup: 8.4->[]
I20260709 12:21:49.858999  3848 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:21:49.762630  6543 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.865943  7034 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.4, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:49.866811  7034 consensus_queue.cc:1243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:21:49.899055  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.900509  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.852804  6996 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:49.916818  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.928143  6543 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:49.928687  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:49.930806  6996 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:49.934597  3999 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.905529  7011 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.943012  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:49.966872  3999 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.968906  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.943264  6991 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:49.976368  3999 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:49.972622  3998 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
W20260709 12:21:49.978138  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 257149us
W20260709 12:21:49.992264  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.980950  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:49.966343  7009 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:21:49.996284  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.012573  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:50.018985  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 307865us
I20260709 12:21:49.978727  6991 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:50.046944  7024 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.982709  6992 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.087425  7024 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:50.118176  7056 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.250s	user 0.005s	sys 0.000s
W20260709 12:21:50.149057  7054 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:21:50.152232  7023 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.135680  6991 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.155572  6996 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:50.194999  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 147677us
I20260709 12:21:50.179509  7023 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:50.218641  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 70557.3us
I20260709 12:21:50.226857  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:50.228935  3996 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:21:50.233013  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 176803us
I20260709 12:21:50.233732  3996 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:50.205253  7068 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:50.207016  7069 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.207293  6992 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.238116  3996 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:21:50.241991  7063 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:21:50.242386  7065 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:21:50.243649  7057 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:21:50.254594  7066 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:21:50.265296  7068 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:50.280864  7056 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:21:50.309211  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 82444.5us
I20260709 12:21:50.332242  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:50.320305  6868 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:50.319571  7067 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.011s
I20260709 12:21:50.209131  7024 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:50.327754  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 45667.2us
I20260709 12:21:50.343990  7068 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.333662  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:50.349666  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:50.278136  7069 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.320566  6959 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:50.356963  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.357684  3848 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:50.351760  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:50.335850  7064 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.157s	user 0.000s	sys 0.004s
I20260709 12:21:50.361104  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:50.353046  7058 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:50.395782  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:50.399410  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.336687  7077 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:50.404807  6868 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:50.354115  6959 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:50.413975  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.363432  7068 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.415277  3844 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:50.426409  3916 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:50.418659  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:50.428279  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.404719  7010 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.395254  6996 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:50.434930  6959 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.443698  7001 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:50.432184  3925 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:50.406754  7058 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.415405  7062 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.509174  7068 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:50.596838  7068 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:50.597090  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 163670us
I20260709 12:21:50.508666  7010 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.597446  7068 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:50.563254  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 117238us
I20260709 12:21:50.599742  7010 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:50.574721  6959 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:50.603570  6993 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.849s	user 0.005s	sys 0.016s
W20260709 12:21:50.497448  7011 consensus_meta.cc:287] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.004s
I20260709 12:21:50.604075  6993 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:50.603853  7058 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.605351  7069 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.606102  7058 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.608418  7011 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.497812  7067 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:50.503942  7023 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.612061  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:50.594262  7020 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.872s	user 0.020s	sys 0.010s
I20260709 12:21:50.621860  7023 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:50.625556  7023 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.627990  7023 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.629812  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:50.631095  6868 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:50.632967  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:50.633951  7018 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:50.634382  7018 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.634755  7018 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.635915  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.619526  7011 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.638814  7011 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.640229  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:50.640971  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.654884  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.655846  3922 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:50.661365  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.679426  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2099) took 1002 ms. Trace:
I20260709 12:21:50.679879  3990 rpcz_store.cc:276] 0709 12:21:49.677087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.677240 (+   153us) service_pool.cc:224] Handling call
0709 12:21:49.677551 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.716295 (+ 38744us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:49.761840 (+ 45545us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.862653 (+100813us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b180038b8a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:21:50.644416 (+781763us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.644975 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.645149 (+   174us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:50.645201 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.645269 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.647120 (+  1851us) raft_consensus.cc:1685] finished
0709 12:21:50.679220 (+ 32100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.679365 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":691484,"prepare.queue_time_us":45431,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7623,"raft.queue_time_us":730305,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":2197888,"thread_start_us":116725,"threads_started":1,"wal-append.queue_time_us":200033}
W20260709 12:21:50.722647  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 292652us
I20260709 12:21:50.661899  7007 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:50.678121  6868 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:50.682442  7011 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.609783  7062 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.686748  7028 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.687005  7036 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.693533  7091 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.662048  7020 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.690526  7010 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.786913  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 1709) took 1076 ms. Trace:
I20260709 12:21:50.779306  7090 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.787603  3921 rpcz_store.cc:276] 0709 12:21:49.710048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.711623 (+  1575us) service_pool.cc:224] Handling call
0709 12:21:49.712069 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.911525 (+199456us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:49.944065 (+ 32540us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.337685 (+393620us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.337959 (+   274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.345801 (+  7842us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.345962 (+   161us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.364262 (+ 18300us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.364483 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.364560 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.786567 (+422007us) raft_consensus.cc:1685] finished
0709 12:21:50.786602 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.786817 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52975,"prepare.queue_time_us":130578,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":169,"raft.queue_time_us":258062,"raft.run_cpu_time_us":624,"raft.run_wall_time_us":57686,"thread_start_us":534736,"threads_started":4,"wal-append.queue_time_us":154028}
I20260709 12:21:50.779553  7008 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.789065  7090 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.789912  7008 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.792280  7008 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.794029  7090 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:50.796746  6966 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.797394  6966 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.783638  6725 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.801826  6725 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.809202  7027 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:50.809839  7027 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.810357  7018 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.811740  3844 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:50.816709  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:50.817639  4575 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 4.
I20260709 12:21:50.824450  6966 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:50.825169  7062 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.777971  7007 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.825867  3916 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:50.827529  7007 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.829228  7028 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.831715  7036 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.834061  7036 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:50.834719  7091 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.836166  7010 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.838305  7010 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.839406  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.841364  7020 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.842999  4579 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:50.844635  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 422) took 1011 ms. Trace:
I20260709 12:21:50.844964  4579 rpcz_store.cc:276] 0709 12:21:49.833456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.833665 (+   209us) service_pool.cc:224] Handling call
0709 12:21:49.893573 (+ 59908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.843521 (+949948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.844421 (+   900us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b540012b1d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:50.844577 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183045888}
I20260709 12:21:50.845688  3848 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:50.847255  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.847895  3845 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:21:50.778266  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 82746.3us
I20260709 12:21:50.848404  6868 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.850029  7078 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.850634  7078 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.853791  7078 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.855814  7091 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.857080  6725 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.861243  7079 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.861871  7079 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.864436  7079 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:50.869377  7027 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:50.871254  3747 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.873304  3747 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:50.879329  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.880226  3916 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:50.884269  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.885052  3925 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:50.883229  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.891937  3922 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:50.875106  3747 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:50.896260  3747 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 5, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 5 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.901242  3990 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:50.903345  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.904798  3996 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:50.905820  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.906629  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:50.905967  3747 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:50.903908  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.908278  3992 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:50.908403  3747 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.910267  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.910959  3996 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:50.912181  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.912990  3996 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:50.914135  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.914907  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:50.917788  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.923818  3996 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:50.910905  3747 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.932466  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.935746  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.942251  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.936492  3842 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:21:50.944187  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.944198  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:50.891683  6725 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:50.958959  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:50.893121  7001 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.930027  7027 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.960175  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1109) took 1065 ms. Trace:
I20260709 12:21:50.963970  3998 rpcz_store.cc:276] 0709 12:21:49.894286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.983989 (+ 89703us) service_pool.cc:224] Handling call
0709 12:21:49.984425 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.984785 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.984824 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.020380 (+ 35556us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.186981 (+166601us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:50.231835 (+ 44854us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.959809 (+727974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.959905 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.959949 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:50.959965 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.960111 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474479,"prepare.queue_time_us":45262,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":11941,"raft.queue_time_us":544693,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":37276,"thread_start_us":379571,"threads_started":2,"wal-append.queue_time_us":180093}
I20260709 12:21:50.960268  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1110) took 1065 ms. Trace:
I20260709 12:21:50.931206  7036 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.929738  7076 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:50.891505  7068 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.825192  7011 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:50.956991  7028 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:50.966138  3999 rpcz_store.cc:276] 0709 12:21:49.894558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.997691 (+103133us) service_pool.cc:224] Handling call
0709 12:21:49.998140 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.998451 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.998488 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:50.018287 (+ 19799us) log.cc:844] Serialized 26 byte log entry
0709 12:21:50.102785 (+ 84498us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:50.103131 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.959839 (+856708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:50.959935 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.959988 (+    53us) raft_consensus.cc:1685] finished
0709 12:21:50.960004 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.960195 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551707,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":585929,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":67009,"thread_start_us":339532,"threads_started":2,"wal-append.queue_time_us":147571}
I20260709 12:21:50.982717  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:50.985541  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.987207  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.988265  3999 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:50.989308  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.991845  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:50.992733  3999 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:50.992568  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.994642  3994 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:50.994961  3998 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:50.994014  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:50.996008  3845 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:21:50.997143  3844 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:50.998831  3990 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:51.000844  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.001695  3992 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:51.002784  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.004498  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.005290  3996 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:51.006417  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.004730  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:51.009485  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:50.984491  3921 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:51.010787  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.009711  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.021864  3999 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:51.025426  3746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 213) took 13162 ms (client timeout 15000 ms). Trace:
I20260709 12:21:51.027658  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.028548  3845 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:51.014672  3990 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:21:51.036262  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.037109  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:50.962250  6725 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.042930  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:50.965451  7001 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.056989  7062 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:51.057780  7034 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.058478  7001 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.046694  7082 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.049968  6966 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:51.050566  6988 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:50.995934  7028 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.975227  7088 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:21:51.021310  7094 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:50.972381  7036 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:50.967047  7027 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.060099  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:21:51.026175  3746 rpcz_store.cc:269] 0709 12:21:37.834827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.835096 (+   269us) service_pool.cc:224] Handling call
0709 12:21:50.996605 (+13161509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:49.340962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:49.341629 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:49.341674 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:21:49.341701 (+    27us) tablet.cc:662] Decoding operations
0709 12:21:49.343510 (+  1809us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:49.343582 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:49.343614 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:21:49.344832 (+  1218us) tablet.cc:701] Row locks acquired
0709 12:21:49.344855 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:21:49.345019 (+   164us) write_op.cc:270] Start()
0709 12:21:49.345144 (+   125us) write_op.cc:276] Timestamp: P: 1783599709344967 usec, L: 0
0709 12:21:49.345163 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:21:49.352636 (+  7473us) log.cc:844] Serialized 5920 byte log entry
0709 12:21:49.425236 (+ 72600us) op_driver.cc:464] REPLICATION: finished
0709 12:21:49.658178 (+232942us) write_op.cc:301] APPLY: starting
0709 12:21:49.658309 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:49.658682 (+   373us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:49.659857 (+  1175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:49.717399 (+ 57542us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:49.721643 (+  4244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:21:49.721702 (+    59us) write_op.cc:312] APPLY: finished
0709 12:21:49.722101 (+   399us) log.cc:844] Serialized 107 byte log entry
0709 12:21:49.722954 (+   853us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.723129 (+   175us) write_op.cc:454] Released schema lock
0709 12:21:49.723189 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:49.759554 (+ 36365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.761550 (+  1996us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9427,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":230203,"apply.run_cpu_time_us":7909,"apply.run_wall_time_us":85413,"num_ops":15,"prepare.queue_time_us":106634,"prepare.run_cpu_time_us":5133,"prepare.run_wall_time_us":45353,"replication_time_us":79903,"thread_start_us":199532,"threads_started":2}]]}
I20260709 12:21:51.020865  3996 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:51.060328  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.081709  3888 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.065963  7082 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.068504  6988 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.018167  3747 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.072898  7018 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.092518  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.098404  3921 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:51.100901  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.102748  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.103996  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.105083  7090 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.099067  3747 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.107714  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.107100  3747 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 12, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.109095  3747 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.088032  7069 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.088891  7082 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:51.112777  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 175156us
I20260709 12:21:51.091099  6988 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.113420  3747 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.119428  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1108) took 1225 ms. Trace:
I20260709 12:21:51.120292  3747 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.119912  3997 rpcz_store.cc:276] 0709 12:21:49.893938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.894098 (+   160us) service_pool.cc:224] Handling call
0709 12:21:49.894575 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.895202 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.895238 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.900209 (+  4971us) log.cc:844] Serialized 52 byte log entry
0709 12:21:50.005374 (+105165us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:50.017525 (+ 12151us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.075891 (+1058366us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.119125 (+ 43234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.119206 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.119244 (+    38us) raft_consensus.cc:1685] finished
0709 12:21:51.119255 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.119373 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":726426,"prepare.queue_time_us":11501,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":669590,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":9093,"thread_start_us":507734,"threads_started":3,"wal-append.queue_time_us":209590}
I20260709 12:21:51.123051  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.074765  7028 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.124408  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.099632  6991 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:51.126688  3747 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.129142  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1107) took 1235 ms. Trace:
I20260709 12:21:51.129350  3747 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.130595  3747 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.115276  7069 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.147184  7069 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.148183  7097 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:51.148639  7097 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:51.149590  7097 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.150924  7097 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.129588  3993 rpcz_store.cc:276] 0709 12:21:49.893523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.893671 (+   148us) service_pool.cc:224] Handling call
0709 12:21:49.903646 (+  9975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:49.903911 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:49.910487 (+  6576us) log.cc:844] Serialized 14 byte log entry
0709 12:21:50.817009 (+906522us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4800060cd8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:21:50.994834 (+177825us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.035893 (+ 41059us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.036090 (+   197us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:51.096858 (+ 60768us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.122915 (+ 26057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.122985 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.128918 (+  5933us) raft_consensus.cc:1685] finished
0709 12:21:51.128939 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.129082 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":654489,"prepare.queue_time_us":6572,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":668735,"raft.run_cpu_time_us":1065,"raft.run_wall_time_us":127594,"spinlock_wait_cycles":52299008,"thread_start_us":492683,"threads_started":3,"wal-append.queue_time_us":198954}
I20260709 12:21:51.139371  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.153914  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.153970  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.155825  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:51.112888  7090 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.115293  7055 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.115971  7059 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:51.113101  6992 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.115895  7095 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.175328  3992 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:51.171092  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:51.131727  3747 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.174026  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2106) took 1494 ms. Trace:
I20260709 12:21:51.199152  3747 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.173341  7007 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.203603  7007 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.204005  7007 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.174650  7055 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.208093  7055 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.210337  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.211851  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.213421  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.214048  3848 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:51.214385  7017 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.214916  7017 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.172631  7090 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.215618  3845 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:51.215966  7090 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.217178  7017 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.200806  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 6, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.217733  7017 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.218269  7017 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.218344  3747 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.219941  3747 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 8, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.221091  7015 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.188863  6992 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.221781  6962 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.221654  7015 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.222414  6962 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.222869  7036 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.223850  6725 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.223985  7015 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.224426  7068 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.132056  6543 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:51.145539  7001 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:51.255590  7001 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:51.256510  7001 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.257877  7001 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.198491  3991 rpcz_store.cc:276] 0709 12:21:49.688066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.688239 (+   173us) service_pool.cc:224] Handling call
0709 12:21:49.688758 (+   519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.715672 (+ 26914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:49.715704 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.724508 (+  8804us) log.cc:844] Serialized 52 byte log entry
0709 12:21:50.186758 (+462250us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:50.200532 (+ 13774us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.138069 (+937537us) log.cc:844] Serialized 14 byte log entry
0709 12:21:51.173708 (+ 35639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.173785 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:51.173825 (+    40us) raft_consensus.cc:1685] finished
0709 12:21:51.173836 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:51.173969 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585067,"prepare.queue_time_us":45315,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":571014,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":53542,"thread_start_us":820100,"threads_started":3,"wal-append.queue_time_us":520132}
I20260709 12:21:51.221643  3747 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 6, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 6 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.215631  7096 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.260110  7096 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.260617  3747 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.262548  7096 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.262181  3747 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 3 to 5, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 5 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.128178  7060 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:21:51.233292  7098 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.264495  7098 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.199385  7095 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.266733  7095 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.255107  7028 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.189455  7024 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.271849  7024 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.272269  7024 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.146682  7083 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:51.240640  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.276062  7083 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.278350  7083 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.279613  7060 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.280128  7060 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.286015  7098 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.171023  6868 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.248247  6962 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.248952  7027 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.249568  7017 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.221820  6992 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.190579  7100 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.282312  7069 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.303889  7100 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.287680  3747 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 2 to 4, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 4 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.306330  7069 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.306974  7100 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.252079  6543 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.307161  3747 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.307982  6543 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:51.309109  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:51.282287  7060 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.310698  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:51.311309  4579 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:51.234175  7011 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.252909  7015 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.312181  7015 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.312558  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:51.313146  4579 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:51.314280  7015 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.253099  7034 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.228701  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.314975  7034 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:51.315600  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 352644us
I20260709 12:21:51.317106  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.317253  7034 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.151955  6991 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.243492  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:51.318954  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 124366us
I20260709 12:21:51.318629  7095 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.319433  6991 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.320914  7095 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.328509  7024 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.309527  3747 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:21:51.331719  3747 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.318570  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:51.334295  7100 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.335371  7100 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.338064  7100 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.346387  7100 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.347795  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:51.351384  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 180390us
I20260709 12:21:51.255121  3962 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.356739  7009 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:51.362529  7082 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.416481  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.417407  3845 raft_consensus.cc:2368] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8.
I20260709 12:21:51.418665  4546 leader_election.cc:400] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8.
I20260709 12:21:51.419024  4546 leader_election.cc:403] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:21:51.419525  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:51.372076  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55051.1us
W20260709 12:21:51.368187  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 243860us
I20260709 12:21:51.420158  4575 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.372625  6991 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.421324  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.399803  7024 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.423911  7070 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.424372  7070 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.424751  7070 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.427491  4575 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:51.428907  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:51.427570  7100 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.430321  7100 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:51.430835  7100 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:51.431845  7100 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.433334  7070 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.439994  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:51.441095  7097 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.441586  7097 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.442039  7097 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.447062  7070 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.373553  7090 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.449481  7090 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.371084  6988 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.405097  6966 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:51.451886  6966 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.454180  6966 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.411491  4579 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:21:51.454002  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.399577  7007 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.411613  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.386603  7055 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:51.460028  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48535us
I20260709 12:21:51.461442  7055 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.411991  7009 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:51.461866  7104 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.462344  7104 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.462241  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:51.462824  7104 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.462962  7001 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:51.464215  7106 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:51.464671  7106 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:51.465039  7106 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:51.465868  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44329.8us
I20260709 12:21:51.462255  7009 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.412552  6959 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:51.473074  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.473806  3995 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:51.474715  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.475487  3992 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.476153  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.476631  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.477334  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.477918  3995 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:51.478825  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.479378  3990 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.482005  7055 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:51.482542  7055 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.485024  7055 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.485467  6959 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:51.486008  6959 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.488098  6959 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.489295  3993 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:51.490775  3992 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:51.492219  7104 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.493351  7009 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.489264  3997 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:51.496162  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:51.496410  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:51.496817  4579 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:21:51.497087  4575 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9.
W20260709 12:21:51.413232  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 158179us
I20260709 12:21:51.498967  3990 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:51.499171  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:51.363511  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 237300us
I20260709 12:21:51.419670  7079 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.421787  6991 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.500969  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.504346  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.505438  3997 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.508438  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.406761  6992 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.515026  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.515781  3848 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:51.495910  7106 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.517482  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.518085  7106 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.518260  3991 raft_consensus.cc:2368] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:51.394486  6543 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.521286  6543 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:51.521668  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.522006  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.523227  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:51.519718  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.524983  3990 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:51.523262  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.525532  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.527397  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:51.527962  4579 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:51.529754  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.532177  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.532783  3847 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:51.534811  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.535408  3847 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:51.538643  4579 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:51.526170  3841 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:21:51.541658  3849 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9.
I20260709 12:21:51.542516  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.543571  3999 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:51.504072  7104 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.546828  7009 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.522995  6966 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:51.550700  3997 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:51.551744  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.552580  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.553494  3848 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:51.556175  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.557394  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.557622  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.558197  3841 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:51.560808  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.561815  3841 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:51.563776  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.564690  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.566238  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.565902  3815 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9.
I20260709 12:21:51.510062  6991 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.567675  3815 leader_election.cc:403] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:51.567049  3993 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:21:51.565907  3841 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.510927  7034 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:51.576399  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.572064  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.572352  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.577114  3814 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.577523  3849 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:51.572695  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.573249  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.573439  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.574579  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.578621  7082 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.522678  7055 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:51.579548  7103 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:51.580044  7103 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.580463  6992 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.580884  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.581650  3847 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.578795  3922 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:51.583727  6988 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.585876  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.586552  3922 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:51.578730  3924 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:51.588936  3845 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:51.558977  3962 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.596407  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.596522  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.603981  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.606391  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.609741  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.597126  3962 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.570307  6966 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:51.611340  6966 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.611548  7100 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:51.611763  6966 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.612013  7100 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:51.612411  7100 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.580420  7103 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:51.616225  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.617141  7015 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.617743  7015 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.618348  7015 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.605937  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.620820  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.621718  7010 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:51.623320  7011 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:51.624439  7100 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.607172  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.625461  3848 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.626114  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.624864  7011 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:51.628015  7011 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:51.606572  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:51.628890  7011 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.610527  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.632030  3994 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:51.632808  7010 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:51.633744  7010 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.634720  7100 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.631119  7015 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.637167  3848 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:51.638360  7015 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:51.643414  7024 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:51.643962  7024 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:51.644869  7024 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.655120  7007 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:51.603993  7095 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:51.656642  7095 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.657078  7095 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.660606  3849 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:51.665045  7001 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:51.669346  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:51.669777  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.672226  3847 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:51.674970  3841 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:51.676055  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.617612  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:51.680450  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.576514  7017 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:51.686503  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.689586  3994 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.595608  7069 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.595793  7055 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:21:51.690683  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73138.3us
I20260709 12:21:51.691246  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.693105  3991 raft_consensus.cc:2368] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8.
I20260709 12:21:51.683753  7009 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9.
I20260709 12:21:51.683773  7034 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:51.693730  7069 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.697151  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:51.700955  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:51.701756  3925 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:51.702466  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.693279  3962 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.707749  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:51.684171  7104 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:51.708349  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:51.746194  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:51.739310  3889 leader_election.cc:400] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7.
I20260709 12:21:51.734172  3841 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:51.736904  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.743584  3994 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:51.749147  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.749393  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:51.749904  3998 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:21:51.733004  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:51.750769  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:51.737756  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47188.3us
I20260709 12:21:51.764321  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.769375  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:52.013502  3998 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:51.695020  7034 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.713142  6959 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:51.778256  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:51.695981  7017 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.705842  7097 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.883332  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:51.747351  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:52.020294  3847 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.010344  7095 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:51.708911  7015 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.815629  7055 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:51.763885  7028 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:51.751583  6962 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:51.746724  6701 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.744468  7027 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:52.014432  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 266019us
W20260709 12:21:52.013926  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 273752us
W20260709 12:21:52.021263  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 273938us
I20260709 12:21:52.061786  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:52.056139  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 347883us
I20260709 12:21:52.070621  3997 raft_consensus.cc:2368] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
W20260709 12:21:52.046880  7079 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.007s
I20260709 12:21:52.073776  3994 raft_consensus.cc:2368] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:21:52.027426  7015 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.102365  3847 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:52.059792  6993 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.047771  7098 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:52.068429  7086 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.053197  6959 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:52.055573  6701 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.116499  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:52.083817  7020 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:52.074888  6543 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.075764  7077 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.082202  7079 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8.
I20260709 12:21:52.082386  7100 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:52.080827  7070 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.139343  3841 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:52.100531  7015 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:52.050913  7103 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.064234  6962 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.071424  7027 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:52.163640  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 101946us
I20260709 12:21:52.138289  6701 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.183779  3844 raft_consensus.cc:2368] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:21:52.189844  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:52.150604  6991 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.010s
I20260709 12:21:52.137744  7028 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:52.192574  4575 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:52.194689  7028 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:52.197427  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:52.130625  6993 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.132464  7086 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:52.209173  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 150625us
I20260709 12:21:52.208379  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:52.213073  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:52.150328  6543 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.194591  6991 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.160869  7070 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.253396  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:52.200572  7100 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.265188  3841 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:52.184864  7098 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:21:52.208765  7096 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.154629  7077 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:52.319254  6966 consensus_meta.cc:287] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.006s
I20260709 12:21:52.334653  7100 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:52.263911  6959 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:52.360492  7120 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 12:21:52.344887  7097 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.354077  7017 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.363391  7034 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.373415  7139 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:52.388159  7126 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:21:52.373783  7123 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:21:52.392967  6543 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:52.394142  7121 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:21:52.394586  7103 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.364624  6966 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:52.395922  7125 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:21:52.396634  6962 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.337163  7028 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.397985  7095 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:52.398175  6966 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.375756  7020 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:52.401043  7077 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.400573  7139 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.410084  7139 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.406773  7027 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.414146  6993 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.414865  6991 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.416492  7086 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.416545  7070 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:52.418749  7119 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.407s	user 0.000s	sys 0.004s
I20260709 12:21:52.426216  7139 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.484380  7020 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:52.491542  7139 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.497107  6701 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.506153  6701 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.509780  7015 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:52.513859  7015 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:52.660892  7117 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 1.007s	user 0.006s	sys 0.016s
W20260709 12:21:52.669885  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 455728us
I20260709 12:21:52.676088  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.678130  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.679145  3920 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.683418  7090 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.684495  7090 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.687916  7090 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.692744  3920 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:52.694192  7083 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:52.694581  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.695308  7083 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.695809  3920 raft_consensus.cc:2368] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:52.697376  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.698626  7083 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.698688  3920 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:52.700464  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.701215  3920 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:52.708031  7011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.071s	user 0.019s	sys 0.002s
W20260709 12:21:52.708701  7011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.020s	sys 0.003s
I20260709 12:21:52.709304  3920 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
W20260709 12:21:52.712759  7115 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 1.018s	user 0.008s	sys 0.005s
W20260709 12:21:52.719398  3815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.006s
W20260709 12:21:52.719899  3815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.012s	sys 0.006s
I20260709 12:21:52.721374  3920 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:52.725067  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:52.725575  3920 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:52.725967  7083 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:52.727345  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.728744  3920 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:52.729100  3815 leader_election.cc:400] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:52.729338  3815 leader_election.cc:403] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:52.729971  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.730017  7083 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:52.730796  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:52.730937  3920 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:52.731832  7083 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:52.732352  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:52.732499  7083 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:52.734128  7083 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.740775  3920 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:52.741469  7083 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.742321  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 1241) took 1221 ms. Trace:
I20260709 12:21:52.742532  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.743292  3920 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.742843  7083 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:52.742844  3842 rpcz_store.cc:276] 0709 12:21:51.520715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.520829 (+   114us) service_pool.cc:224] Handling call
0709 12:21:51.521143 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.544681 (+ 23538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.544713 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.566771 (+ 22058us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b2c000014c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:51.567185 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.696474 (+129289us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:51.696527 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.696633 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.741629 (+1044996us) raft_consensus.cc:1685] finished
0709 12:21:52.741704 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.742067 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5211,"raft.queue_time_us":24182,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":8181120,"thread_start_us":126059,"threads_started":1,"wal-append.queue_time_us":441277}
I20260709 12:21:52.743793  7001 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:21:52.753252  3920 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:21:52.747213  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:52.759294  3920 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:52.760016  7001 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:52.760661  7001 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:52.760815  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.761600  3918 raft_consensus.cc:2376] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13. Re-sending same reply.
I20260709 12:21:52.762336  7001 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.766266  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.767544  3919 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:21:52.769930  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:52.779886  7083 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.780627  7083 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:52.782080  7083 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.786209  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 1143) took 1262 ms. Trace:
I20260709 12:21:52.791874  7106 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.786764  3992 rpcz_store.cc:276] 0709 12:21:51.523658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.523769 (+   111us) service_pool.cc:224] Handling call
0709 12:21:51.524079 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.540468 (+ 16389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.540501 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.547737 (+  7236us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.749935 (+202198us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:51.749975 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.750085 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.785496 (+1035411us) raft_consensus.cc:1685] finished
0709 12:21:52.785554 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.785880 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19895,"thread_start_us":201693,"threads_started":1,"wal-append.queue_time_us":583581}
I20260709 12:21:52.798220  7096 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.798676  3993 raft_consensus.cc:2368] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:52.799168  7096 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.801224  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 2143) took 1123 ms. Trace:
I20260709 12:21:52.801752  3993 rpcz_store.cc:276] 0709 12:21:51.677809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.678002 (+   193us) service_pool.cc:224] Handling call
0709 12:21:52.800829 (+1122827us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002963d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:52.801074 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518092544}
I20260709 12:21:52.802299  7096 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:52.817402  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 2146) took 1137 ms. Trace:
I20260709 12:21:52.818094  3997 rpcz_store.cc:276] 0709 12:21:51.680043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.680172 (+   129us) service_pool.cc:224] Handling call
0709 12:21:52.816814 (+1136642us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54002959d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:52.817137 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894864640}
I20260709 12:21:52.821982  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2137) took 1334 ms. Trace:
I20260709 12:21:52.822557  3995 rpcz_store.cc:276] 0709 12:21:51.487891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.490223 (+  2332us) service_pool.cc:224] Handling call
0709 12:21:51.490557 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.490900 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.490926 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.491397 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:21:51.605356 (+113959us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:51.605402 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.605468 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.659767 (+1054299us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:21:52.821308 (+161541us) raft_consensus.cc:1685] finished
0709 12:21:52.821336 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.821777 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3765,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12759,"spinlock_wait_cycles":46424960,"thread_start_us":113621,"threads_started":1,"wal-append.queue_time_us":161863}
I20260709 12:21:52.869931  7011 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:52.870723  7011 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:52.872067  7011 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:52.873685  7011 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.876641  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:52.884984  3922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1727) took 1216 ms (client timeout 1531 ms). Trace:
W20260709 12:21:52.885602  3922 rpcz_store.cc:269] 0709 12:21:51.668901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.669043 (+   142us) service_pool.cc:224] Handling call
0709 12:21:52.884563 (+1215520us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540024ed54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:52.884763 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524282112}
W20260709 12:21:52.890002  3964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.027s	sys 0.022s
W20260709 12:21:52.890443  3964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.027s	sys 0.022s
W20260709 12:21:52.890753  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 653389us
I20260709 12:21:52.891891  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:52.897536  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.905087  7096 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:52.913362  4546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.010s	sys 0.026s
W20260709 12:21:52.914714  4546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.011s	sys 0.027s
I20260709 12:21:52.934661  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 430) took 1411 ms. Trace:
I20260709 12:21:52.935213  4575 rpcz_store.cc:276] 0709 12:21:51.522838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.522978 (+   140us) service_pool.cc:224] Handling call
0709 12:21:52.934203 (+1411225us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b540060fed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:52.934416 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456051456}
I20260709 12:21:52.942938  3889 leader_election.cc:400] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:21:52.943478  3889 leader_election.cc:403] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:52.944447  6868 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:21:52.954533  6817 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:52.960335  6817 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:52.964003  6817 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:52.980861  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.982178  3922 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:52.988222  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.989751  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.988533  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:52.991976  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.992754  3924 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:52.994119  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:52.994820  3921 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:52.996647  6817 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.997418  6817 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:52.999930  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:53.002317  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:53.005110  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:53.006045  3814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.004s	sys 0.030s
W20260709 12:21:53.006489  3814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.004s	sys 0.030s
I20260709 12:21:53.006536  6817 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.005977  3847 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:53.009608  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:53.010421  3920 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:53.011292  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 2052) took 1301 ms. Trace:
I20260709 12:21:53.011807  3844 rpcz_store.cc:276] 0709 12:21:51.709891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.710007 (+   116us) service_pool.cc:224] Handling call
0709 12:21:53.010847 (+1300840us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540011b7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:53.011084 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391675648}
I20260709 12:21:53.016727  7096 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.020784  7096 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.023123  7096 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:53.028162  7096 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.028836  7096 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.031028  7096 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.034691  3921 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:53.036449  3924 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:53.035864  7096 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:53.038218  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:53.039182  7096 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.041978  7096 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:53.042629  7096 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.044027  7096 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.046856  7096 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.047583  7096 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.048401  7096 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.051182  7096 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:53.051204  6817 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:53.051862  7096 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.051985  6817 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.052529  6817 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.055166  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2150) took 1321 ms. Trace:
I20260709 12:21:53.056018  3999 rpcz_store.cc:276] 0709 12:21:51.733907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.736020 (+  2113us) service_pool.cc:224] Handling call
0709 12:21:51.736352 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:51.745074 (+  8722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.745105 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:51.745706 (+   601us) log.cc:844] Serialized 52 byte log entry
0709 12:21:52.045151 (+299445us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:52.045201 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.046340 (+  1139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.054606 (+1008266us) raft_consensus.cc:1685] finished
0709 12:21:53.054657 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.054931 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251250,"raft.queue_time_us":9196,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14239,"thread_start_us":35937,"threads_started":1,"wal-append.queue_time_us":397803}
W20260709 12:21:53.060111  3994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 1153) took 1324 ms (client timeout 1757 ms). Trace:
W20260709 12:21:53.060775  3994 rpcz_store.cc:269] 0709 12:21:51.735195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.749108 (+ 13913us) service_pool.cc:224] Handling call
0709 12:21:53.059605 (+1310497us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400197dd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:53.059870 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743715712}
W20260709 12:21:53.062724  3990 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.006s	sys 0.015s
W20260709 12:21:53.063897  3990 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.006s	sys 0.016s
I20260709 12:21:53.063155  7096 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.065551  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2148) took 1380 ms. Trace:
I20260709 12:21:53.066107  3990 rpcz_store.cc:276] 0709 12:21:51.685576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.685721 (+   145us) service_pool.cc:224] Handling call
0709 12:21:51.688527 (+  2806us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:51.699526 (+ 10999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.699568 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:51.700247 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:21:52.151156 (+450909us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:53.064543 (+913387us) log.cc:844] Serialized 14 byte log entry
0709 12:21:53.065029 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.065160 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.065243 (+    83us) raft_consensus.cc:1685] finished
0709 12:21:53.065261 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.065470 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12202,"prepare.queue_time_us":257681,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":11549,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":37321,"thread_start_us":1018773,"threads_started":2,"wal-append.queue_time_us":605592}
I20260709 12:21:53.075634  7017 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.076534  7017 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:53.087266  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 199452us
I20260709 12:21:53.094981  7161 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.095868  7161 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.098255  7122 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.099185  7122 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.102167  7122 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.102229  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:53.102851  7122 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.103056  3994 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:53.106711  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.108821  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:53.109710  3999 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.106587  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.112830  3995 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:53.106590  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:53.117375  3996 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:53.120157  7122 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:53.121857  7124 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.932s	user 0.003s	sys 0.000s
I20260709 12:21:53.125313  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:53.125638  7017 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:53.088768  6817 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:53.134652  3888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.017s	sys 0.012s
I20260709 12:21:53.123103  7122 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:53.170310  7118 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 1.514s	user 0.014s	sys 0.000s
W20260709 12:21:53.204341  3891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.020s	sys 0.019s
I20260709 12:21:53.277256  7083 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:53.277720  3923 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:53.278204  7083 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:53.279891  3891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.023s	sys 0.025s
I20260709 12:21:53.283365  7015 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.284451  7128 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.284229  7015 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.285188  7128 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.286268  3999 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:21:53.288169  3888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.022s	sys 0.017s
I20260709 12:21:53.288479  3994 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:53.286670  7015 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:53.300302  3924 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:53.303488  7020 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.304273  7020 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.309145  6868 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.309676  7058 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.309978  6868 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.310371  7058 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.311185  4583 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:53.312618  7058 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.313205  7058 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.313792  7058 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.316022  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.317695  3999 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:53.319060  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.319422  7011 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.320183  7011 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:53.312619  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 1.25349e+06us
I20260709 12:21:53.322546  7011 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.355829  7122 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.356726  7122 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.359505  7096 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.290398  7017 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.360718  7017 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.740682  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.776567  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:53.821695  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:53.922739  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:21:53.458707  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 167419us
I20260709 12:21:53.927275  3992 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:53.323200  7011 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.404211  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.928957  4579 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:21:53.506348  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.803020  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:53.463853  3814 leader_election.cc:400] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:53.423368  3888 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9.
W20260709 12:21:53.485745  7162 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:21:53.725688  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:21:53.862421  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4280 after lost signal to thread 2680
I20260709 12:21:53.932322  3888 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:53.913376  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:53.932219  3814 leader_election.cc:403] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:53.936165  3844 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.935819  3997 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:53.936491  3995 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.741196  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:53.873103  6817 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.363948  7009 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:53.507071  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.757s (SENT) [suppressed 46 similar messages]
I20260709 12:21:53.402849  7161 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.941411  4583 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:53.941875  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4f60 after lost signal to thread 3782
I20260709 12:21:53.883960  7008 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.872252  7017 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.438287  7104 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.768953  7106 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.947710  7009 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.724362  7111 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.362577  6991 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.624s
I20260709 12:21:53.952121  6725 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9.
I20260709 12:21:53.705065  7028 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:53.953128  7088 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:53.873646  7128 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.704869  7142 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.922535  7020 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:53.952507  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 597378us
I20260709 12:21:53.884441  7069 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.486342  7010 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.938990  6868 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:53.949571  7011 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:53.966625  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4e20 after lost signal to thread 3874
I20260709 12:21:53.964705  4547 leader_election.cc:400] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8.
W20260709 12:21:53.984140  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4e40 after lost signal to thread 3875
I20260709 12:21:53.973620  7167 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:53.965090  7104 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.967541  7017 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:53.989223  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08003c98e0 after lost signal to thread 3949
W20260709 12:21:53.991755  4605 debug-util.cc:398] Leaking SignalData structure 0x7b080038a6a0 after lost signal to thread 3950
I20260709 12:21:53.993916  7170 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:53.996059  7170 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:53.986011  7142 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:53.999064  7142 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:53.976262  7083 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:54.002863  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08003bde00 after lost signal to thread 4023
I20260709 12:21:54.001497  7088 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.004768  7011 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:54.007699  4605 debug-util.cc:398] Leaking SignalData structure 0x7b080022c520 after lost signal to thread 4608
W20260709 12:21:54.008638  4605 debug-util.cc:398] Leaking SignalData structure 0x7b080032aac0 after lost signal to thread 4609
I20260709 12:21:54.010829  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:54.014748  7167 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.015341  7088 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.016290  7130 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.016865  7130 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.017234  7167 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.019213  3995 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:21:54.020169  4605 debug-util.cc:398] Leaking SignalData structure 0x7b0800197840 after lost signal to thread 7018
I20260709 12:21:54.021070  7168 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.021721  7130 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.021636  7168 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.023101  7036 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.023751  7036 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:54.025328  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08001c28a0 after lost signal to thread 7073
I20260709 12:21:53.986858  7128 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:54.032431  7128 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.031173  7170 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:53.984455  7106 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:53.983134  7008 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.035589  7011 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.045998  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.046293  7011 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.048651  7011 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:54.031806  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 94329.4us
I20260709 12:21:54.050820  7106 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.052292  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.055208  3842 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:54.055805  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.057070  7163 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:54.059027  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.060618  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.062361  7009 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.064183  7128 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.064169  3844 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:21:54.064776  7168 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.065584  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.066305  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.067222  7069 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:54.048544  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.068176  7020 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:54.068847  7020 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:54.041740  7017 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.069875  7020 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.071794  7017 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.044644  7122 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.077811  4583 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:54.079952  3744 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.080982  7166 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:54.081650  7166 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:54.082655  7166 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.084136  7166 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.087589  7088 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:54.087678  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 624050us
I20260709 12:21:54.088207  7088 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:54.088649  7088 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.088762  3814 leader_election.cc:400] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7.
I20260709 12:21:54.045080  7083 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.093362  7083 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.026937  7058 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.067296  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.101930  7058 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.104790  4583 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:21:54.106128  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63166.3us
I20260709 12:21:54.111925  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.113812  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.116484  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:53.984611  7111 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:54.128587  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61377.6us
I20260709 12:21:54.129732  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.130914  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.131611  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.131623  4579 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:54.134385  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.138353  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.010315  7010 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.136021  7058 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:54.008567  7028 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.143930  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.156280  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.156605  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.157011  3841 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:54.139863  7170 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:54.150846  7106 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.164342  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:54.182336  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:54.160212  7170 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.183949  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.189647  7028 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.190457  7083 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.193009  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.197742  7009 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:54.198843  7011 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:54.200387  7170 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.189677  7010 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.159277  7106 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.199280  7011 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:54.221791  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.222499  3842 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:54.225644  7001 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.241616  7128 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.242857  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.244071  7165 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.259387  7036 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.260620  7165 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.262449  7106 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.262879  7165 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.252413  7111 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.225700  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:54.263881  3844 raft_consensus.cc:606] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.264271  3844 raft_consensus.cc:614] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:54.227334  7028 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:54.228013  7017 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:54.265460  7017 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.257509  7001 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:54.258527  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100543us
I20260709 12:21:54.222126  7011 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.215408  7109 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:54.275697  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:54.282063  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:54.282274  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 775205us
I20260709 12:21:54.282756  3846 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:54.259582  7008 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.276887  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:54.286630  3844 raft_consensus.cc:606] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:54.287276  6725 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:54.286558  3744 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.287895  6725 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.288841  3744 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 7 to 8, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:54.290539  7088 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.291690  6725 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.294174  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722124affb914f0496100070a9582045"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:54.295975  3844 raft_consensus.cc:606] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:54.259879  7128 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.300422  6868 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.301270  6868 consensus_queue.cc:1243] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:21:54.302515  7069 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:54.278386  3962 leader_election.cc:400] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:21:54.278807  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.278916  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:54.279009  7001 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.279482  7058 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.280328  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.280524  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:54.281205  3842 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:54.275584  7017 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.308909  3845 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:54.308960  7171 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:54.291067  3744 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.310446  7171 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.310878  7171 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.311185  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.311349  3744 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.313159  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.315973  7058 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.316251  7111 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:54.317414  7111 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:54.317785  7111 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:54.318543  7058 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.308403  3962 leader_election.cc:403] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.318775  7111 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.319939  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.320335  7017 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:21:54.320796  7036 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.321659  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:54.320456  7111 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.322494  7017 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:54.323215  3843 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:21:54.323231  7017 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:54.324280  7109 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:54.324780  7017 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.325315  7109 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:54.327831  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102446us
I20260709 12:21:54.329623  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.329717  7170 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.331310  3848 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:54.332595  3990 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:54.333309  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.333472  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.333638  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.333941  3995 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:21:54.334203  3997 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:54.334887  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.335306  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.335673  3842 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:54.335005  7058 raft_consensus.cc:2764] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:21:54.336483  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.337201  3843 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:54.302904  7069 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:54.339476  7069 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.341140  7069 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.343107  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:21:54.343771  7001 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.344364  7001 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.344743  7088 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.343765  3997 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.345896  3997 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:54.376433  3849 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:54.392979  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.395732  7169 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:54.397110  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:54.398625  7036 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.399327  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:54.399194  7036 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.401140  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.401626  7036 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.406344  3990 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:54.411191  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.413075  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:54.414158  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 114280us
W20260709 12:21:54.420043  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 141884us
I20260709 12:21:54.302981  7128 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.426282  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:54.427534  3996 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.427670  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.433396  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.440106  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.441491  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.442390  3844 raft_consensus.cc:2410] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:21:54.444391  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.426265  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:54.426124  7169 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:54.446251  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 117014us
I20260709 12:21:54.446601  3995 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:54.456734  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:54.465902  7059 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:54.466466  7059 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.466853  7059 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.467651  7082 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:21:54.468178  3993 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:54.475556  3844 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:54.476886  7170 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.479255  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.480449  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.481503  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.482615  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.483876  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.484225  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.484642  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.432284  7011 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.485483  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.485747  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.486140  3999 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:54.486846  7011 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.487344  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.487607  3850 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:54.488541  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.489108  3994 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:54.489511  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.489974  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.490204  3843 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:21:54.490638  3842 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:54.468386  7082 consensus_queue.cc:1243] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:54.491803  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.492336  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.492555  3846 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:54.483804  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.491814  3962 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.495855  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.486919  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.487114  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.497610  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.498307  3996 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:21:54.505818  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.506572  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.505856  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.508525  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:54.506596  3993 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:54.506143  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.521953  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.530647  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:54.531256  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.533118  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.533896  3921 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 4.
I20260709 12:21:54.545847  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.545958  3844 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:54.547135  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.552086  3844 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:54.552438  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.553148  3849 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:54.554906  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.556138  3844 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:54.556664  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.507750  7036 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:54.559190  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.559381  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.558882  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.576073  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.456215  7104 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.482813  7171 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.592711  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.598300  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:54.608152  3924 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:54.608794  3924 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:54.605928  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.612233  3917 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:54.613070  3998 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:54.614574  7180 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.613122  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.616614  3918 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:54.577852  7036 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.630753  3841 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:54.634049  7187 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.637133  7028 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.638703  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:54.661715  3846 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:54.639853  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.642181  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.643098  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.648125  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.649181  7001 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.651957  7171 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.653649  3920 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:21:54.654289  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.655576  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.659863  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.629370  3924 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.659787  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:54.665968  4575 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.665155  3920 pending_rounds.cc:85] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 4
I20260709 12:21:54.667237  3920 pending_rounds.cc:107] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:21:54.670274  3920 raft_consensus.cc:2889] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.670629  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.671253  3925 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:54.626287  7179 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:54.679919  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.681259  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.658205  7036 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.679011  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.683604  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:54.684116  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.684512  3924 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.686271  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.689286  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.689544  3997 raft_consensus.cc:2368] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:21:54.658263  7187 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.691713  7017 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.692622  3923 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:54.615396  7180 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:54.698235  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.701035  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.707281  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.684196  7171 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:54.716956  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 221211us
I20260709 12:21:54.672685  7028 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.738207  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.694965  7187 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.729569  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.699734  7178 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.746454  7069 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:54.746254  7178 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.746995  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.742841  3964 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:21:54.749357  3964 leader_election.cc:403] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.749183  3888 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.737913  3962 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.689854  7179 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.770316  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:21:54.774447  7028 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.776394  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:54.777894  3962 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:21:54.703253  7017 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.787339  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.790050  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:54.801066  7188 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:21:54.804315  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.804600  7188 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:54.805182  7188 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.805563  7188 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.785128  7058 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:54.808223  3924 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:21:54.809562  3843 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:54.771260  7192 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.796363  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.810349  3924 pending_rounds.cc:85] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 4
I20260709 12:21:54.811801  3924 pending_rounds.cc:107] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:21:54.812115  3924 raft_consensus.cc:2889] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.812702  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.814141  4575 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:54.740221  7171 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.815634  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.785863  7069 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:54.826787  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:54.831082  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60889.6us
I20260709 12:21:54.820828  6868 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:54.835829  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.842141  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.824739  7009 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:54.846719  6868 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:54.850317  7179 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.850083  6868 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.847749  7069 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:54.821557  7192 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.852880  7171 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.852890  7178 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.854606  7192 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.855491  3924 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:54.841065  7109 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:54.876441  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57378.6us
I20260709 12:21:54.880584  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.856626  7009 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:54.847636  7202 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:54.893388  7059 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.895093  7017 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.895817  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.900141  7009 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.915478  3918 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:21:54.901199  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71724.8us
I20260709 12:21:54.901294  7200 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:54.872045  7197 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:54.888849  7069 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:54.911581  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.886341  7193 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:21:54.920472  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:54.925788  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.879962  7028 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:54.888046  7171 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:54.933876  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56447.9us
W20260709 12:21:54.921722  7190 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 12:21:54.933061  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.899147  7187 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.937904  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.936578  4581 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:54.932525  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 100482us
I20260709 12:21:54.939190  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.944854  3888 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:54.946090  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:54.927305  7194 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.926141  7180 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:54.923239  7197 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.904024  7133 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:21:54.934847  7028 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.951179  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:54.953516  7187 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.959739  7069 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:54.940850  7104 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:54.967832  4576 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:54.963395  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:54.965665  7197 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.948100  7192 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.971869  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.970585  3924 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:54.968609  7028 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:54.972272  7036 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.986930  7036 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:54.987778  7036 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.960460  4574 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:54.949211  7202 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:54.982784  7187 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:54.989698  7187 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:54.984454  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:54.990748  3916 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:54.990216  7202 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:54.991953  7187 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.948135  7194 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.992516  7211 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:54.995972  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:54.942633  7171 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:54.927507  7200 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:55.016698  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.018139  3842 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:55.016544  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:54.996975  7058 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.004443  7194 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:55.073515  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 153123us
W20260709 12:21:55.124009  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.199721  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 260560us
I20260709 12:21:55.201457  7059 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:55.201696  7216 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.202116  7201 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:55.201709  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 127067us
I20260709 12:21:55.205426  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.202283  7216 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.207152  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.209120  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.209120  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.213039  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.219532  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.224349  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.057309  7058 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.009509  7211 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.246703  7197 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.248782  7214 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.249097  7197 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.249184  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:55.249374  7214 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.224326  7059 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:55.251720  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:55.253208  7205 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:55.253722  7205 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.254072  7205 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.234345  7170 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.255818  7213 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:21:55.244501  7008 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:21:55.260838  7008 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:55.261349  7218 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:55.261799  7212 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:55.261865  7218 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:55.262692  7218 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:55.263026  7208 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:21:55.257325  3814 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.266561  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.273486  3814 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.232861  7036 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:55.281698  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 66999.8us
I20260709 12:21:55.288208  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.288496  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.288757  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.289237  3847 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.293776  7214 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.294402  3994 pending_rounds.cc:85] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:21:55.293905  3998 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:55.294791  3994 pending_rounds.cc:107] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:21:55.295271  3994 raft_consensus.cc:2889] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:55.303160  7188 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.303853  7171 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.305428  3998 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:55.306893  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.307578  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:55.315263  3999 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:55.222376  7180 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:21:55.320885  3847 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:55.322449  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.323275  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.281028  7170 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:55.284129  7201 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.292517  7008 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:55.264424  7010 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:21:55.329638  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.333876  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.335794  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.310727  7214 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:55.321656  7165 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:21:55.330971  7008 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.344091  7008 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.338356  7036 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:55.348413  7200 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:55.348174  7036 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.348881  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.348819  7185 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:55.350104  7177 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.336637  7201 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.351681  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:55.354635  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.358805  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 190) took 8310 ms. Trace:
I20260709 12:21:55.366690  7008 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.360602  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 444) took 1016 ms. Trace:
I20260709 12:21:55.361023  7187 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.362118  7036 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.360613  7028 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.363296  7017 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:55.339389  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.363315  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.371744  7214 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.324009  7171 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:21:55.388420  7217 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:55.388976  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.390398  7216 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.391875  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.426538  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.326409  7170 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.375092  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.364200  3747 rpcz_store.cc:276] 0709 12:21:47.051784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.059541 (+  7757us) service_pool.cc:224] Handling call
0709 12:21:47.370976 (+311435us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:55.358563 (+7987587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:51.529732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:51.530304 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:51.530341 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:21:51.530359 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:51.532288 (+  1929us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:51.532378 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:51.532407 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:21:51.534645 (+  2238us) tablet.cc:701] Row locks acquired
0709 12:21:51.534665 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:51.534806 (+   141us) write_op.cc:270] Start()
0709 12:21:51.534934 (+   128us) write_op.cc:276] Timestamp: P: 1783599711534762 usec, L: 0
0709 12:21:51.534955 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:51.535868 (+   913us) log.cc:844] Serialized 10915 byte log entry
0709 12:21:52.512135 (+976267us) op_driver.cc:464] REPLICATION: finished
0709 12:21:52.516542 (+  4407us) write_op.cc:301] APPLY: starting
0709 12:21:52.516743 (+   201us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:52.517440 (+   697us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:52.517611 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:52.521611 (+  4000us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:52.522432 (+   821us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:21:52.522548 (+   116us) write_op.cc:312] APPLY: finished
0709 12:21:52.523491 (+   943us) log.cc:844] Serialized 188 byte log entry
0709 12:21:52.523781 (+   290us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:52.524905 (+  1124us) write_op.cc:454] Released schema lock
0709 12:21:52.525020 (+   115us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:52.525636 (+   616us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:52.525656 (+    20us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59559,"reported_tablets":52,"spinlock_wait_cycles":506992512,"child_traces":[["op",{"apply.queue_time_us":3890,"apply.run_cpu_time_us":9150,"apply.run_wall_time_us":9153,"num_ops":28,"prepare.queue_time_us":95680,"prepare.run_cpu_time_us":55029,"prepare.run_wall_time_us":220238,"raft.queue_time_us":25757,"raft.run_cpu_time_us":4696,"raft.run_wall_time_us":4744,"replication_time_us":976760,"thread_start_us":294772,"threads_started":4,"wal-append.queue_time_us":475800,"wal-append.run_cpu_time_us":33735,"wal-append.run_wall_time_us":1513635}]]}
I20260709 12:21:55.359927  3842 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:55.428678  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:55.408814  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45573.4us
I20260709 12:21:55.393558  7218 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.431353  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.374315  7201 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.429302  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.445608  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.447844  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:55.451323  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.459650  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.423249  7083 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.436189  7104 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.433568  7170 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.436813  7200 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.430779  7171 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.490597  7227 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.494434  7220 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:55.497473  7188 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.399771  4574 rpcz_store.cc:276] 0709 12:21:54.344552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.371175 (+ 26623us) service_pool.cc:224] Handling call
0709 12:21:55.360388 (+989213us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540046c3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:55.360517 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816010496}
W20260709 12:21:55.527652  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 76463.9us
I20260709 12:21:55.464967  7010 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:55.449512  7216 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 12:21:55.539179  7175 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:21:55.539616  7222 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:55.508358  7201 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.547729  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.532703  7036 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.563736  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:55.560432  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100890us
I20260709 12:21:55.536316  7202 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:55.540275  7222 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:55.586375  7222 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:55.586618  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:55.589069  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 156201us
I20260709 12:21:55.589931  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.590929  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.588619  7234 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:55.564949  6868 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.606810  7220 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:55.549808  7205 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.593175  7234 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:55.583035  7202 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.600759  7218 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.600957  7008 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:55.613365  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.617631  7187 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.615267  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.608671  7010 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:55.636476  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 313714us
I20260709 12:21:55.637486  3814 leader_election.cc:400] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:21:55.637883  3814 leader_election.cc:403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.638722  7236 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:21:55.641016  7200 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.642380  7223 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:55.637789  7220 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.643703  7236 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.645535  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.612589  7036 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:55.656925  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85385.9us
I20260709 12:21:55.618121  7214 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.659194  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:55.659938  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.666723  3923 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.660739  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:55.644732  7010 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:55.669410  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.615763  7234 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:55.672264  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:55.651726  7230 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.670938  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:55.617671  7216 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:55.673388  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.664027  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:55.673763  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.674360  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.670305  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.679205  3917 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:55.679270  3924 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:55.675957  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.680089  3922 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:55.681232  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.683506  7240 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:55.684072  7240 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:55.684422  7240 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.694655  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.695616  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.696069  3999 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:55.694695  3993 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:55.698189  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:55.699357  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:55.703672  7239 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:55.705572  7008 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.706964  7240 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.707404  7202 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.709617  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.680742  7171 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.712097  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.714273  7242 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:55.714999  7242 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.717628  7242 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.720008  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.720878  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.722602  7240 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:55.722738  7194 consensus_meta.cc:287] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
W20260709 12:21:55.724690  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51391.8us
I20260709 12:21:55.725111  3924 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:21:55.729612  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.672493  7010 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.730322  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:55.731528  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.688884  7236 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.692211  7205 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.735375  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.733878  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.735981  7009 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.733304  7128 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.731986  7194 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.747076  3995 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:55.748063  7194 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.754427  7028 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:55.772496  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.773885  3995 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:55.780275  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.783026  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.792230  3843 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:55.794157  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.798695  3995 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:55.799721  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65538.4us
I20260709 12:21:55.798985  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.801819  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.804538  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.806007  3990 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:55.811896  3995 pending_rounds.cc:85] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 4
I20260709 12:21:55.813400  3995 pending_rounds.cc:107] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:55.813871  3995 raft_consensus.cc:2889] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:55.814011  3849 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:55.811957  3996 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:55.793200  7008 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.797606  7009 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.797498  7083 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.820981  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.818558  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:55.819218  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.732539  7170 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.824102  3999 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:55.824294  3923 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
W20260709 12:21:55.880267  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61133.8us
I20260709 12:21:55.880781  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:55.880792  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59886.3us
I20260709 12:21:55.883025  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.885006  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.885506  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.886734  3990 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:55.886758  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.887287  3990 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:55.889343  3849 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:55.795986  7128 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:21:55.887007  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 58834.9us
I20260709 12:21:55.884845  7214 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.892249  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:55.900151  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 375) took 1100 ms. Trace:
I20260709 12:21:55.903846  4581 rpcz_store.cc:276] 0709 12:21:54.799475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.799883 (+   408us) service_pool.cc:224] Handling call
0709 12:21:54.800229 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:54.941157 (+140928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.899812 (+958655us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54005c03d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:55.900036 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309986176}
I20260709 12:21:55.901873  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.906512  3999 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:55.892876  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:55.907232  3847 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:55.911273  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.811234  7109 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:21:55.791714  7222 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:55.880057  7171 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.917634  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:55.882930  7180 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:55.927657  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45217.7us
W20260709 12:21:55.929735  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 125278us
I20260709 12:21:55.817763  7192 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:21:55.891953  7200 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.942993  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.938889  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.945885  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.948961  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.949060  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:55.953856  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.968391  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.973999  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:55.943712  7201 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:55.977548  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:55.925431  7218 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:21:55.952170  7028 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:55.970762  7194 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.968932  7246 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.971668  7214 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:55.960506  7248 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.004742  3999 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:55.979624  7237 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.980326  7200 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.988059  7218 consensus_queue.cc:1243] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:21:56.022240  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69029.3us
I20260709 12:21:56.026525  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:56.030385  7230 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.035948  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:56.002490  7236 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:56.024121  7242 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:56.037346  3990 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:55.988735  7201 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.047796  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:56.052330  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 109439us
I20260709 12:21:56.034922  7228 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:56.040750  7220 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:56.039008  7248 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:56.070235  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:56.051193  7128 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.027694  7243 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.228s
W20260709 12:21:56.073081  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 191770us
I20260709 12:21:56.073359  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:56.054239  7009 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.079507  7234 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.080235  7256 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:56.082016  7234 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:56.082559  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:56.082849  7243 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:56.083535  7243 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.085843  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:56.073405  7180 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:56.102236  7104 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:56.102761  7104 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.104059  7243 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.106235  7222 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:56.087225  7170 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:56.109763  7248 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:56.112121  7201 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.115157  4581 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:56.116353  7222 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.116905  7222 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.121284  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:56.120947  7261 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:56.127343  7009 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.127961  7009 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.130012  7009 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.139698  7171 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:56.145682  7222 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:56.149395  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2197) took 1444 ms. Trace:
I20260709 12:21:56.149884  3991 rpcz_store.cc:276] 0709 12:21:54.704944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.705128 (+   184us) service_pool.cc:224] Handling call
0709 12:21:54.738847 (+ 33719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:54.819542 (+ 80695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:54.819576 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:54.819620 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:54.819657 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.149137 (+1329480us) spinlock_profiling.cc:243] Waited 80.4 ms on lock 0x7b5400390154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:56.149188 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.149322 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184960256}
I20260709 12:21:56.151374  7165 raft_consensus.cc:993] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:21:56.151947  7165 raft_consensus.cc:1081] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:21:56.157229  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:56.159605  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:56.160027  7242 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.160738  7242 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.162719  7220 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.163228  7220 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.176527  3842 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:21:56.180310  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:56.173918  7036 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:21:56.256129  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 170355us
I20260709 12:21:56.257043  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:56.258292  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 67167.7us
I20260709 12:21:56.259279  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:56.279856  3991 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:56.281378  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:56.282197  3999 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.258919  6868 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.257753  7111 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.300823  3999 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
W20260709 12:21:56.275426  7010 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.007s
I20260709 12:21:56.268582  7088 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:56.305588  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:56.268420  7234 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.306625  3998 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:56.260886  7260 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:56.312386  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55452.5us
I20260709 12:21:56.277014  7017 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:56.294422  3997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "722124affb914f0496100070a9582045"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:21:56.317764  3997 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:56.300071  7201 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.318233  3997 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.293694  7163 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.321992  7017 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:56.322096  7268 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:56.323467  7017 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.320490  7088 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.341364  7088 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.304849  6868 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.309170  7111 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.328593  7192 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.311326  7010 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.355888  7058 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:56.359658  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45892.7us
I20260709 12:21:56.374044  7058 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:56.374356  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:56.374621  7058 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.372632  3990 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:56.375313  7223 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:56.364444  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50370.3us
I20260709 12:21:56.377629  7058 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.380805  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.380560  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.383502  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.389220  3920 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:56.389472  7010 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:56.385754  7265 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:21:56.453676  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.453754  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.454937  3921 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.391811  3843 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:56.455641  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60742.6us
I20260709 12:21:56.384613  7189 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:56.462591  3842 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:56.461792  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85629.7us
I20260709 12:21:56.400050  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:21:56.464627  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 64782.7us
I20260709 12:21:56.386862  7192 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:56.379532  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.343056  7255 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.465971  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.466224  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.466534  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.328117  7234 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.329118  7201 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.467898  3924 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:21:56.492112  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:56.465979  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.493700  3919 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:56.494791  3846 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:56.321516  7220 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.468636  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:56.501310  3842 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:56.331389  7163 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.488296  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.511009  3918 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:56.489064  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.337189  7230 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:21:56.453861  7246 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:56.486970  3921 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:21:56.512332  3922 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:56.588610  7104 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.589775  7180 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:56.457684  7069 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
W20260709 12:21:56.593796  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59771.4us
I20260709 12:21:56.595916  7163 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:56.459753  7223 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:56.601997  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.623940  3921 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:56.624089  7223 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.343258  7256 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:21:56.602631  3919 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:56.560171  7165 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:56.628098  3990 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:56.631394  3990 pending_rounds.cc:85] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 7
I20260709 12:21:56.630672  3814 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:56.636394  3990 pending_rounds.cc:107] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:56.637316  3990 raft_consensus.cc:2889] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:56.648072  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 204785us
I20260709 12:21:56.583320  7088 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:21:56.675401  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 208690us
I20260709 12:21:56.626883  7192 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.620896  7180 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.633926  7058 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:56.706444  3922 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:56.510195  7255 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.710070  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.649698  7009 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.674093  7163 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.715303  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.716423  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:21:56.707834  7242 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.001s
I20260709 12:21:56.722577  3922 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:56.689508  7111 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:56.680567  7165 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:56.681627  7189 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:56.725595  7209 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:21:56.726259  7281 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:56.726469  7220 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:56.727115  7249 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:21:56.727500  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:21:56.728826  7263 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:21:56.729949  7288 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:56.731704  7180 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.597004  7246 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.733353  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:56.734963  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:56.735919  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:56.708877  7069 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:56.752701  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:56.754341  3917 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:21:56.759622  7266 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 12:21:56.760454  7234 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.703364  7192 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.762240  4575 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:56.955943  3842 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:56.844898  3918 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
W20260709 12:21:56.946455  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:56.855108  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 206049us
I20260709 12:21:56.780463  3997 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.973451  3997 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.741714  7009 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:56.975263  3732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 294965us
I20260709 12:21:56.952466  7179 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.760967  6868 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:56.952306  7211 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:56.870282  7290 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.980232  7271 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:56.990362  7271 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.990942  7291 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.868465  7270 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:56.736027  7163 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.871132  7279 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:56.959740  7288 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.962926  7069 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.988794  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:56.953194  7281 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:56.799857  7255 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.989899  7290 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.765004  7104 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:56.991350  7271 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.792309  7201 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:56.743255  7242 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.993841  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:56.994405  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:56.987210  7179 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:56.966693  6817 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:21:56.992295  7192 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:56.757223  7189 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:56.763334  7165 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.039839  7281 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.004035  7270 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:56.996068  7291 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.084481  7271 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.088304  7246 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.089114  7230 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:57.088970  7069 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.090121  7300 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.091665  7058 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.049443  6868 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.085044  7009 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.256776  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 2115) took 1105 ms. Trace:
I20260709 12:21:57.094314  7109 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:57.255719  7288 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.265503  7109 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:57.266139  7288 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:57.266572  7109 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.268630  6725 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:57.269043  6725 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:57.269855  6725 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.270275  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:57.270864  6725 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.267558  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:57.272529  7207 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:57.272601  7275 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.273128  7207 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:57.274119  7207 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.274694  7109 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.277691  7180 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.278920  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.213433  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:57.280659  3924 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 5.
I20260709 12:21:57.281997  7058 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.284260  7058 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.053187  7279 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.286901  7279 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:57.213655  7263 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:57.290174  7300 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.291482  6868 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:57.149091  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 171215us
I20260709 12:21:57.197264  7285 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.225590  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:57.093029  7242 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.301589  3921 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:57.295135  3843 rpcz_store.cc:276] 0709 12:21:56.151104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.153093 (+  1989us) service_pool.cc:224] Handling call
0709 12:21:56.153494 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.455936 (+302442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.256404 (+800468us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540011bcd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:57.256688 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547605760}
W20260709 12:21:57.321182  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.324231  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.311201  7275 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:21:57.335662  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.324411  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.335987  7275 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.337455  7297 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.311578  7170 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.312961  6725 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:57.353844  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.339473  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:21:57.359704  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.360996  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:57.338060  7297 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:57.375524  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.378387  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.362381  6725 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.382558  6725 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.391537  7246 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.392186  7246 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.394246  3924 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:57.394296  7246 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.361661  7170 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.398002  7170 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.406754  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 2120) took 1232 ms. Trace:
I20260709 12:21:57.407217  3850 rpcz_store.cc:276] 0709 12:21:56.173931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.174157 (+   226us) service_pool.cc:224] Handling call
0709 12:21:56.174457 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.174671 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:56.470592 (+295921us) log.cc:844] Serialized 14 byte log entry
0709 12:21:57.406291 (+935699us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b180026f9e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287
0709 12:21:57.406400 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:57.406446 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:57.406501 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.406566 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.406688 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37203,"prepare.queue_time_us":451629,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":121721,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":5859072,"thread_start_us":384519,"threads_started":2}
I20260709 12:21:57.408615  7187 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.409253  7187 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.409775  7017 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.410403  7017 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:57.411610  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 1.02784e+06us
I20260709 12:21:57.415717  7216 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.416316  7216 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.418588  7216 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.420176  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.420357  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:57.421399  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:57.422696  3997 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:57.423575  3998 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:21:57.423753  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.424499  7200 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.424597  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.425036  7200 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.425747  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.426249  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.427129  7200 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.427790  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:57.430716  3999 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:57.432124  7179 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.433699  7234 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.435644  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.438313  3849 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:57.458042  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.445333  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.446373  3992 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:57.447561  7274 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.849s	user 0.004s	sys 0.000s
I20260709 12:21:57.365525  7300 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.456159  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:21:57.460059  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44648.8us
I20260709 12:21:57.436008  7223 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:57.493088  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.496795  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.495915  7237 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:57.495164  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.497978  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.333928  7285 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.504443  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.498999  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.505640  3990 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:57.498709  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.508971  3999 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:21:57.515502  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.515889  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.520103  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.488569  7187 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.531667  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.533578  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.535827  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.536975  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.539659  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:57.522989  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 226686us
I20260709 12:21:57.524957  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.490168  7216 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.369333  7270 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.547297  3848 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:57.522647  7275 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.519007  7179 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:57.518690  7213 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.547744  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.534989  7036 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:57.571738  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.573206  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.491739  7234 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.545869  7187 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.586571  7285 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.587594  7078 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.588279  7078 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.559814  7216 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:57.590451  7305 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:21:57.547698  7242 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:57.545693  7200 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.595711  7200 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.596261  7200 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.604424  3844 raft_consensus.cc:2410] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:21:57.550522  7211 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:57.559007  7194 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.625357  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2209) took 1814 ms. Trace:
W20260709 12:21:57.626542  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78912.1us
I20260709 12:21:57.625828  3995 rpcz_store.cc:276] 0709 12:21:55.811024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.811181 (+   157us) service_pool.cc:224] Handling call
0709 12:21:55.811658 (+   477us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:55.820302 (+  8644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.820332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:56.124587 (+304255us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:56.125214 (+   627us) log.cc:844] Serialized 78 byte log entry
0709 12:21:56.321523 (+196309us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:56.345520 (+ 23997us) log.cc:844] Serialized 14 byte log entry
0709 12:21:56.347819 (+  2299us) log.cc:844] Serialized 14 byte log entry
0709 12:21:57.390830 (+1043011us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b180042e440. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287 00007fdc52a0e208
0709 12:21:57.613118 (+222288us) log.cc:844] Serialized 14 byte log entry
0709 12:21:57.624959 (+ 11841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.625066 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:57.625117 (+    51us) raft_consensus.cc:1685] finished
0709 12:21:57.625134 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.625295 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35872,"prepare.queue_time_us":66973,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":1064259,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":62378,"spinlock_wait_cycles":12957696,"thread_start_us":417759,"threads_started":2,"wal-append.queue_time_us":342494}
I20260709 12:21:57.627604  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.605221  7270 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.611244  7201 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.640245  7078 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.625571  7205 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.626791  7197 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:57.643543  7205 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.618834  7194 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.654050  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.632256  7213 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:57.657383  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 296473us
I20260709 12:21:57.658578  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.650821  7194 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:57.677934  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 131901us
I20260709 12:21:57.652608  7291 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:57.689662  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.690183  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.672806  7220 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:57.685703  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.657209  7036 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.651294  7201 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:21:57.690613  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.654826  7205 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.662464  7187 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:21:57.700870  7200 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.684623  7165 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:21:57.705353  7010 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:57.707352  7246 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:57.707737  7201 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.707894  7246 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:57.694624  7036 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.708770  7036 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.708987  7246 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.710692  7246 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:57.687561  7285 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.663935  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.714646  7285 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:57.715130  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51310.7us
I20260709 12:21:57.716533  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:57.716938  7285 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.717829  7200 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:57.694753  3845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.004s	sys 0.005s
W20260709 12:21:57.725512  3845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.004s	sys 0.005s
I20260709 12:21:57.726197  7240 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.726840  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2175) took 1002 ms. Trace:
I20260709 12:21:57.727249  3920 rpcz_store.cc:276] 0709 12:21:56.724555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.068647 (+344092us) service_pool.cc:224] Handling call
0709 12:21:57.095713 (+ 27066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:57.291280 (+195567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:57.291315 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:57.291352 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:57.291381 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.726598 (+435217us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540036f6d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:57.726646 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.726776 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449335040}
I20260709 12:21:57.656000  7211 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:57.718470  7187 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:57.720132  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.721084  7205 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:57.721750  7237 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:57.723804  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:57.688876  7275 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.733532  7187 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:57.734603  7211 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:57.697857  7220 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:57.738817  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.697099  7312 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:57.720155  7194 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.757558  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.733515  7237 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.750456  7200 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.763142  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:57.767669  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.740048  4574 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.756422  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:57.767753  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:57.748517  7201 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.784546  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.785431  3847 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:57.786379  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.787878  3847 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:57.769767  7237 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:57.803290  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.764122  7234 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:57.804832  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.805343  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.805471  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.808300  7207 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.788174  7201 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.782209  7239 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.810700  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:57.741256  7275 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.759227  7312 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.817052  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 509) took 1421 ms. Trace:
W20260709 12:21:57.805269  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.758944  7242 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:57.842816  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 67607.1us
I20260709 12:21:57.764585  7036 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.786448  7262 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:57.848743  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.786283  7253 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:57.851555  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117770us
I20260709 12:21:57.779430  7200 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.852089  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:57.855774  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:57.786326  7205 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:21:57.844403  3845 rpcz_store.cc:276] 0709 12:21:56.395318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.396550 (+  1232us) service_pool.cc:224] Handling call
0709 12:21:56.470240 (+ 73690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:56.683835 (+213595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:56.683869 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:57.193382 (+509513us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b2c000014c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:21:57.194025 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:21:57.725899 (+531874us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:57.725939 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:57.726042 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:57.816626 (+ 90584us) raft_consensus.cc:1685] finished
0709 12:21:57.816652 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:57.816966 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37377,"raft.queue_time_us":121701,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":2218880,"thread_start_us":707143,"threads_started":2,"wal-append.queue_time_us":567123}
I20260709 12:21:57.841218  7246 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.848212  7234 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:57.827922  7187 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.856467  3919 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:57.869200  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:57.848874  7191 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:57.851157  7242 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.867161  7240 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:57.865326  7271 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.004s
W20260709 12:21:57.884615  7288 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.618s	user 0.017s	sys 0.000s
I20260709 12:21:57.884948  7246 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:57.898686  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 142370us
I20260709 12:21:57.890810  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:57.906066  7200 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.906378  3843 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:57.848798  7239 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.909747  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:57.907768  3843 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:57.911032  3998 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:57.913295  3999 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:57.892648  7315 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.854641  7262 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.855032  7253 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.921380  3997 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:57.925849  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.925874  3996 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.927700  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:57.927809  3995 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.928318  3993 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.929214  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.930575  3994 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.853138  7220 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.902962  7234 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:57.851177  7211 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.917228  7322 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.932338  7288 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.941097  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.942895  3995 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:57.944619  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:57.903081  7240 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:57.901288  7191 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.936830  7228 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:57.939879  7194 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.941532  7322 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.940137  7324 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.944203  7036 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:57.944905  7290 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.949617  7200 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.963562  7324 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:57.927729  7315 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.959602  7228 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.945263  7288 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:57.979434  7275 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.982180  7191 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.964820  7322 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.990119  7216 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.976359  7200 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:57.996119  7313 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 12:21:58.001499  7297 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.002090  7165 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.001385  4574 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:58.005187  7189 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.973141  7324 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.002743  7165 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.007555  7010 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.008069  7248 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:58.008486  7262 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.983633  7239 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.009945  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:58.010336  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.010197  7297 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:58.011292  7243 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:58.011943  7253 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:57.941287  7234 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.016906  7240 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.018886  7315 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.108964  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.109905  3850 raft_consensus.cc:2410] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:58.111289  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.020886  6868 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.024940  7069 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.030293  7312 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:57.816285  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.031280  7201 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:58.002086  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.003804  7200 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:58.036019  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.098847  3993 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:58.038092  7222 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.031394  3744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 113) took 10087 ms. Trace:
I20260709 12:21:58.005189  7288 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.136191  7288 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:58.136562  7288 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:58.137383  7288 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.138556  7288 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.128079  6725 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:58.140074  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130214us
I20260709 12:21:58.140025  6725 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.141613  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.142962  7271 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.143864  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.033447  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:58.147240  7316 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 12:21:58.148720  7179 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:58.036615  7246 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.150235  7237 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.152647  7165 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.122886  4581 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:58.153609  3990 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:58.142473  6725 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.125172  7104 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.157568  3843 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.157469  7104 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.158756  3843 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.132285  7242 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:58.133661  7328 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:21:58.133064  7222 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.134755  7297 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:58.109149  7010 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.163249  7222 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:58.163666  7297 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.164222  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.165066  7010 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.114158  7248 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.165832  7297 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.166113  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.166896  4581 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:21:58.133980  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.167800  7281 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.155144  7234 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:58.167996  3920 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:58.125313  7253 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:58.170326  7253 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.170643  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.173611  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.128180  3744 rpcz_store.cc:276] 0709 12:21:47.944200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.945192 (+   992us) service_pool.cc:224] Handling call
0709 12:21:48.267012 (+321820us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54003d46a8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc58be5331 00007fdc58be03fc 00007fdc587b1e84 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:58.031285 (+9764273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:54.546330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:54.547187 (+   857us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:54.547240 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:21:54.547275 (+    35us) tablet.cc:662] Decoding operations
0709 12:21:54.548105 (+   830us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:54.548198 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:54.548224 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:54.548880 (+   656us) tablet.cc:701] Row locks acquired
0709 12:21:54.548931 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:21:54.549105 (+   174us) write_op.cc:270] Start()
0709 12:21:54.549266 (+   161us) write_op.cc:276] Timestamp: P: 1783599714549037 usec, L: 0
0709 12:21:54.549289 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:21:54.549998 (+   709us) log.cc:844] Serialized 2054 byte log entry
0709 12:21:55.377690 (+827692us) op_driver.cc:464] REPLICATION: finished
0709 12:21:55.489854 (+112164us) write_op.cc:301] APPLY: starting
0709 12:21:55.489961 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:55.490150 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:55.490299 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:55.491185 (+   886us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:55.491423 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:55.491522 (+    99us) write_op.cc:312] APPLY: finished
0709 12:21:55.491832 (+   310us) log.cc:844] Serialized 47 byte log entry
0709 12:21:55.492044 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.492171 (+   127us) write_op.cc:454] Released schema lock
0709 12:21:55.492222 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:55.492685 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.492720 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111906,"reported_tablets":9,"spinlock_wait_cycles":40268032,"child_traces":[["op",{"apply.queue_time_us":111854,"apply.run_cpu_time_us":2768,"apply.run_wall_time_us":2788,"num_ops":5,"prepare.queue_time_us":71937,"prepare.run_cpu_time_us":20213,"prepare.run_wall_time_us":120524,"raft.queue_time_us":350472,"raft.run_cpu_time_us":45304,"raft.run_wall_time_us":158157,"replication_time_us":828232,"spinlock_wait_cycles":1408,"thread_start_us":412949,"threads_started":4,"wal-append.queue_time_us":169415,"wal-append.run_cpu_time_us":75843,"wal-append.run_wall_time_us":1758500}]]}
I20260709 12:21:58.175041  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.176831  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:58.178563  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.179045  7248 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.180290  7253 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.183542  7171 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:58.184010  7171 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:58.184571  7267 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:58.185087  7171 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.185974  7267 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:58.186233  7171 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:58.186513  7267 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.146944  7322 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.188539  4574 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8.
I20260709 12:21:58.188650  7104 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.189600  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.189955  7322 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:58.190768  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.191396  3918 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.191870  4581 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:58.192276  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.193539  3890 leader_election.cc:400] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8.
I20260709 12:21:58.193811  3890 leader_election.cc:403] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:58.195072  6725 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.195427  6725 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.195791  6725 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.196488  7237 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.198904  7297 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:58.202725  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.203928  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.210485  4575 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:21:58.218568  3918 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:21:58.220842  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:58.224100  7267 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.225100  7189 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.128726  7228 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.225854  7069 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8.
I20260709 12:21:58.228313  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.230070  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.230422  7281 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:58.230713  7290 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:58.230957  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:58.231258  7290 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:58.231472  7315 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:58.231851  7228 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:58.232062  7315 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:58.233168  7315 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.236019  3843 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:58.236439  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:21:58.113224  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.011s	sys 0.002s
I20260709 12:21:58.231796  7290 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:58.238799  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.011s	sys 0.002s
I20260709 12:21:58.246709  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.251118  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.252401  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.254943  7189 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.239682  6725 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.228359  7163 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.257881  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.258562  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.257495  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.260959  3918 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:58.262979  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:58.263638  4581 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.259050  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.269522  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.272533  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.274058  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.275295  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.276355  3921 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:58.278474  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.230875  7281 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:58.280735  3994 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.282238  3921 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:58.201308  7324 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:58.283644  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 431626us
I20260709 12:21:58.285682  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.285912  3921 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:58.257459  7297 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:58.298228  3923 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:21:58.266324  6725 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.299489  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:58.301837  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:21:58.304131  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.283303  7281 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:58.309852  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.311581  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.311827  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.312392  3919 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:21:58.312945  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.307528  7209 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.314404  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.315048  3925 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:58.316249  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.318624  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.319059  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:58.323570  3962 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.298959  7300 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.305380  7237 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.358121  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:58.361383  4581 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:58.362987  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.357045  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.365218  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 456) took 1170 ms. Trace:
I20260709 12:21:58.365048  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.316931  3995 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:21:58.394423  4575 rpcz_store.cc:276] 0709 12:21:57.195001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.197026 (+  2025us) service_pool.cc:224] Handling call
0709 12:21:58.365045 (+1168019us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400534b54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:58.365155 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920143104}
I20260709 12:21:58.396121  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.394008  3849 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:58.404428  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:21:58.406701  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.412320  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:58.414362  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 1772) took 2035 ms (client timeout 2096 ms). Trace:
W20260709 12:21:58.414860  3923 rpcz_store.cc:269] 0709 12:21:56.378489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.379738 (+  1249us) service_pool.cc:224] Handling call
0709 12:21:58.414179 (+2034441us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540024e354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:21:58.414300 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4344894208}
I20260709 12:21:58.416116  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:58.414860  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.418642  3843 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:21:58.426214  3843 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:58.433269  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.391677  7222 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:58.364475  7234 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.394824  7288 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:58.442996  3917 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:58.443548  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.441778  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.448913  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.450075  3843 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:21:58.402688  7300 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.453913  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.445433  7234 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:58.454689  3919 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:58.455018  7234 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.455829  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.456581  3919 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:58.463186  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49040.4us
I20260709 12:21:58.464252  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.465242  6817 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:58.465889  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.468519  7324 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:21:58.469213  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.468348  3923 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
W20260709 12:21:58.437836  7327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.035s	sys 0.058s
I20260709 12:21:58.471819  7291 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:58.472487  7291 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:58.472507  7327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.035s	sys 0.059s
I20260709 12:21:58.473953  7191 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:58.475045  7291 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.474041  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.479221  3923 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:58.481606  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:58.484401  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 69159.9us
I20260709 12:21:58.485319  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.485525  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.485971  3917 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:58.415681  7270 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:58.417203  7248 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:21:58.489040  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.489554  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.486053  3923 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:58.482492  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.410903  7179 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:58.491132  7179 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:58.491173  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.488220  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.476354  7234 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.492434  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.495587  3918 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:58.502373  3919 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:58.504736  3918 pending_rounds.cc:85] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 5
I20260709 12:21:58.505043  3918 pending_rounds.cc:107] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:58.505295  3918 raft_consensus.cc:2889] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.505173  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.429399  7307 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.507045  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:58.508009  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62904.4us
I20260709 12:21:58.510730  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.518203  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:58.501770  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:58.534080  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.569770  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.573407  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.508960  7270 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:58.484289  7288 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.531936  7170 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:58.518386  7009 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.609651  3991 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:58.611021  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 100376us
I20260709 12:21:58.533038  7222 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:58.559077  7240 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.614678  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.620352  7171 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:58.609251  7297 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.518131  7248 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:21:58.535367  7246 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:21:58.628552  4581 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:58.651360  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:58.621482  7010 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:58.621896  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 120218us
I20260709 12:21:58.653473  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:21:58.631564  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97545.7us
I20260709 12:21:58.688421  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.632078  7262 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:58.687474  3917 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:58.631624  7170 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:58.654574  7009 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.702316  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.679860  7171 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.706660  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.622061  7179 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.682163  7017 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.711337  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.686228  7297 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.708839  7171 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.697567  7291 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.696200  7262 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:58.715690  7010 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.715819  7270 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.759739  7281 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.736177  7312 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.716543  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:58.761600  7312 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:58.762475  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46019us
I20260709 12:21:58.720391  7248 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:21:58.763208  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.763620  7312 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.764196  7312 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:58.764294  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.764670  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:58.717137  7165 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:58.765870  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.766315  7261 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:58.766649  3917 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:21:58.722564  7300 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.766105  7165 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.767678  7165 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.755707  7291 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.769519  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.770988  7291 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.698642  7170 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:58.723405  7222 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.720216  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.741784  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:58.742079  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.789911  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.742494  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.715209  7288 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.744463  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:58.746809  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 385235us
I20260709 12:21:58.709702  7009 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:58.800318  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55989.9us
I20260709 12:21:58.764567  7312 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:58.766776  7261 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.685071  7290 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.773602  7246 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:58.718806  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:58.719399  7240 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:58.782019  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.766054  7297 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.793634  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:58.794095  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:58.794351  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.799521  7234 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.755656  7262 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:58.825614  7253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.016s
I20260709 12:21:58.805200  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:58.756088  7010 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:58.830199  7010 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.763681  7248 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:58.836066  7171 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.808358  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.808480  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:58.837329  3921 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
W20260709 12:21:58.837718  7253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.008s	sys 0.016s
W20260709 12:21:58.804368  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.821815  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103087us
I20260709 12:21:58.838341  7171 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:58.811034  7291 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:58.817845  7165 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.839429  7291 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.841497  7165 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.838968  7262 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.843555  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:58.844364  3916 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:58.845369  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:58.846179  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.846786  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.845368  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.847728  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.848030  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:58.848800  3998 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:58.851052  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.851379  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.810504  7261 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.852145  3999 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:58.810249  7243 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:58.807608  7343 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.821079  7246 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.860577  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.860993  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.844054  7291 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:58.855786  7270 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.859736  7191 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:58.873128  3990 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.865183  7246 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:58.876080  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 110386us
I20260709 12:21:58.882865  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.862303  7243 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.891072  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.868577  7253 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:58.864190  7165 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:58.891954  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.894109  3990 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:58.909266  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:58.882085  7240 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:21:58.921671  7358 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.921840  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:58.922201  7358 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:58.870754  7312 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.923120  7358 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.937963  7358 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.938905  7312 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.913056  7234 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.940128  7009 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.942399  7009 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.930462  7010 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.932879  7262 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:58.943466  7354 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:58.932996  7356 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:58.934083  7240 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:58.944700  7356 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.945166  7356 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:58.946245  7356 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.914024  7171 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.963795  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.963907  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.965013  3990 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 7: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:58.965348  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.966854  3996 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:58.967216  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.968034  3999 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:21:58.970108  7357 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:21:58.973650  7243 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.974536  7163 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:58.974946  7163 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:21:58.975553  7290 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.975854  7163 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:58.982052  7009 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:58.982753  7009 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.984174  7270 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:58.984731  7270 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.989753  7270 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.993794  7248 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:58.994266  7248 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:58.994891  7009 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:58.995087  7248 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:58.996544  7248 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:58.996620  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.999356  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:58.998486  7191 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:59.002082  7191 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.006865  3998 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:59.008217  7170 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.010418  7170 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.012924  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2242) took 1098 ms. Trace:
I20260709 12:21:59.013337  3991 rpcz_store.cc:276] 0709 12:21:57.914341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.917608 (+  3267us) service_pool.cc:224] Handling call
0709 12:21:57.917862 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:58.681582 (+763720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:59.012684 (+331102us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002968d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:21:59.012859 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542852992}
I20260709 12:21:59.016263  7010 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:21:59.017258  7355 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:21:59.017796  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.015501  7281 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.024923  7191 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.036566  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.038214  7187 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:59.038666  7187 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.039016  7187 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.040915  7163 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.058853  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.066037  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:59.067118  7331 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.391s	user 0.000s	sys 0.004s
I20260709 12:21:59.067008  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.068452  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.069208  3995 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:59.069720  7069 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.071026  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.071080  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.071165  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:21:59.072441  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.073195  3997 raft_consensus.cc:2368] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10.
I20260709 12:21:59.083890  3990 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:59.087162  3924 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:59.089478  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:21:59.093346  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.070219  7069 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:59.098126  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 174918us
I20260709 12:21:59.061566  7246 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.105051  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:21:59.108783  3993 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:21:59.058743  7104 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:59.107646  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.110359  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.112442  4581 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.108588  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:59.115892  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.082947  7179 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:21:59.123795  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.096366  7189 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.096712  7322 raft_consensus.cc:2764] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:59.176187  3990 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:59.107203  7256 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.144486  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.180066  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.181383  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.112501  7261 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.186174  3850 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:59.186959  3921 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:59.149693  3993 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.188006  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.154018  7246 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.150490  7069 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.119038  7036 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.173324  7165 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:59.149003  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.202914  3849 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.181403  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:21:59.114102  7104 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.183259  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.184165  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.183297  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.191668  3841 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:59.191732  3848 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:59.193436  3850 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:59.216621  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.197132  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.147219  7290 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.154091  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:59.207224  7036 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:59.211038  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 62162.4us
I20260709 12:21:59.211313  7069 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.211365  7362 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.212257  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.212919  7261 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.195613  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.239952  3846 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.163992  7361 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:21:59.218686  7197 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:59.152511  7191 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.220495  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.173277  7179 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.220767  4575 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:21:59.247334  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.223106  4583 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:59.193558  7189 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:59.186034  7171 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.199105  7281 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.224146  7300 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.225894  7248 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:59.226635  7332 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.200371  7277 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.228885  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.204121  7291 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.239315  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.240996  3849 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:59.202798  7165 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.246886  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.193481  7256 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:59.252389  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 134614us
W20260709 12:21:59.256985  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.242442  7323 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.219424  7187 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.251456  7267 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.280828  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.239566  7069 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.284284  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.239154  7242 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:59.233824  7017 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:21:59.274896  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46115.8us
I20260709 12:21:59.231683  7209 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:21:59.265391  7228 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.276449  7237 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:59.299523  7207 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:59.299880  7237 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.302111  7237 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.302275  7165 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.242628  7360 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:59.316617  7187 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.276675  7248 consensus_queue.cc:1243] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:59.305011  3919 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:59.304510  7300 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:59.303609  7165 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.308353  3846 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:59.311604  7234 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:59.312086  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:59.319861  3849 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.313859  7256 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.314195  7179 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:59.269735  7277 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.322866  7277 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.287420  7288 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.304739  7189 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:21:59.324476  7189 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:59.324869  7189 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:59.249904  7197 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.325769  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.325747  7189 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.327564  7197 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.266727  7363 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:21:59.332020  7189 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.277614  7171 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:21:59.339887  7069 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.280918  7312 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.341164  7312 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.342870  3846 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:59.283435  7361 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.263897  6725 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:59.347299  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.348125  3845 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:59.349610  3845 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:59.350461  7291 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.351169  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:21:59.351987  4574 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:59.358580  3888 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.369371  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.370198  3842 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:21:59.373595  7261 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:59.374257  7261 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.377146  7036 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.378840  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:59.364219  3745 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 6 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:59.381947  3849 raft_consensus.cc:606] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.383472  7312 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.367559  3890 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:21:59.469106  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 101723us
I20260709 12:21:59.470535  7069 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:59.471048  7069 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:21:59.471506  7069 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.386991  7261 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.394963  7189 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:59.472488  7189 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.472965  7189 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.481750  7261 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.409004  7323 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:59.491727  7323 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:59.492820  7323 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.494737  7323 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.496978  7069 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.427208  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.432087  7332 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:59.501071  7332 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:59.501495  7069 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:59.392423  3888 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.397866  7228 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:21:59.468329  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 187565us
I20260709 12:21:59.484716  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722124affb914f0496100070a9582045"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:21:59.507691  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.507728  7228 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.507993  3849 raft_consensus.cc:606] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.508587  3849 raft_consensus.cc:614] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:59.509667  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.418264  7104 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.512332  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.512749  3919 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:59.512943  3920 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.513027  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.440349  7356 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.513862  3916 raft_consensus.cc:2376] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6. Re-sending same reply.
I20260709 12:21:59.514962  6725 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:59.517071  6725 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.524327  6725 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.501968  7332 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.525957  7332 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.515681  7290 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:59.531879  7290 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.532400  7290 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.533427  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.536264  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.502820  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:21:59.532361  3920 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:59.521737  7104 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.544718  3923 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:21:59.546947  3923 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:59.503109  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 76005.3us
I20260709 12:21:59.547762  7374 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.548326  7374 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:59.523473  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.503727  7367 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.553969  7374 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.524487  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.520799  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.557652  7312 raft_consensus.cc:2764] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:21:59.557652  3918 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:21:59.561743  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.564023  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 323987us
W20260709 12:21:59.516111  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 123797us
I20260709 12:21:59.574873  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.577845  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:59.581313  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.543081  7290 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.563325  3815 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.584339  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.586175  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.587116  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.588351  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.589120  3846 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.590216  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:59.590871  3925 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:21:59.595283  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.597412  7240 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:59.596220  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:59.582124  3920 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.598315  3849 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.599593  3849 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:59.580143  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:21:59.605602  3923 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
W20260709 12:21:59.604022  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 387479us
W20260709 12:21:59.605731  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.606669  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:59.608260  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.608107  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.613948  3922 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:21:59.618149  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.618659  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.619320  3847 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:59.622869  3846 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:21:59.593138  7374 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.598801  7358 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:59.627017  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:59.630033  3924 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:21:59.633893  7290 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.636420  3920 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:59.637116  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.637822  3846 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.639405  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:59.640774  3919 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:21:59.616240  7363 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:59.630097  7358 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.651044  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.651136  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.653311  7201 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:59.654845  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:59.648155  3846 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:21:59.650679  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.660277  7197 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:59.660857  7197 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:59.661708  3888 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.631551  7374 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.662777  7069 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:59.663383  7069 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:59.640444  7373 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.664147  7373 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.664481  7069 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.666685  7373 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.661738  3843 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:59.668099  3843 pending_rounds.cc:85] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 7
I20260709 12:21:59.668393  3843 pending_rounds.cc:107] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:59.668660  3843 raft_consensus.cc:2889] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.644759  7371 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.672092  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.645992  7171 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.648029  7358 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.676486  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.664472  7374 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.647940  7036 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.677443  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.650018  7253 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.648154  7222 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:59.674747  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.669056  7201 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.661729  7197 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.684881  7036 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:21:59.654376  7017 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:21:59.675668  7010 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.681835  7171 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.713872  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.714607  7036 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:21:59.710510  7222 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.668816  7234 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:21:59.718649  7360 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:59.689179  7189 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.711941  7356 raft_consensus.cc:2764] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:21:59.756675  7171 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:21:59.757656  7375 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:59.758292  7375 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.760743  7375 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.720198  7010 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.761945  7010 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.738651  7322 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:21:59.765043  6725 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.767215  7189 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.767972  3921 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:59.767427  6725 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.731078  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:21:59.731969  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.734509  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.679529  7209 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:21:59.728228  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.720242  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.775043  7209 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:59.775527  7209 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:21:59.775609  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55456.7us
I20260709 12:21:59.680440  7312 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:59.776625  7312 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:21:59.777163  7312 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.742111  7360 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.776808  7209 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.778355  7209 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.778303  7360 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.779104  7165 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:59.725071  3846 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:59.779778  7360 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.779832  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.746035  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.772941  7228 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.737622  7187 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:59.781289  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.781754  7187 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:59.781948  3841 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:59.782701  7187 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.711251  7374 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:59.783660  7374 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.776404  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.784121  7374 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:59.786465  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.789008  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:21:59.789526  6725 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:59.789753  3924 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.790376  6725 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.776404  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:21:59.797639  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.813460  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.814572  3844 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:21:59.688601  7240 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:59.817459  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 142773us
I20260709 12:21:59.820075  6725 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.811240  7365 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:59.783665  7228 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:21:59.824999  3814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.526s (SENT) [suppressed 1 similar messages]
I20260709 12:21:59.801990  7291 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.825766  3924 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
W20260709 12:21:59.834898  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.834735  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.845719  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:21:59.846335  3844 raft_consensus.cc:606] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:21:59.819116  7375 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.818331  7288 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:21:59.844491  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.819913  7165 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.853014  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:59.855741  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:59.856694  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:59.857527  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:59.835791  7170 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:59.819730  7332 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:21:59.871526  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:21:59.873067  7017 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:59.860584  7375 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.873991  7170 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:21:59.887326  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.852734  7365 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:21:59.863060  7242 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:59.913720  7368 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:21:59.918076  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46764.4us
I20260709 12:21:59.848721  7291 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.932245  7291 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.933377  3841 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:21:59.935731  3849 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:21:59.922295  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:21:59.938275  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:21:59.941183  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 116230us
I20260709 12:21:59.863752  7288 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:21:59.943691  7392 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:21:59.945518  7365 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.952754  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.953346  7375 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.953701  6725 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.953421  7170 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.953979  7375 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:59.954345  7242 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:59.954192  6725 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.954561  7375 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:21:59.955899  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.956215  6725 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.956612  3844 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:21:59.957180  6725 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.957639  6725 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.958149  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.963843  7242 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:59.964234  7242 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.964636  7242 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.965691  7288 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.956225  7165 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.961371  7387 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:59.961004  3888 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.981232  7387 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:21:59.961689  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.962141  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.982025  3844 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:59.982496  3847 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:21:59.982264  7387 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.919077  7222 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:59.984946  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:21:59.962924  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.985862  7291 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:59.986403  3849 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:21:59.986479  7291 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:21:59.987138  7291 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.968673  6725 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.988930  6725 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:59.950925  7358 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.979923  7010 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.989732  7222 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.990013  3848 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:59.990720  3843 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:21:59.992439  7358 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:21:59.913964  7240 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.988524  7375 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.983970  7387 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:59.993088  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:21:59.978685  7312 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:21:59.989408  6725 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.010072  6725 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:00.011404  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:00.013331  3919 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.993901  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:21:59.996946  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58757.8us
I20260709 12:22:00.021292  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:00.039701  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 45881.9us
I20260709 12:22:00.040445  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:00.040740  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.041327  3924 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:00.042210  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:00.042976  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.024827  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:00.048532  7069 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:00.053601  7069 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:00.054464  7069 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:00.052456  3919 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:00.084358  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.086845  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.055356  7222 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:00.063946  7288 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:00.116693  7288 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:00.117206  7288 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.999356  7242 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.120929  7242 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:00.092687  6725 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.075230  7323 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:00.123539  6725 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.123945  7323 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.095849  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.125488  3991 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:22:00.094661  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.125708  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.098623  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.126371  3999 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:00.066220  7248 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.106720  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.050779  7197 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:00.107515  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.127395  3990 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:00.127720  3993 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:00.109418  4574 consensus_meta.cc:287] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.011s
I20260709 12:22:00.110219  7312 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.113879  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.114346  7332 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:00.121057  7291 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.130429  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:00.132263  3994 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.132681  6725 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:00.126739  3997 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:00.142365  3995 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.147786  6725 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.148453  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:00.124274  7323 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:00.100036  7017 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:00.147745  3843 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:00.164860  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:00.165756  3850 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:22:00.152061  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 116274us
I20260709 12:22:00.151907  7386 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.167366  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.079859  7201 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:22:00.166085  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.138867  7189 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:00.168764  6725 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.154979  3990 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:00.170868  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.140981  4574 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:00.179476  7201 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:00.179945  7201 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:00.155602  7036 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:22:00.181581  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.182658  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.183161  3997 raft_consensus.cc:2410] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:00.184007  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:00.184158  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:00.182341  7209 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:22:00.161248  7332 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:00.195600  3919 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:22:00.143831  7248 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:00.171543  7207 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.203228  3849 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:00.211256  3843 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:00.213191  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.215138  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.152400  7374 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.182549  7017 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:00.225943  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.224634  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.195886  7209 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:00.232175  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.235931  3997 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.235239  3990 raft_consensus.cc:2410] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:00.199811  7291 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.173422  7386 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:00.197607  7165 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:00.238770  7240 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:00.223096  7242 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:00.180634  7189 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:00.256932  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.261482  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.261689  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.253269  3995 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:00.262049  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.268505  3991 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:00.268667  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.262380  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.234480  7290 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:00.270397  3998 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.271806  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.274302  3997 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:00.279783  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.280223  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.280668  3992 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:00.281172  3998 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:00.279402  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.283584  3998 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:22:00.284142  3998 pending_rounds.cc:85] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 3
I20260709 12:22:00.284449  3998 pending_rounds.cc:107] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:22:00.284773  3998 raft_consensus.cc:2889] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:00.262761  7242 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:00.219586  7207 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:00.286392  7240 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:00.300511  7240 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.287894  3997 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.288491  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.303704  3919 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:00.304368  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.309105  7261 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.309815  3999 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.309749  7261 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.313169  3843 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:00.313750  3924 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:00.297612  7242 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.266971  7165 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:00.293326  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:00.314913  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 137716us
I20260709 12:22:00.316778  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.320431  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:00.327126  3920 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:00.327791  7261 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:00.329487  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.331658  7017 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.333498  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:00.334403  7398 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:22:00.335793  3890 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:00.336306  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.337988  3998 raft_consensus.cc:2376] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7. Re-sending same reply.
I20260709 12:22:00.339031  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.341213  3921 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:00.349761  7189 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:00.365341  3850 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:00.368840  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.370121  3924 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:00.371490  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.305650  7290 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:00.380512  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:00.381469  3850 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:00.382072  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:00.373687  3992 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:22:00.379779  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.379884  3888 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:00.397279  3849 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:00.396688  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:00.396253  7189 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:00.325757  7387 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:22:00.405833  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:00.406219  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:00.406629  3918 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:00.404908  7189 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:00.420362  7401 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:22:00.420087  7189 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.426479  7403 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:00.399776  7291 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:00.430516  3920 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:00.313412  7332 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:00.440603  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.449102  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:00.453891  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.456049  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.457439  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.455708  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.458374  3997 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:00.458415  3991 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.460228  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:00.461823  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:00.457337  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.466473  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:00.468163  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:00.468727  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72329.2us
I20260709 12:22:00.468895  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.469578  3990 raft_consensus.cc:2368] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10.
I20260709 12:22:00.472769  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:00.474810  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 139120us
I20260709 12:22:00.480515  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.462627  4583 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:00.481760  3848 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:00.482923  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:00.446987  7374 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:00.486316  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.483706  4575 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:00.489152  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.488523  3998 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:00.495308  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.441051  7288 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.464954  7248 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:00.504277  3998 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:00.479629  7312 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:00.482738  7170 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:00.519013  3848 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:22:00.512910  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84767.6us
I20260709 12:22:00.500550  3999 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:00.520339  3997 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:00.522149  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.520969  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.440851  7165 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.537793  3848 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:00.539525  3992 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:00.542536  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.542719  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.544060  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.544487  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.545821  3990 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 6: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:00.547413  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.548475  3999 raft_consensus.cc:2368] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10.
I20260709 12:22:00.487286  7358 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:22:00.592808  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.467017  7290 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.607338  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:00.532486  7386 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:00.610886  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.499121  7017 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:22:00.609333  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.611956  3990 raft_consensus.cc:2376] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7. Re-sending same reply.
I20260709 12:22:00.504051  7069 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.613498  3992 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:00.616086  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.527576  7283 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:22:00.610478  7403 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:00.600986  7291 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:00.591588  7374 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:22:00.546895  7242 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:22:00.628473  7375 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:00.650776  3991 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:00.651527  7207 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.656227  7387 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:00.652263  7375 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:00.714733  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52437.4us
W20260709 12:22:00.715251  7421 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:22:00.661851  7420 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:00.716018  7410 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:22:00.729336  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.727219  7375 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:00.763480  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 219070us
I20260709 12:22:00.764973  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.727219  7187 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:00.763265  7358 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.768913  7288 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.756058  7420 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:00.827049  7412 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:22:00.811983  7419 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:00.776017  7187 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:00.833595  7069 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:00.843600  7409 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:22:00.765597  7291 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:00.856899  7323 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.005s
I20260709 12:22:00.864202  7323 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.869946  3995 raft_consensus.cc:2368] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
W20260709 12:22:00.876688  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 355831us
I20260709 12:22:00.877463  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.875698  7201 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.879802  7201 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:00.880172  7420 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:00.883632  7222 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:00.884110  7222 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:00.885007  7222 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.886245  7222 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:00.887802  7323 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:00.894516  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 129671us
I20260709 12:22:00.897544  4575 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:00.812762  7358 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:00.847151  7187 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:00.901175  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.906914  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:00.909031  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.912210  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.917459  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.918859  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.926849  3843 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:00.931933  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:00.915848  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:00.934540  3814 leader_election.cc:400] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10.
I20260709 12:22:00.936983  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:00.900512  7416 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:00.940750  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:00.944195  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:00.944892  7416 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.945398  7416 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:00.947921  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.948089  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:00.949038  3991 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:00.938073  7402 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:00.947048  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.914906  7413 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.918265  7069 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:00.918128  7417 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:00.957064  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.958071  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:00.950234  7402 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:00.959565  7165 raft_consensus.cc:993] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:00.940423  7424 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:00.948091  7228 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:00.940441  7426 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:00.992193  7187 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:01.045533  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 87708.7us
W20260709 12:22:01.044649  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88728.7us
I20260709 12:22:00.992427  7291 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.046535  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:01.048422  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91463.5us
I20260709 12:22:01.055239  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.045480  7069 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.049273  7170 raft_consensus.cc:1081] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:01.057866  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.060149  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.057204  7290 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.051427  7332 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.054265  7228 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:01.064359  7291 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.057641  7187 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:01.059696  7424 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:22:01.050544  7413 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:01.066968  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:01.070876  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 133973us
I20260709 12:22:01.045339  7417 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.071380  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.065294  7386 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:01.061998  7069 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.081408  3997 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:01.080359  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.083817  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.084524  3997 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:01.078428  7417 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.091337  3996 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:01.083066  7290 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:22:01.072628  7291 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:01.072392  7413 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:01.082998  7187 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.106007  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:01.106526  7422 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.083120  7189 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.100051  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.106328  7413 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:01.095638  7375 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.077971  7288 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:01.112823  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:01.128194  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 81812.4us
I20260709 12:22:01.131489  3997 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:01.138314  3924 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:01.139547  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:01.140270  3918 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.140743  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:01.141402  3925 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:01.107359  7358 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.112175  7403 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.142918  3916 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:22:01.141868  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.150660  3997 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:01.146564  3924 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 12:22:01.122085  7288 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:01.152129  3922 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:01.128491  7332 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.073460  7402 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.126183  7426 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:01.159113  7358 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.162629  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.143038  7228 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.164109  3999 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:01.152134  7207 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:01.135380  7386 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:01.173852  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.174916  3918 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:01.112618  7187 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:22:01.126005  7189 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.157348  7288 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.107295  7422 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.115712  7291 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.191982  3990 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:01.196442  3990 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:01.197320  3990 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.198362  3990 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:01.215803  7189 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.190532  7171 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:22:01.171402  7332 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.237932  3990 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:22:01.186748  7430 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:22:01.241122  3990 pending_rounds.cc:85] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 4
I20260709 12:22:01.241488  3990 pending_rounds.cc:107] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:01.241806  3990 raft_consensus.cc:2889] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.197247  7386 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:22:01.266857  7418 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.533s	user 0.003s	sys 0.000s
I20260709 12:22:01.268867  3925 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:01.269145  7441 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:01.271344  3847 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:01.271739  7405 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:01.307662  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.283627  3849 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:01.284240  7010 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.285512  7424 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:01.293919  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 92082.4us
I20260709 12:22:01.196669  7434 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:22:01.299055  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.299909  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.314478  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.311892  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.313889  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.311486  3847 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:01.319298  3847 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:01.321853  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.233507  7416 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.320989  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:01.327608  3849 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:01.339761  3841 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:01.335803  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 229893us
W20260709 12:22:01.344831  7446 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:01.320161  7424 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.307400  7405 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:01.344105  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.343972  3814 leader_election.cc:400] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10.
I20260709 12:22:01.358603  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.355609  3849 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:01.359423  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.314519  7419 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:01.359432  3995 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:01.331825  7036 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:01.310583  7441 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.382421  7416 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.387795  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.365288  7433 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:01.388963  7433 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:01.389916  7433 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.391513  7036 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:01.392084  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.392495  7036 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.393200  7422 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.393302  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:01.394591  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:01.394893  7405 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.395946  7453 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:01.396329  7405 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:01.396595  7453 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:01.397025  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.397533  7453 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.398337  4574 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:01.395516  7414 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:01.341889  7375 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:01.378820  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.402621  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.377650  3814 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:01.341423  7201 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:22:01.404201  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.364212  7419 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:01.342322  7323 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:22:01.411175  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:01.406809  7284 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:01.421278  7365 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.416179  7404 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.421928  7290 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:01.423313  7414 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:01.440701  7323 consensus_queue.cc:1243] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:01.464578  3918 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:01.465469  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.466289  3922 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:01.466230  3917 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:01.467621  3922 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:01.423549  7416 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:01.468137  3916 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:01.468070  3924 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:01.457823  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:01.471396  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.476639  3922 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:01.427650  7375 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:01.449708  7291 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:01.448822  7449 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:01.427400  7413 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.437130  7417 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.345824  7451 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
W20260709 12:22:01.491464  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71497.4us
I20260709 12:22:01.489415  3917 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:01.496183  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:01.497182  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 94440.8us
I20260709 12:22:01.499819  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.500643  3995 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:01.501786  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.502856  3991 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:01.458544  7404 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.477276  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:01.479753  7365 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:01.512085  3919 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:01.513013  3918 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:01.484129  7449 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.484759  7332 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:01.466658  7228 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:22:01.485718  7426 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:01.514379  7201 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.522548  7201 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:01.523851  7448 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:22:01.524827  7201 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:01.526154  7404 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.526748  7375 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:01.527283  7426 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.529578  7426 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.520218  7414 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.505380  7424 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:01.556218  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 97723.3us
I20260709 12:22:01.520641  7422 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:22:01.515413  7365 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:01.568503  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46438.1us
I20260709 12:22:01.568993  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.576393  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:01.554180  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48618.9us
I20260709 12:22:01.577129  3842 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:01.576817  3995 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:01.519181  7449 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.576520  3917 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
W20260709 12:22:01.594101  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86051.1us
I20260709 12:22:01.571985  3814 leader_election.cc:400] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:22:01.593678  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:01.625205  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53433.3us
I20260709 12:22:01.624387  3999 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:01.591777  7237 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.634419  3999 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:01.578223  7365 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:01.641885  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49496.4us
I20260709 12:22:01.600739  7417 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.651886  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:01.662097  3999 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.662271  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2263) took 1210 ms. Trace:
I20260709 12:22:01.629125  7322 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.662551  3999 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:01.662665  3994 rpcz_store.cc:276] 0709 12:22:00.452184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.452294 (+   110us) service_pool.cc:224] Handling call
0709 12:22:00.452628 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.452957 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.452982 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.453462 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.425272 (+971810us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003a7500. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:01.650082 (+224810us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:01.659170 (+  9088us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.659394 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.659494 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.659537 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:01.662075 (+  2538us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.662213 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10060,"raft.queue_time_us":3845,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13869,"spinlock_wait_cycles":3713280,"thread_start_us":222720,"threads_started":1,"wal-append.queue_time_us":1190746}
I20260709 12:22:01.654321  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.656894  3991 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:01.658207  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.666035  3995 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:01.594693  7416 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:22:01.593216  7288 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.660302  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.638038  7010 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:01.667470  3995 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:01.655282  7207 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.669668  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:01.670221  7415 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.943s	user 0.002s	sys 0.004s
I20260709 12:22:01.644696  7248 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:22:01.641491  7240 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:22:01.687675  3849 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:01.659271  7441 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.638821  7237 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.689308  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.708818  3994 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:01.711293  4547 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:01.717242  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 2183) took 1365 ms. Trace:
I20260709 12:22:01.718072  3843 rpcz_store.cc:276] 0709 12:22:00.352100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.352312 (+   212us) service_pool.cc:224] Handling call
0709 12:22:00.352785 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.927624 (+574839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.716873 (+789249us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540008d9d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:01.717150 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319185792}
W20260709 12:22:01.725716  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 396389us
I20260709 12:22:01.726624  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.730223  7197 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:01.689777  3888 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:01.668215  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:01.697659  7413 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.674767  7322 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.697978  3923 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:01.698832  7069 consensus_meta.cc:287] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.002s
W20260709 12:22:01.701926  7431 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.909s	user 0.004s	sys 0.002s
I20260709 12:22:01.684561  7417 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.733297  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:01.733870  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44205.7us
W20260709 12:22:01.736475  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68363.4us
I20260709 12:22:01.690704  7207 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.743474  7429 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:01.742600  7402 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:01.738725  3999 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.751622  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:01.758927  6725 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:01.761637  7461 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:01.762140  7461 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.762494  7461 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.749085  7443 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:01.764432  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.754303  7413 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:01.766564  7402 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:01.768610  7207 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.769294  7419 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.769750  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:01.770226  7288 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.754063  7453 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.770787  7419 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.771075  7453 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.768234  7402 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.749929  7234 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.777557  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.777868  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.756237  7429 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.748302  7069 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.791926  3999 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:01.794767  7234 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.766251  7443 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.798058  7429 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.809448  3921 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:01.754513  7417 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.803248  3997 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:01.808226  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:01.811100  3925 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:01.817312  7463 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:22:01.829192  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:01.832185  3998 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:01.809732  7443 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:01.832953  3999 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:01.809243  7413 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:01.840576  3923 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:01.842043  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:01.826373  7237 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:01.830037  7201 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.844983  7453 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.862146  3925 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:01.846472  7413 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:01.856690  7201 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.865442  7322 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.885339  7234 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:01.886947  7417 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:01.864292  7365 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:01.954854  7284 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:01.964465  7465 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:01.972965  7248 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:01.973409  3850 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:02.002588  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:01.973712  7240 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:01.976120  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:02.007929  7240 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.008908  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.009670  3846 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:01.977147  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:01.981066  3847 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.981222  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:02.013126  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:02.013732  3844 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:02.014122  3844 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.010928  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:01.890885  7471 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.193s	user 0.004s	sys 0.000s
I20260709 12:22:01.983167  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.022745  3845 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:02.014873  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:02.027676  7473 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:22:02.029660  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 2191) took 1306 ms. Trace:
I20260709 12:22:02.030237  3848 rpcz_store.cc:276] 0709 12:22:00.723652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.723799 (+   147us) service_pool.cc:224] Handling call
0709 12:22:00.724152 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.725002 (+   850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.725048 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.541101 (+816053us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b2c000014c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:22:01.544118 (+  3017us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.796276 (+252158us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:01.796314 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.796375 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.029274 (+232899us) raft_consensus.cc:1685] finished
0709 12:22:02.029299 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.029563 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":577,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"spinlock_wait_cycles":8238976,"thread_start_us":163714,"threads_started":1,"wal-append.queue_time_us":253005}
I20260709 12:22:02.024555  3844 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.034114  3844 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:02.036684  7201 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:02.000809  7284 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:02.001359  7248 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.046190  7461 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.010272  7069 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.047930  7449 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:02.049474  7476 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:02.049465  3849 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12.
I20260709 12:22:02.050782  7449 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.064018  7413 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:02.040561  7248 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.070703  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.072069  3921 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:02.026139  3850 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:02.072417  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:02.072436  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.067327  7356 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:02.075942  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.076784  3847 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:02.078415  3848 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:02.085039  7461 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.066522  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:02.102137  3844 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:02.105095  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.106060  3848 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:02.082391  7413 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:02.080421  7356 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.114112  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:02.126142  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:02.009567  7240 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.094846  7248 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:02.081946  7288 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:22:02.135675  3847 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:22:02.136309  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 494079us
I20260709 12:22:02.137178  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:02.127638  7242 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.145663  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:02.130116  7323 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.134334  7413 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:02.149317  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.151062  7417 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:02.136435  7187 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.142982  7237 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.144697  7240 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.167973  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:02.169720  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.172286  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.174656  7414 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:02.176920  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.183444  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:02.185477  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:02.168823  7323 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.187404  7453 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:02.187644  7069 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:02.189276  7323 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:02.189328  7483 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:22:02.175258  7284 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.179890  7312 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:22:02.198531  7413 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.183332  7261 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:22:02.173089  7449 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:02.215389  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 47503.8us
I20260709 12:22:02.184866  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:02.180908  7237 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.175401  7010 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:02.219390  7358 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:02.225930  7453 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:02.226179  7414 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:02.226886  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:02.227288  7197 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.227819  7036 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:22:02.229817  7482 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.238s	user 0.004s	sys 0.000s
I20260709 12:22:02.232892  3921 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:02.161231  7356 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.235070  3925 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:02.237803  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.179957  7187 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:02.277024  3996 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:02.252344  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:02.279175  3919 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:02.162994  7242 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:02.248329  7358 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:02.234304  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.267357  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:02.268173  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53007.3us
I20260709 12:22:02.243620  7449 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.245785  7237 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.288422  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.263195  7365 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.264962  7197 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.258533  7414 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.273203  7228 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:02.182837  7443 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:02.290731  7358 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.257151  7484 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:02.293526  7449 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.298292  7414 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.296258  7322 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:02.321447  7487 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:22:02.320653  7468 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.621s	user 0.006s	sys 0.000s
I20260709 12:22:02.299621  7197 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:02.309580  7433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.006s	sys 0.005s
I20260709 12:22:02.338793  7420 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:02.344187  7170 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:02.298003  7228 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:02.356685  7433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.007s	sys 0.006s
I20260709 12:22:02.399977  3991 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:02.359552  7170 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.357475  7420 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:02.415874  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.416270  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.415894  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.361378  7201 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:02.405156  7429 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 12:22:02.421727  7222 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.444726  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:02.445442  3919 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:02.441051  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:02.447018  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.424911  7036 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:02.458825  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.463505  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.444478  7387 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.464581  7387 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.466123  7489 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:02.466715  7489 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.456485  7490 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:02.467418  7489 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.472600  7323 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:02.475100  7490 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:02.476154  7490 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.431794  7443 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.423872  7201 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.425544  7429 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.420473  7228 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.497726  3992 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:02.812592  3849 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:02.864177  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:02.509692  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:02.872033  3993 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:02.811316  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.814795  3888 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12.
I20260709 12:22:02.755190  3990 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:02.486296  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:02.496484  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.596264  3919 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:02.865028  3924 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:02.691170  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:02.884613  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:02.874902  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60311.5us
I20260709 12:22:02.885182  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:02.894200  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 203160us
I20260709 12:22:02.897979  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:02.703186  7495 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:02.845541  7433 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.554687  7332 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.885674  3925 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:02.865823  7187 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:02.865689  7483 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:02.793665  7417 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.684870  7242 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:02.897135  7453 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.653384  7036 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:02.448838  7222 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.779821  7197 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.897047  7307 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.466727  7387 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:02.911849  7497 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:22:02.688933  7414 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.719112  7449 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.730525  7237 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.891819  7261 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:22:02.904742  7228 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:02.931403  7163 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:02.447178  7170 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.922936  7417 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.906032  7433 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.910756  7332 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.959532  7197 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:02.959743  7358 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.005s
I20260709 12:22:02.960315  7358 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:02.921175  7483 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:02.976363  7417 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.977254  7358 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:02.977553  7433 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:02.978817  7332 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:02.979296  7414 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:02.979974  7498 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:22:02.987730  7429 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.989997  7449 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:02.993144  7483 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:02.996752  7489 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 12:22:02.997859  7489 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.002771  7489 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:02.788995  3779 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 12:22:02.945549  3998 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:03.047086  3923 raft_consensus.cc:2368] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:03.043310  3992 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:02.808102  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.051234  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 162046us
I20260709 12:22:03.045372  3993 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:03.046372  3994 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:22:03.060094  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.934819  7036 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.079237  3999 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.083216  7429 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.085990  7237 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.085726  7429 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.090910  7201 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.091140  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2309) took 1433 ms. Trace:
I20260709 12:22:03.091663  3991 rpcz_store.cc:276] 0709 12:22:01.657490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.666459 (+  8969us) service_pool.cc:224] Handling call
0709 12:22:01.666911 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.400541 (+733630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:03.090506 (+689965us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400350054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:03.090884 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685397120}
I20260709 12:22:03.139582  7036 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.142038  7417 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.143225  7417 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.147909  7417 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.153106  7010 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.154064  7010 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.161087  7010 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.164798  7197 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.165980  7197 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.167286  7261 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:03.168726  7261 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:03.172250  7242 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.167735  7187 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.180815  7234 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.181350  7222 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.187789  7356 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:03.190229  7284 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.191828  7187 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.195009  7187 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.191064  7284 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.203045  7242 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.207034  7284 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.178555  7197 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.213740  7332 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.214784  7332 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.202836  7234 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.218782  7170 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.219731  7242 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:03.266072  3997 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:03.269698  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:03.271771  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:02.100659  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:03.228473  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 259587us
I20260709 12:22:03.325678  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:03.326828  3994 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:03.232898  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 2269) took 1002 ms. Trace:
I20260709 12:22:03.331671  3923 rpcz_store.cc:276] 0709 12:22:02.230567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.233905 (+  3338us) service_pool.cc:224] Handling call
0709 12:22:03.232503 (+998598us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540024f754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:03.232750 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748799872}
I20260709 12:22:03.234081  3924 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:03.237031  7445 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.333060  7451 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:03.333611  7445 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.238476  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:03.241233  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 347211us
I20260709 12:22:03.242240  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:03.336012  3849 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:03.336452  4574 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:03.337214  3994 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:03.244800  7207 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.370047  7207 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.373023  7207 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.254241  7332 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:03.255430  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:03.374792  3845 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:03.375263  3845 pending_rounds.cc:85] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 3
I20260709 12:22:03.256331  3995 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:03.375675  3845 pending_rounds.cc:107] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:03.376082  3845 raft_consensus.cc:2889] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:03.258562  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:03.378928  3996 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:03.381574  7187 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.382265  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.382597  7419 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.384949  7419 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.386464  3845 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:03.204121  7429 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.388062  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.388239  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.388906  3844 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.262502  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:03.375505  3993 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:03.263397  7234 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.264026  7197 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:03.399706  3844 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
W20260709 12:22:03.400167  3745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 199) took 15809 ms (client timeout 15000 ms). Trace:
I20260709 12:22:03.400327  7197 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.222750  7420 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.281435  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.284750  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:03.287405  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.289465  7414 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.289517  3999 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:03.292976  7422 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:03.295091  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 75854.8us
I20260709 12:22:03.295970  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.297994  7242 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:03.307483  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:03.322449  7356 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:03.229264  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.242518  7512 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 12:22:03.341251  7451 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:03.350803  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:03.335340  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:03.351691  4574 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:03.355345  7445 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.360332  3747 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 6 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.383493  3847 raft_consensus.cc:2368] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:03.262074  7288 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.382318  7187 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:03.419771  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 57350.3us
I20260709 12:22:03.432633  3849 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:03.433048  3992 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:03.433782  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:03.435338  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.438376  3997 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.443562  3998 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.443662  4583 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:03.450040  3844 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:03.450179  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.456072  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:03.457854  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 122701us
I20260709 12:22:03.458560  7312 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:03.459170  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:03.451395  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:03.463549  3996 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:03.495165  3747 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.497483  3747 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:03.459364  7312 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:22:03.499972  7312 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:03.500475  7312 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:03.500813  7312 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:03.467808  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:03.430337  7414 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.511428  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.513217  7360 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:03.513870  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54846us
I20260709 12:22:03.513967  7360 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.515595  7461 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:03.459197  7422 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:03.522480  3997 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:03.499346  3747 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:03.462875  7420 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:03.528924  7426 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:03.529340  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:03.529640  7360 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:03.531409  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.563359  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:03.462482  7356 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.535877  7010 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.502143  7312 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.537562  7416 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:03.539167  7424 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:03.505661  7242 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.502779  7288 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.545082  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 1303) took 1060 ms. Trace:
W20260709 12:22:03.548048  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.549894  7414 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.572615  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.502959  7419 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.536711  7413 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:03.561774  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:03.568432  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 150998us
I20260709 12:22:03.523871  7461 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:03.572819  3999 rpcz_store.cc:276] 0709 12:22:02.485079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.486027 (+   948us) service_pool.cc:224] Handling call
0709 12:22:03.504509 (+1018482us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400209754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:03.544970 (+ 40461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463036800}
I20260709 12:22:03.582337  3850 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:03.609838  7010 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.608884  7467 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:03.651321  7467 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.651829  7467 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.586689  7414 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:03.652366  7414 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:03.400699  3745 rpcz_store.cc:269] 0709 12:21:47.590420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.590603 (+   183us) service_pool.cc:224] Handling call
0709 12:22:03.399855 (+15809252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:59.608459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:59.609087 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:59.609126 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:21:59.609146 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:59.609554 (+   408us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:59.609629 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:59.609662 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:59.609866 (+   204us) tablet.cc:701] Row locks acquired
0709 12:21:59.609885 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:59.610040 (+   155us) write_op.cc:270] Start()
0709 12:21:59.610159 (+   119us) write_op.cc:276] Timestamp: P: 1783599719609985 usec, L: 0
0709 12:21:59.610181 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:59.610915 (+   734us) log.cc:844] Serialized 538 byte log entry
0709 12:21:59.911863 (+300948us) op_driver.cc:464] REPLICATION: finished
0709 12:22:00.014120 (+102257us) write_op.cc:301] APPLY: starting
0709 12:22:00.014220 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:00.014335 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:00.014490 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:00.050678 (+ 36188us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:00.083201 (+ 32523us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:00.093735 (+ 10534us) write_op.cc:312] APPLY: finished
0709 12:22:00.102229 (+  8494us) log.cc:844] Serialized 23 byte log entry
0709 12:22:00.102422 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:00.102514 (+    92us) write_op.cc:454] Released schema lock
0709 12:22:00.102557 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:00.103025 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:00.103063 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":102005,"apply.run_cpu_time_us":2353,"apply.run_wall_time_us":88872,"num_ops":1,"prepare.queue_time_us":215072,"prepare.run_cpu_time_us":9941,"prepare.run_wall_time_us":95268,"raft.queue_time_us":204881,"raft.run_cpu_time_us":5286,"raft.run_wall_time_us":102411,"replication_time_us":301484,"spinlock_wait_cycles":37120,"thread_start_us":498693,"threads_started":4,"wal-append.queue_time_us":92533,"wal-append.run_cpu_time_us":29531,"wal-append.run_wall_time_us":1402818}]]}
I20260709 12:22:03.653393  7414 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.654958  7414 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.614199  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.618871  7356 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.620431  7288 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.620332  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.612177  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.625629  7197 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.581802  7360 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:03.632728  7419 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:03.635938  3841 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:22:03.669308  3841 pending_rounds.cc:85] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 6
I20260709 12:22:03.669797  3841 pending_rounds.cc:107] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:22:03.669399  7419 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.674435  3923 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:03.675922  3919 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:03.675863  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.676906  3922 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:03.677452  7417 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.678133  7417 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.637291  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.637305  7242 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:03.639576  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.640357  3847 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:22:03.681643  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 69573.4us
I20260709 12:22:03.643321  3998 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:03.640265  3992 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:03.644306  7461 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.646309  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.684206  3849 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
W20260709 12:22:03.648231  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 187836us
I20260709 12:22:03.576458  7426 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:03.686983  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.649955  4581 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:03.666705  7312 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.670182  3841 raft_consensus.cc:2889] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:03.637033  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.677511  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:03.698170  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.699893  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.702584  3917 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:03.703372  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.702478  3850 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:03.706424  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.687022  7356 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.708276  3922 pending_rounds.cc:85] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 4
I20260709 12:22:03.709786  3922 pending_rounds.cc:107] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 12:22:03.709828  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.708395  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.710475  3922 raft_consensus.cc:2889] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:03.713985  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.718140  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.724795  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:03.725786  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 88970us
I20260709 12:22:03.729446  7284 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:03.730017  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.730365  7419 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:03.730962  3849 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:03.732374  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.733383  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:03.734556  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:03.735332  7288 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.737337  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.738165  7248 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:03.752830  3918 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:03.753217  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.738900  7010 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.739460  7291 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:22:03.739810  3815 leader_election.cc:400] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:03.741247  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.741674  7417 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.745695  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.709707  7356 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:03.721323  3747 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:03.756166  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.757296  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.758447  3815 leader_election.cc:403] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:03.754904  3916 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:03.758095  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.760154  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.752049  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.763296  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.771180  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.748405  7284 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:03.728081  7413 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:03.777249  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.778795  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.779336  3920 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:03.780480  3888 leader_election.cc:400] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:03.799105  3888 leader_election.cc:403] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:03.783754  7424 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:03.785317  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:03.786382  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67518.6us
I20260709 12:22:03.786751  7449 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.788234  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:03.789278  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.805069  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.791877  7248 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.775725  7288 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.793421  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:03.805330  4583 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:03.794137  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.791131  7187 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:03.762887  7429 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:22:03.810702  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 74717.1us
I20260709 12:22:03.800585  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.786456  7483 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:03.800009  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.803706  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.808825  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:03.810240  3916 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:03.811426  3917 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:03.811748  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.797673  7413 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:03.775689  7417 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.765725  7356 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.810690  3842 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:03.815569  7449 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.816746  7419 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:03.817123  7445 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:03.741372  7426 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.818220  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.813916  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:03.797892  7284 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:03.830722  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50405.8us
I20260709 12:22:03.808254  7424 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:03.818380  7288 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.836509  7417 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.826380  7416 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.861726  7416 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.862676  7417 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.839680  7460 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:03.863348  7460 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.863797  7460 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:03.863948  7416 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.842636  3747 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:03.843119  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.832864  7422 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.811254  7429 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:03.835927  7451 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:03.834431  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.851227  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:03.850032  3841 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:03.853852  7222 raft_consensus.cc:2764] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:22:03.854254  7228 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:03.855297  7170 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:03.855599  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.879526  3917 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:03.855955  7010 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.856431  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.858729  7467 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.859613  7424 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.860661  7248 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.852344  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:03.868582  3844 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:03.824292  7413 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:03.876751  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:03.877336  7422 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.896240  7010 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.898509  7010 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.898877  3842 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:03.834286  7187 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:22:03.905956  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:03.903563  3747 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:03.911717  3962 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.913043  7222 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.913690  7467 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.913656  7222 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.914498  4574 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:03.880012  7417 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:03.878935  7419 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:03.900564  7422 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:03.925449  7417 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.965338  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:03.938090  7451 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:03.937917  7234 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:03.973601  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121313us
I20260709 12:22:03.969606  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:03.982363  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 102164us
I20260709 12:22:03.981329  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:03.987949  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.966655  7417 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.997478  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.997571  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.998607  3916 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
W20260709 12:22:03.999998  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 90820.1us
I20260709 12:22:04.002605  3918 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:03.938237  7483 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:22:03.938920  7228 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:03.983273  7234 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.005921  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:04.013335  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.019408  3747 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:03.990583  7261 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:04.012442  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:03.994525  7451 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:03.982409  7419 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:03.996052  7222 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:04.032493  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63282.9us
W20260709 12:22:04.004943  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 176344us
I20260709 12:22:04.023149  7234 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.036900  3921 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:04.054219  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:03.980201  7413 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.058053  3842 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:04.048584  7416 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:04.062985  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49736.1us
I20260709 12:22:03.993068  7429 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.013273  7248 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:22:04.066061  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.039654  7187 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:22:04.078258  7532 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:04.084450  3844 pending_rounds.cc:85] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 5
I20260709 12:22:04.085004  3844 pending_rounds.cc:107] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:22:04.085315  3844 raft_consensus.cc:2889] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:04.073729  3747 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.092814  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.070518  7010 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:04.069180  7416 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.062922  7197 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:22:04.098397  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.076174  7413 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:04.105386  3845 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:04.101945  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.100461  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.113332  3747 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:04.118369  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.097136  7429 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.120056  3849 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:04.115384  3747 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:04.121353  7323 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:04.122282  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.108665  7312 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:04.125527  7222 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:04.096916  7449 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.107225  7416 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:04.132012  7530 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 12:22:04.132611  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 213424us
I20260709 12:22:04.136437  7419 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.136943  7451 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:04.138015  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45763.7us
I20260709 12:22:04.138844  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:04.124781  7529 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:04.130491  7291 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:04.159693  3747 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.162748  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.152760  7222 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:04.173295  7222 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.122701  7010 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:04.177232  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.177428  7010 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.166538  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:04.179984  3921 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:04.180279  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.181051  3849 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:22:04.153563  7312 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.182067  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.182246  7312 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.182735  3849 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:04.165872  7291 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.183662  7291 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:04.166191  7413 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.186383  7413 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.172070  7187 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.172657  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.189980  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.167189  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:04.191088  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:04.150974  7323 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:04.192178  7323 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.192328  7197 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:04.193307  7197 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.193945  7197 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:04.197160  7197 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:04.194393  7248 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:04.168571  7228 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:04.201524  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.181100  7242 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:04.178939  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.215834  3888 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.165997  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:04.227308  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:04.233629  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.239238  3848 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:04.235237  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.215816  7197 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:04.254657  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.234196  7248 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:04.259326  7248 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.260432  7451 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:04.228065  7242 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:04.231985  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:04.251570  7422 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:04.233953  7547 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:04.254987  7187 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:04.284385  7547 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.267839  7451 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.266595  7419 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:04.268427  7422 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.299582  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.310271  7422 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:04.303128  7451 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:04.316233  7419 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.309506  7541 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:04.317737  7187 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:22:04.317865  7541 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:04.317401  7542 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:22:04.297487  7547 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:04.324985  7535 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.325531  7535 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.325896  7535 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.311636  7460 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.329967  7460 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.333315  7242 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.334668  7242 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.343091  7197 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.352932  7312 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.354127  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.354876  7532 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.357882  7416 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.358543  7197 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.359812  7419 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:04.365309  3848 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:22:04.368475  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.397297  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 180822us
W20260709 12:22:04.398692  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100343us
W20260709 12:22:04.407773  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139044us
I20260709 12:22:04.309597  7356 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.398524  7532 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.411911  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.397979  7553 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.396813  7234 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.418274  7553 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.421625  7553 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:04.442509  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.366452  7417 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.406811  7419 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:04.449882  3847 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:04.450248  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.457096  3849 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:22:04.457448  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.458137  3844 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:04.459542  7548 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.141s	user 0.004s	sys 0.000s
I20260709 12:22:04.459831  3846 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:04.460546  7356 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:04.477378  7222 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.478690  7416 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.484799  7323 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.446527  7553 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.487830  7541 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.505808  7426 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:04.520952  7426 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:04.521898  7413 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:04.523283  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:04.514094  7291 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:04.526122  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.526963  7552 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 12:22:04.527202  7291 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.528015  7291 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.528667  7291 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.530953  7461 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.531610  7461 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.533843  7461 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.534307  7461 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.534765  7461 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.535830  7360 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:04.536757  7417 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.457993  7419 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.549091  7461 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.548800  7426 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.550217  7426 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.499082  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.552835  7234 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.487948  7553 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.487202  7323 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.560993  7553 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.564766  7360 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:04.565482  7360 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:04.566045  3845 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:04.574417  7451 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.582010  7535 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.589340  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.589438  7532 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.590839  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.592684  3847 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:04.465867  7312 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.596488  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.597790  7547 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:04.598269  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.579133  3844 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:04.600623  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.601380  3849 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:04.602545  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 194664us
I20260709 12:22:04.607259  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.608038  3844 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.586853  7422 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.612502  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.657091  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.610122  7535 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.744833  7197 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:04.745543  7222 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:04.656807  7284 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:04.746932  3844 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:22:04.748677  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 331307us
I20260709 12:22:04.750288  3925 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:04.752655  3849 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
W20260709 12:22:04.758420  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 141133us
I20260709 12:22:04.753741  7197 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.761902  7544 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:04.762926  7197 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.764473  7419 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:04.764890  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:04.765595  3919 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.778630  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:04.843055  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91441.5us
I20260709 12:22:04.890594  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:04.891604  7557 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.892112  7557 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:04.842937  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83337.2us
I20260709 12:22:04.892738  7557 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.894203  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.798995  3919 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:04.785262  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:04.897166  4578 raft_consensus.cc:2368] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
W20260709 12:22:04.897245  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 131737us
I20260709 12:22:04.897178  3922 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:04.901669  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:04.902170  7557 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.902526  7426 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:04.903498  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.788985  7291 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.905046  7451 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.908293  3962 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.863243  4574 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:04.917166  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:04.922170  3844 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:04.929072  3843 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:04.923870  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.771835  7547 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:04.929095  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.930536  3847 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:04.879700  7532 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.934839  7234 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:04.934913  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.923404  7559 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:04.947417  7559 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.947863  7559 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:04.956122  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.958106  7451 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:04.958678  7451 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:04.958815  7544 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:04.959348  7544 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:04.959671  7451 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.960309  7544 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.932528  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.935480  7234 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:04.939981  7553 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.941874  7197 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:04.938369  7323 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:04.941792  3962 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:04.942306  7207 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:04.984967  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:05.036410  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47582.5us
W20260709 12:22:05.051713  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 119234us
W20260709 12:22:05.064229  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 122492us
I20260709 12:22:04.973333  7234 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:04.979864  7422 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:04.978868  7557 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:05.042384  7566 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.081907  4578 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:05.082120  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:05.087265  3842 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:05.084057  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:05.100160  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:04.993809  7424 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:22:05.105302  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.091666  7566 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:04.995831  7553 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:05.114548  3815 leader_election.cc:400] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:22:05.114988  3815 leader_election.cc:403] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:22:05.043954  7535 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:22:05.116268  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.120064  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:05.099722  7360 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.007s
I20260709 12:22:05.084209  7197 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:05.076754  7228 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:05.081779  7563 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:05.100519  7422 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.139394  7323 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:05.167680  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63748.5us
W20260709 12:22:05.188990  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 103928us
I20260709 12:22:05.143046  7547 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:05.129330  7360 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:05.229339  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60418.5us
I20260709 12:22:05.235309  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.172124  7563 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:05.154249  7323 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:05.244169  3842 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:05.245592  7426 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8.
I20260709 12:22:05.248490  7563 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.251619  7567 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:05.252355  7567 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.255009  7567 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.264034  7539 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:05.142486  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722124affb914f0496100070a9582045"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:05.272689  3843 raft_consensus.cc:606] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:05.264765  7358 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:05.218744  7451 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:05.155460  7422 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.268797  7242 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:05.271852  3846 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:05.268002  7579 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:05.270665  7234 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.278792  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:05.280141  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 165744us
I20260709 12:22:05.237685  7187 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.284416  7358 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:05.287196  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.300055  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.277511  7228 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:05.280848  7451 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.268033  7323 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:05.281107  7242 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:05.285944  7579 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.320333  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.321313  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.287560  7197 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.292943  7539 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.301198  7248 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:22:05.341888  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:05.379901  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.364382  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:05.383119  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 83145.9us
I20260709 12:22:05.383278  3846 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:05.384011  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.301177  7360 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.390749  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.283088  7559 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.412699  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.388705  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.356830  7323 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:05.419064  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.421203  3841 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:05.328507  7547 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:05.378547  7312 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.346201  7422 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.347743  7579 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:05.330919  7451 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.340582  7553 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:05.339011  7566 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.394157  7570 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:05.297180  7187 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:05.323156  7228 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.421687  7557 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.420461  7532 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:05.451413  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 215338us
I20260709 12:22:05.442114  7570 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:05.453220  3843 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:05.457454  7234 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:05.457854  7559 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:05.347518  7242 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:05.460182  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.458665  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:05.445891  7547 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:05.462255  3847 raft_consensus.cc:606] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:05.463882  3847 raft_consensus.cc:614] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:05.438263  7312 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.449162  7323 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:05.329181  7358 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.462149  7570 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:05.478859  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.709s (SENT) [suppressed 5 similar messages]
I20260709 12:22:05.494627  7571 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:05.527686  3848 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:05.525496  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:05.479799  7010 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:05.567739  3846 raft_consensus.cc:2368] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7.
I20260709 12:22:05.572602  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:05.587131  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.462881  7532 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.550076  7242 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.593432  7312 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.599972  7539 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.548393  7419 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:05.621562  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 202586us
I20260709 12:22:05.656675  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.658362  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:05.586257  7234 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:05.641935  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:05.556061  7571 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.631629  7228 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.623375  7010 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.661010  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.651609  3888 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:05.674189  3962 leader_election.cc:400] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7.
I20260709 12:22:05.674749  3962 leader_election.cc:403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:05.676497  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:05.668365  7323 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:05.671267  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:05.680545  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 201738us
I20260709 12:22:05.681416  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:05.693429  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:05.694554  3918 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:05.673444  7563 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:05.696825  3846 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:05.672541  7547 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:05.731119  3923 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:22:05.678773  7585 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:05.732285  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55905.4us
I20260709 12:22:05.680326  7422 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:05.737577  3845 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:05.733736  3923 pending_rounds.cc:85] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 5
I20260709 12:22:05.741753  3923 pending_rounds.cc:107] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:22:05.742100  3923 raft_consensus.cc:2889] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:05.743566  7575 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:05.747035  7592 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:05.685518  7291 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:05.689356  7580 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:05.688251  7584 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:05.668583  7234 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.672793  7588 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:22:05.685563  7597 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:05.738780  7585 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.761480  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:05.679612  7419 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:05.765828  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:05.766176  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:05.776784  3998 raft_consensus.cc:2368] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:05.776898  3992 raft_consensus.cc:2410] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:05.768203  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:05.770444  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:05.759965  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:05.740733  7557 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:05.754429  7291 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.781093  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:05.784662  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 84662.5us
I20260709 12:22:05.787076  7566 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.787385  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:05.787660  7566 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.781307  7563 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:05.790385  7593 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:22:05.790728  7563 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:05.790822  7360 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:05.792258  7532 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.793026  7563 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:05.775949  7559 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:22:05.794510  7234 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:05.767462  7323 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.780913  7291 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.795771  7323 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.798105  7323 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:05.803654  7571 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.777457  7585 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.807101  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.781818  3994 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:05.809005  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.809319  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.764148  7584 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:05.795325  7234 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:05.814426  7584 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:05.831413  3998 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:05.836946  7595 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:05.848366  3997 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:05.858219  7010 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.863974  7419 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:05.823390  7234 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:05.865509  7234 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.866533  7234 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:05.866691  7566 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:05.871491  7187 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:05.870968  7596 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:05.873903  7596 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:05.873950  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:05.874378  7596 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:05.929471  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46022.9us
W20260709 12:22:05.936306  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:05.942414  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 113115us
W20260709 12:22:05.952492  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 181027us
W20260709 12:22:05.953536  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 81663.3us
I20260709 12:22:05.976089  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:05.976186  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:05.979966  3924 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:05.980034  7585 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:05.982079  3919 raft_consensus.cc:2368] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:05.982860  3998 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:05.988790  7596 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:05.999866  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47929.8us
W20260709 12:22:06.070029  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.100787  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:06.053574  3996 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:05.951676  7580 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 6. Current term is 7.
W20260709 12:22:06.097800  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 95606.4us
I20260709 12:22:06.007203  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:06.208228  3925 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:06.209033  3923 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:06.213047  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:06.161619  7598 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:22:06.161764  7582 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:22:06.196710  7615 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.087s	user 0.000s	sys 0.003s
I20260709 12:22:06.223021  3995 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
W20260709 12:22:06.211740  7570 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.002s
I20260709 12:22:05.971711  7547 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:06.231607  3842 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:06.231330  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.242045  3998 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
W20260709 12:22:06.234302  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.234892  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.036988  7585 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:06.009913  7588 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:05.945844  7579 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.053954  7553 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.226s
I20260709 12:22:06.245731  7547 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:06.262955  3845 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:06.242363  7570 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.265130  7570 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:06.247650  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.266474  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.266889  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.267628  3994 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:06.267762  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.268630  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.268899  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.269528  3994 raft_consensus.cc:2410] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:06.269958  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.231485  7323 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.271763  7323 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:06.273957  7323 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:06.231226  7563 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:06.274621  7563 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.248418  7610 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:06.254655  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.255239  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.255501  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:06.256609  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.282948  3850 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.278671  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:06.279001  3998 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:06.279740  3845 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.278740  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.284711  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:06.301340  7596 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.304680  3815 leader_election.cc:400] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:06.493050  3815 leader_election.cc:403] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:06.305811  7571 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.495312  7571 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:06.496651  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 192111us
I20260709 12:22:06.498186  7571 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:06.498423  3991 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:06.286609  7584 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.500511  7563 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:06.501835  7422 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:06.315778  7323 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.188s
W20260709 12:22:06.297048  7611 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.249s	user 0.009s	sys 0.003s
W20260709 12:22:06.299906  7601 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.259s	user 0.000s	sys 0.004s
I20260709 12:22:06.261787  7588 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:06.505486  3994 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:22:06.506134  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:06.447966  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 165330us
I20260709 12:22:06.507560  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:06.508239  7620 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:22:06.550114  3998 raft_consensus.cc:2410] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:06.550273  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:06.488303  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:06.497478  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:06.530561  3995 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:06.534401  3850 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:06.243393  7291 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.539253  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:06.554373  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56989.8us
I20260709 12:22:06.288475  7610 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:06.547732  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.548169  3918 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:06.549515  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.553407  3846 raft_consensus.cc:606] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:06.547174  3994 pending_rounds.cc:85] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:22:06.560487  3846 raft_consensus.cc:614] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:06.560629  3994 pending_rounds.cc:107] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:22:06.560912  3994 raft_consensus.cc:2889] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:06.561658  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.562855  3997 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:06.557495  7358 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.564647  7358 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:06.560088  3991 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:06.565138  7358 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.567224  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.567909  4583 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:06.570180  3888 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:06.572968  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.575714  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.571671  7606 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:06.579247  7584 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:06.580307  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:06.582280  7579 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:06.583638  7586 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:06.584151  7358 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.591869  3917 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:06.593494  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:06.605113  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.624752  3990 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:06.598845  7360 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.626611  7360 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.627095  7360 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.631669  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.599174  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 505) took 1136 ms. Trace:
I20260709 12:22:06.608086  3849 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:06.598891  7606 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:06.603148  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:06.634933  3992 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:06.594228  7358 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:06.642102  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:22:06.635005  7603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.021s	sys 0.018s
W20260709 12:22:06.645146  7603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.021s	sys 0.018s
I20260709 12:22:06.639422  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:06.649459  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.650385  3990 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:06.652114  7544 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:06.652767  7544 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:06.653879  7544 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.643200  7571 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:06.655925  7610 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:06.656112  7571 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.656608  7571 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:06.654510  3992 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:22:06.668835  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 97442.6us
I20260709 12:22:06.670485  7222 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:06.671631  7579 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:06.637061  4574 rpcz_store.cc:276] 0709 12:22:05.463213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.465954 (+  2741us) service_pool.cc:224] Handling call
0709 12:22:05.519717 (+ 53763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:05.520337 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:05.526306 (+  5969us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:05.598825 (+ 72519us) log.cc:844] Serialized 26 byte log entry
0709 12:22:05.789622 (+190797us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18002f33e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:05.875911 (+ 86289us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:05.929162 (+ 53251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.951113 (+ 21951us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:06.296265 (+345152us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:06.598934 (+302669us) raft_consensus.cc:1685] finished
0709 12:22:06.598957 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.599094 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16002,"raft.queue_time_us":1573,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":27802,"spinlock_wait_cycles":153396864,"thread_start_us":36378,"threads_started":1,"wal-append.queue_time_us":394686}
I20260709 12:22:06.671882  7291 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:06.672006  7579 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:06.673019  7579 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.674271  7579 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.676918  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.677428  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.677523  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.678108  3990 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:06.678450  3998 raft_consensus.cc:2368] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:06.679037  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.679463  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.680089  3995 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:06.680183  3994 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
W20260709 12:22:06.681342  7619 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.003s
I20260709 12:22:06.681715  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.682588  3996 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:06.681334  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.685283  7588 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:06.685164  7606 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.688153  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:06.645210  3849 raft_consensus.cc:606] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:06.694906  3997 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:06.697443  3846 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:06.706328  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.721508  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.722416  3996 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:06.712625  7623 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 12:22:06.770433  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:06.943866  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:06.944499  3923 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.945711  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.946691  3997 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:06.909255  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 127039us
I20260709 12:22:06.948678  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.954545  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:06.909570  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 117122us
I20260709 12:22:06.951994  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:06.956545  3845 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.942976  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.776955  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96631b804304cddb7995664610e592d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:06.959538  3849 raft_consensus.cc:606] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:06.781389  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.942762  3918 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:06.973508  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:06.975209  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:06.976352  4578 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:22:06.978639  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.980131  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:06.980903  3999 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
W20260709 12:22:06.913174  7625 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:06.901382  7588 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.987800  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.992867  4578 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:06.735747  7571 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:06.990499  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.994633  3997 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:06.781826  7360 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:06.983132  7234 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.990427  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.998761  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.999368  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.000121  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.001058  3996 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:22:07.002362  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.002699  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.003582  3990 raft_consensus.cc:2410] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:07.005705  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.006963  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:06.995584  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:06.992285  7614 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:07.011771  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.012573  3991 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:06.998502  7588 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.013383  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.013618  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.014626  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.015026  7588 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:07.015363  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.015508  7605 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:22:07.001600  7187 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:07.016579  3994 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:07.016472  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.017405  3995 raft_consensus.cc:2410] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:07.017639  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.017359  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.012509  7614 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:07.014731  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.018893  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.021073  3999 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.022893  3996 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:22:07.023902  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.024821  3846 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:07.024976  3991 raft_consensus.cc:2368] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:07.029551  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.037005  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.036852  3845 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:07.038645  3998 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:07.039849  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.041545  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.042339  3997 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:07.009088  7234 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.044978  3841 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:07.043249  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.046006  3997 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.047731  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.049993  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.045141  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.055372  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.056828  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.058947  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.062439  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.067622  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.016705  7187 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.071161  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.071524  7187 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.072562  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.073602  3993 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:07.074651  7637 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.075079  3993 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:22:07.076263  7360 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.076707  7571 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:07.036016  7588 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.020784  7614 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:07.077651  7588 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.078428  7614 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.079874  7588 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:07.081086  7234 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:07.081822  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.082094  3998 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:07.083089  7637 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.084280  3995 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:07.085615  3995 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:22:07.086907  3995 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:22:07.087133  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:07.087214  3995 pending_rounds.cc:85] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:22:07.096340  3995 pending_rounds.cc:107] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:22:07.096040  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.096611  3995 raft_consensus.cc:2889] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:07.094211  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:07.105707  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72442.9us
I20260709 12:22:07.096871  3843 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:07.097520  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.116071  3996 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
W20260709 12:22:07.118181  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.121073  3997 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:22:07.120659  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:07.126207  3996 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:22:07.127743  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60299.8us
I20260709 12:22:07.129756  3999 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.129567  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.131283  3992 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:22:07.131692  3992 pending_rounds.cc:85] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:22:07.132011  3992 pending_rounds.cc:107] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:22:07.131717  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.132304  3992 raft_consensus.cc:2889] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:07.133447  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 150381us
I20260709 12:22:07.135087  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.135353  7579 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.118903  7553 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.124084  7614 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.153496  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:07.155392  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.169073  3815 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:07.169530  3815 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:07.128587  7588 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.171741  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.176761  3996 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.172910  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.178936  3991 raft_consensus.cc:2376] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
W20260709 12:22:07.180032  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53978.5us
I20260709 12:22:07.135130  7547 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.185451  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:07.186131  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.186765  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.187973  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:07.188987  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 69233.2us
W20260709 12:22:07.198205  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 127137us
I20260709 12:22:07.180756  7559 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.184413  7553 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:07.186890  7637 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:07.206962  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:07.208143  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.211285  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:07.211912  4579 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.216415  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:07.216830  7535 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.210745  7604 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:22:07.203823  7422 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.228591  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.234277  3998 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:07.240550  4579 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:07.202134  7571 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:07.196269  7642 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:07.243616  3990 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
W20260709 12:22:07.267628  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64081.5us
I20260709 12:22:07.267692  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.226926  7637 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:07.269572  7360 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.269973  7360 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.270787  7360 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.272363  7360 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.264519  7234 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:07.276271  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:07.278194  7234 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.278718  7234 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.278424  7553 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.296139  3814 leader_election.cc:400] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:22:07.300463  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.301460  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.296653  3889 leader_election.cc:400] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:07.241936  7535 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:07.265790  7604 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:07.303520  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:07.306551  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52848
I20260709 12:22:07.290292  7547 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:07.307365  3998 raft_consensus.cc:606] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 12:22:07.307552  3962 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:07.307793  3998 raft_consensus.cc:614] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:07.307952  3962 leader_election.cc:403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:07.308605  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.308740  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.306521  7010 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.310027  7641 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.268035  7639 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:22:07.311246  3923 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:07.302788  7567 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:07.310689  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.310261  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.329692  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.330564  7606 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.331550  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.332791  7544 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:07.333216  7544 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.333578  7544 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.322309  7547 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.305404  7604 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:07.305275  7647 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.344010  7547 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.339548  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.315137  7323 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:07.329279  7358 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.309834  7640 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.338846  7642 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:07.360752  7642 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.361325  7642 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.362600  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.327529  7567 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.349546  7323 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.373152  7323 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:07.373797  3796 auto_rebalancer.cc:893] Removing replace marker failed: Replica 32d706e2535f4fa19a09382d4edac677 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:07.374346  3796 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:22:07.374662  3796 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:22:07.351176  7584 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.375663  7584 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.376119  7584 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.351373  7358 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.381714  7358 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.382854  3850 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:07.383757  3849 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:07.339357  7650 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.388752  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.352555  7609 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:07.338124  7637 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.390141  7609 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:07.356645  7234 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.399057  7234 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:07.367965  7567 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.356652  7228 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:22:07.370168  7360 raft_consensus.cc:993] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:07.407907  7360 raft_consensus.cc:1081] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:07.342080  7604 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.407353  7228 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:07.409339  7228 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.410295  7228 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.412752  7228 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.414114  7187 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:07.415063  7010 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.415345  7187 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:07.416395  7588 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:07.416833  7588 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:07.417855  7588 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.419298  7588 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.392387  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.396034  7609 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.365746  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.399861  7580 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.441856  7422 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.437358  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:07.443948  3847 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.446419  7514 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:07.446630  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80947.2us
I20260709 12:22:07.447613  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.452430  7609 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.336329  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.454337  7514 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.411369  7584 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:07.441442  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 91195.6us
I20260709 12:22:07.477289  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:07.480396  7584 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:07.480885  7578 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:07.483176  4583 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:07.484225  7187 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:07.484346  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:07.439025  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46702.7us
I20260709 12:22:07.488111  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:07.489599  3994 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:07.497947  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.498489  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.498886  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.502381  3925 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:22:07.484819  7187 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.503758  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.503875  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:07.507046  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.504493  7636 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:07.507949  3918 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:07.508348  7649 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:22:07.509011  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.500249  7580 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:22:07.496682  7010 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:22:07.511034  7187 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:07.496516  7640 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:22:07.503419  7644 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:22:07.505734  3847 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:07.517117  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.518018  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:07.520224  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.526036  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.519294  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:07.502854  7614 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.479424  7647 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.548241  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.550218  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:07.546272  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.553211  3919 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.550220  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:07.524107  7187 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:07.554885  3846 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:07.562315  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.545306  3746 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.547515  7571 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:07.554811  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.599310  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 214) took 10181 ms. Trace:
I20260709 12:22:07.600667  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:07.600941  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50820.1us
I20260709 12:22:07.601377  3990 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.604151  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:07.605855  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.605994  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:07.606369  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.607729  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.596706  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 10, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.549300  7606 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.614288  3925 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:07.545616  7579 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:07.548512  7445 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.618225  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.615549  7187 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:07.635339  3746 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:07.628046  3990 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:07.617278  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:07.544690  7636 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:22:07.631836  3925 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:07.609506  7010 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.645681  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.599789  3747 rpcz_store.cc:276] 0709 12:21:57.412644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:57.415586 (+  2942us) service_pool.cc:224] Handling call
0709 12:22:07.593960 (+10178374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:04.933727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:04.934499 (+   772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:04.934555 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:22:04.934576 (+    21us) tablet.cc:662] Decoding operations
0709 12:22:04.935894 (+  1318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:04.936014 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:04.936047 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:04.937306 (+  1259us) tablet.cc:701] Row locks acquired
0709 12:22:04.937362 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:22:04.937576 (+   214us) write_op.cc:270] Start()
0709 12:22:04.937736 (+   160us) write_op.cc:276] Timestamp: P: 1783599724937501 usec, L: 0
0709 12:22:04.937764 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:22:05.124845 (+187081us) log.cc:844] Serialized 5201 byte log entry
0709 12:22:06.508198 (+1383353us) op_driver.cc:464] REPLICATION: finished
0709 12:22:06.676081 (+167883us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc4f8e90ac 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc56429ef0
0709 12:22:06.964056 (+287975us) write_op.cc:301] APPLY: starting
0709 12:22:06.964177 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:06.964489 (+   312us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:06.964542 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:06.966005 (+  1463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:06.966345 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:22:06.966384 (+    39us) write_op.cc:312] APPLY: finished
0709 12:22:06.966726 (+   342us) log.cc:844] Serialized 95 byte log entry
0709 12:22:06.966970 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.967140 (+   170us) write_op.cc:454] Released schema lock
0709 12:22:06.967216 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:06.972726 (+  5510us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.972765 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":513659,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":455450,"apply.run_cpu_time_us":3864,"apply.run_wall_time_us":8631,"num_ops":13,"prepare.queue_time_us":427261,"prepare.run_cpu_time_us":33974,"prepare.run_wall_time_us":556458,"raft.queue_time_us":675450,"raft.run_cpu_time_us":34764,"raft.run_wall_time_us":367197,"replication_time_us":1570232,"spinlock_wait_cycles":157372800,"thread_start_us":993560,"threads_started":4,"wal-append.queue_time_us":493022}]]}
I20260709 12:22:07.606701  7614 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:07.610950  7647 raft_consensus.cc:2764] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:22:07.616039  7640 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.613317  3996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96631b804304cddb7995664610e592d"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:07.656176  3996 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:07.656694  3996 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.657881  3919 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.595363  7637 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:22:07.663748  7187 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.664517  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.665033  7640 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.666267  7640 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.666786  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.660247  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.621569  7571 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.669217  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.660068  3746 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.667435  3918 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:07.676420  3996 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:07.681093  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.681595  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.684551  3996 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.650971  7614 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:07.689855  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 75095.4us
I20260709 12:22:07.648665  7010 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.692970  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.651002  7636 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.696085  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.708256  3919 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:07.637615  7579 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.713250  3919 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:07.643165  7445 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.714154  3746 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 8, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.729897  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:07.730728  3841 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:07.733421  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.731135  3841 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:07.739003  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.709470  7636 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:07.746371  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.696183  7234 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:07.752266  3746 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.758447  3996 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:07.760152  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:07.767035  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:07.767815  3918 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.770545  7445 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:07.771318  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:07.772167  3843 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:07.773639  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:07.774497  7445 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:07.774886  7445 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:07.775259  7445 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.776100  7579 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:07.777108  3918 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:07.777606  7614 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:07.781338  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.782169  3841 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:07.813146  3841 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:07.815999  3746 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.818894  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:07.790239  7360 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.740778  7604 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.836112  3746 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 10 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:07.847157  3843 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:07.841339  3746 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.854777  3746 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.856421  3746 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:07.757387  7010 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.816933  7567 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.845147  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:07.859591  7544 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 12:22:07.901044  7544 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.840600  7642 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:07.906112  7650 consensus_meta.cc:287] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 12:22:07.906729  7650 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:07.908696  7544 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:07.910588  7654 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:22:07.910843  7652 raft_consensus.cc:993] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:07.831517  7636 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.911407  7652 raft_consensus.cc:1081] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:22:07.916993  7658 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:22:07.928094  7657 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 12:22:07.931529  7010 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.933348  7604 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:07.822425  7571 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.938104  7567 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:07.870723  7358 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.947510  7358 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:07.947810  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.948592  7358 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:07.966238  3841 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
W20260709 12:22:07.977447  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.991415  3994 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:08.000607  7605 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:07.999688  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 149645us
I20260709 12:22:08.001433  7605 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.004374  7605 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:08.008093  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:08.010218  3746 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.061518  7580 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:08.062860  7234 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:08.062569  7580 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.064097  7234 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:08.065970  7580 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:08.062487  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54539.1us
W20260709 12:22:08.068156  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.065452  7234 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.077469  3746 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.997264  7579 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:08.092262  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:08.095115  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.098701  3921 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:08.105167  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 98444us
I20260709 12:22:08.108142  3925 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:08.098665  7609 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.002s
I20260709 12:22:08.124238  3847 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:08.123939  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:08.130268  3848 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:08.132308  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:08.132370  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.137430  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.138652  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.142021  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:08.145937  3923 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:08.147284  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:08.150393  3916 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.100250  7579 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.166638  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.144552  7606 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:08.178869  7422 raft_consensus.cc:2764] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:08.146534  7445 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.167872  7567 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:22:08.211776  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.232012  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:08.206506  7605 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:08.236761  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:08.235927  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 239369us
I20260709 12:22:08.237920  4581 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.238797  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.239856  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.244513  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.245395  7588 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.246130  7596 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:08.246300  3925 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:08.245983  7588 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.246734  7596 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.249123  7588 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:08.250018  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:08.251572  3993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:08.252233  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.252521  3993 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:08.252928  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.253149  3993 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.258145  7596 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:08.251749  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.261008  7596 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:08.262545  7596 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:08.269968  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.274024  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.235046  7673 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.292536  7673 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.294566  3918 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:08.294929  7673 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:08.236950  7571 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:08.295691  7571 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:08.296684  7571 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.298146  7642 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:08.299124  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:08.299935  7669 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:22:08.300859  7553 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:08.301942  7579 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:08.302577  7636 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:08.305629  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.234261  7605 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:08.309806  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56939.3us
I20260709 12:22:08.315253  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.318595  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.326283  7605 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.327157  7614 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.327777  7605 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.329802  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.330672  7614 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.332676  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:08.336169  7445 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:08.337281  7614 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.341984  4581 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:08.321781  3993 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.343263  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.348184  3998 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:08.349363  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.350755  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:08.351483  3843 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:08.351914  3843 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:08.356779  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.350297  7614 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:08.360219  7559 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:08.360639  7559 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:08.361531  7559 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.363106  7559 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:08.324261  7579 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.363866  7187 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.358770  3993 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:08.356086  3843 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.394412  3843 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.400547  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:08.398803  7685 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:22:08.413239  7187 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.421053  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.422283  7579 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.388553  7614 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:08.427501  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:08.421468  7665 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
I20260709 12:22:08.439520  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.444634  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.518883  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.515766  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:08.520169  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:08.445672  7579 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.454473  7614 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.528749  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.504231  7323 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.535193  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:08.537479  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 99474.7us
I20260709 12:22:08.540699  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:08.523837  7673 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.547537  7588 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:08.549921  7323 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:08.551955  7613 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:08.552942  7692 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:08.556838  3848 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:08.553969  7596 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:08.534842  7187 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.568049  7699 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:08.570927  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.571486  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.537647  7580 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:08.573153  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.577296  3997 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:08.577528  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.574225  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.577919  7571 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:08.575131  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.578336  7571 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:08.579290  7571 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.580509  7571 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:08.575973  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.584358  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.583060  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.589681  3995 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:08.585985  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:08.591975  3995 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:08.592461  3993 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:08.594720  7578 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:08.602319  3999 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:08.603286  3996 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:08.627053  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80678.3us
I20260709 12:22:08.572165  7640 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:08.641804  3996 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:08.638468  3992 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:08.644456  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:08.650524  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.660207  3992 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:08.662842  3843 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:08.666347  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:08.669370  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.670778  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.673099  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.622886  7578 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:08.675774  3992 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:08.679275  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.680549  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:08.659983  7686 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:08.683310  3997 raft_consensus.cc:2393] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:08.684922  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:08.676185  7547 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:08.722774  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 94590.3us
W20260709 12:22:08.729158  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.730584  7701 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:22:08.731815  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 494966us
I20260709 12:22:08.737433  4581 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:08.743969  3919 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:08.764958  3923 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:08.699142  7704 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:08.767418  7704 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:08.773177  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:08.774113  7700 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:08.787099  7700 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.787760  7578 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.789180  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:08.769181  7547 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:08.798175  7547 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.817698  7187 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.818382  7187 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:08.823612  7692 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:08.824280  7692 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:08.823652  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:08.828004  3850 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
W20260709 12:22:08.839704  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.843734  7187 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:08.844863  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:08.845453  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.845700  3999 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:08.848166  7700 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:08.858564  7636 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.556s	user 0.018s	sys 0.004s
I20260709 12:22:08.888549  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.770476  7704 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.892946  7704 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.909951  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.911566  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:08.914465  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:08.915130  4575 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.883545  7692 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:08.924574  7692 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.927163  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:08.955041  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 83179.4us
W20260709 12:22:08.998739  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 259422us
I20260709 12:22:08.935078  7685 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:09.009487  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139390us
W20260709 12:22:09.013414  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.004356  7187 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:09.025799  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:09.027947  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:09.008021  7685 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.029233  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:09.029657  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:09.031795  3992 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:09.032773  7696 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.036234  7653 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:09.044413  3850 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:09.046331  7650 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:09.029233  7681 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.023900  7606 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:09.051663  7606 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:09.054602  7606 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:09.055410  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.016628  7571 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:22:09.056030  7187 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:09.057632  7690 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.487s	user 0.000s	sys 0.003s
I20260709 12:22:09.055414  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:09.063175  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.019752  7707 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.059183  7187 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:09.060149  7685 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:09.072650  3994 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:09.075659  7571 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.076303  7571 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.078341  3843 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:09.085312  3995 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:09.090847  3995 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:09.164716  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 69601.8us
W20260709 12:22:09.169215  7717 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:22:09.172712  7699 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:09.167860  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.072743  7707 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.178202  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2900e71c0212466e8be300d30595c609"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:09.178786  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:09.182591  7714 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.183205  7714 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.184523  3843 raft_consensus.cc:606] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:09.184899  3843 raft_consensus.cc:614] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.185038  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.188446  7707 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.190392  4575 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:09.198709  7606 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:09.199317  7422 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:09.199488  7606 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:09.200250  7422 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.202890  7606 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:09.189139  7187 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.210215  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.215502  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.227098  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:09.096946  7323 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:22:09.234500  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.234835  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.206228  7559 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.203286  7422 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.226406  7604 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.215128  7606 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:09.224203  7187 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:09.261256  7711 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.254s	user 0.002s	sys 0.006s
I20260709 12:22:09.240305  7358 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:09.268963  7358 consensus_queue.cc:1243] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:09.272652  3848 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:09.238811  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.274799  3994 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:09.239816  7692 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:09.278374  7606 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.280737  7606 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.253927  7604 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.287380  7604 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.255429  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:09.288127  3841 raft_consensus.cc:606] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:09.288515  3841 raft_consensus.cc:614] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.258661  7588 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.289535  7588 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.291827  7588 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:09.251180  7677 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:09.298180  7710 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.301s	user 0.009s	sys 0.000s
I20260709 12:22:09.245795  7451 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.300695  7451 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.302798  7451 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.302639  7724 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:09.306326  3918 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:09.313184  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.307605  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.309475  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:09.317209  3850 raft_consensus.cc:606] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:09.317579  3850 raft_consensus.cc:614] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.226280  7699 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:09.319698  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.320441  3841 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:09.320487  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:09.321456  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 255282us
I20260709 12:22:09.323873  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.325430  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.326361  3841 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:09.322255  7707 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:09.337090  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.338727  3888 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:09.340276  3733 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 32d706e2535f4fa19a09382d4edac677 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:09.331983  7571 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.348279  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:09.348969  3850 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:09.354553  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:09.356614  3841 raft_consensus.cc:606] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:09.357187  3841 raft_consensus.cc:614] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.355957  7697 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:09.355022  3850 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:09.358706  7535 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.338914  7707 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.372419  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:22:09.362563  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 125802us
I20260709 12:22:09.373327  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:09.378167  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.389469  4583 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:09.391058  7681 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:09.364614  7451 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:09.366478  7697 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:09.372565  7535 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.375696  7707 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.422267  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.423113  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.424242  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.424901  3993 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:09.425239  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.426415  3992 raft_consensus.cc:1217] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-14.8]   Dedup: 9.6->[12.7-14.8]
I20260709 12:22:09.426910  3992 pending_rounds.cc:85] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 6
I20260709 12:22:09.427134  3992 pending_rounds.cc:107] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:09.427354  3992 raft_consensus.cc:2889] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:09.429198  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.393019  7677 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.430264  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.436116  3923 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:22:09.433187  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.436501  3923 pending_rounds.cc:85] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 7
I20260709 12:22:09.436723  3999 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:09.437301  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:09.438282  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.436754  3923 pending_rounds.cc:107] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:22:09.441361  3923 raft_consensus.cc:2889] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:09.396165  7451 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.445794  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:09.446300  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:09.446486  3916 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:09.448756  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:09.449066  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.403811  7535 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.402987  7714 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.453294  3991 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:09.454385  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.398067  7681 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:22:09.455431  3921 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:09.448477  7451 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.458627  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:09.457298  7704 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.003s
I20260709 12:22:09.472461  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.457273  7670 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.478310  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.476995  7728 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.464818  7604 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.460093  7697 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.485802  7697 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.460067  7614 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:09.488147  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.489648  7644 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.493046  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:09.486852  7698 consensus_queue.cc:1175] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "32d706e2535f4fa19a09382d4edac677" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 12:22:09.490986  7636 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.501982  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.503847  7636 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.509285  7636 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.509410  7685 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:09.510612  3994 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:09.512547  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.517871  7685 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:09.520319  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:09.513767  3890 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9cb9cc431d048dd8cfea736da6af5fa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:09.505307  7704 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.524467  7584 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:09.528362  7584 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:09.529310  7584 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.520427  7644 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:09.527680  7704 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.564998  7704 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.527719  7707 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.555337  7652 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.532374  7729 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:22:09.623423  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.624215  7732 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:22:09.632841  7707 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.633294  7682 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:09.598353  7652 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.635610  7652 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.638355  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:09.591351  7644 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:09.642341  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:09.642963  3992 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.643680  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.644280  3990 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:09.645370  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 66623.9us
I20260709 12:22:09.646148  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.651962  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.652789  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.653672  7644 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.654920  7692 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.650839  7467 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:09.658996  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 92917us
I20260709 12:22:09.614880  7451 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.665072  3995 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:22:09.665657  3846 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:09.655350  7692 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.662909  7467 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:09.660349  7728 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.675688  7535 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.696125  7535 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.696951  3923 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:09.681896  7692 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.663694  7422 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:09.702996  7422 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.705981  7422 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.707744  7613 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.708338  7613 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.710569  7613 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.712316  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:09.713020  3995 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:09.692885  7667 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:09.720330  7451 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.715345  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.715754  4581 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:22:09.735677  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71053.1us
I20260709 12:22:09.668926  7614 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.739806  3992 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:09.744010  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:09.749203  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.745162  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:09.751049  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.746279  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.740036  7707 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:09.759585  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 96822.5us
I20260709 12:22:09.769927  7535 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.757067  7653 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:09.773628  7653 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:09.774693  7653 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.742482  7588 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:22:09.771981  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.781474  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.782603  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.783607  7604 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.784329  7604 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:09.783279  7651 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.758065  7707 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.787832  7707 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.759649  7606 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.803896  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.804816  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:09.805423  3848 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.806792  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:09.761165  7742 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:22:09.755482  7636 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.786754  7467 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:09.828560  3848 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:09.848721  3841 raft_consensus.cc:2368] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:09.851612  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.853798  7743 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.854411  7743 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.860668  7743 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.864653  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:09.843890  7704 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.868170  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.867555  7467 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:09.887435  3846 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:09.872538  7451 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:22:09.908257  7707 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.917397  7636 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.876458  7604 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:09.923683  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 116040us
I20260709 12:22:09.924139  7704 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.879223  7728 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:09.932094  7707 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:09.932857  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 143555us
I20260709 12:22:09.953265  7580 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:09.953915  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:09.954551  3994 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.954861  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:09.935753  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 72283.5us
I20260709 12:22:09.955516  3993 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.956892  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 191) took 7976 ms. Trace:
I20260709 12:22:09.957075  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:09.957654  3992 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.958628  3888 leader_election.cc:400] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:09.958954  3888 leader_election.cc:403] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:09.960569  7728 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.937328  7604 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:09.963910  7604 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:09.964795  7604 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.965584  3993 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:09.863621  7692 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.945864  3744 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:09.970369  7692 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:09.970512  3994 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:09.953917  7580 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:09.974255  7580 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:09.975063  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.976970  3992 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:09.979739  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:09.980681  3848 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:09.983639  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.984198  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.984534  7580 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:09.985100  7580 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:09.985378  7704 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:09.986126  7704 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:09.985497  7580 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:09.989497  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51146.1us
I20260709 12:22:09.987115  7704 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.000819  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:10.001722  3994 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.985546  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:10.029079  3994 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:10.037118  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:10.008692  7580 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.046995  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:09.957297  3746 rpcz_store.cc:276] 0709 12:22:01.980019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.995972 (+ 15953us) service_pool.cc:224] Handling call
0709 12:22:02.233177 (+237205us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400190690. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cf0b2 00007fdc58848759 00007fdc587e0a76 00007fdc587b1d58 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc
0709 12:22:09.956801 (+7723624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:08.338147 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:08.338730 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:08.338765 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:22:08.338784 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:08.340333 (+  1549us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:08.340425 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:08.340470 (+    45us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:08.341959 (+  1489us) tablet.cc:701] Row locks acquired
0709 12:22:08.341995 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:22:08.342160 (+   165us) write_op.cc:270] Start()
0709 12:22:08.342285 (+   125us) write_op.cc:276] Timestamp: P: 1783599728342108 usec, L: 0
0709 12:22:08.342301 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:22:08.343095 (+   794us) log.cc:844] Serialized 5135 byte log entry
0709 12:22:08.683307 (+340212us) op_driver.cc:464] REPLICATION: finished
0709 12:22:08.874065 (+190758us) write_op.cc:301] APPLY: starting
0709 12:22:08.874162 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:08.874442 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:08.874569 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:09.078424 (+203855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:09.078833 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:22:09.078909 (+    76us) write_op.cc:312] APPLY: finished
0709 12:22:09.079263 (+   354us) log.cc:844] Serialized 95 byte log entry
0709 12:22:09.079489 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.079662 (+   173us) write_op.cc:454] Released schema lock
0709 12:22:09.079714 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:09.080139 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.080165 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":996199,"reported_tablets":42,"spinlock_wait_cycles":46441728,"child_traces":[["op",{"apply.queue_time_us":187518,"apply.run_cpu_time_us":5681,"apply.run_wall_time_us":206060,"num_ops":13,"prepare.queue_time_us":143262,"prepare.run_cpu_time_us":13628,"prepare.run_wall_time_us":64918,"raft.queue_time_us":100340,"raft.run_cpu_time_us":6881,"raft.run_wall_time_us":192368,"replication_time_us":309968,"thread_start_us":298163,"threads_started":4,"wal-append.queue_time_us":92432}]]}
W20260709 12:22:10.091570  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.045420  7692 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:10.049151  7707 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:10.118577  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 253994us
I20260709 12:22:10.081694  7636 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:10.125471  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.126543  3924 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:10.114297  7547 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.131407  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.136324  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.113142  7613 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.117538  7692 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:10.120536  7707 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:10.153987  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:10.159809  3993 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:10.160905  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:10.161697  3992 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:10.162602  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:10.163354  3991 raft_consensus.cc:2368] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.166415  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:10.166997  3992 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:10.168229  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:10.176456  3996 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:10.177908  3841 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:10.142299  7636 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:10.146292  7650 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.170987  7673 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.191177  7673 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.191668  7636 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.176890  7614 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.195467  7614 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.181043  7750 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.176669  7323 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.200178  7750 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.200538  7323 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.202085  3992 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:10.182850  7670 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.203099  7670 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.204648  7728 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.181324  7714 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:10.204751  7704 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:10.209311  7742 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:10.210001  7742 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.211344  7653 raft_consensus.cc:993] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:10.211930  7653 raft_consensus.cc:1081] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:10.211820  7651 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:10.212837  7742 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:10.212103  7751 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:10.214243  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.214337  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.189852  7650 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.216012  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.212721  7651 consensus_queue.cc:1243] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:10.216655  3925 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:10.218113  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.219811  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.156281  7613 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.221315  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.222172  7613 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:10.222621  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.223187  7596 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.223421  3918 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:10.223914  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.223811  7596 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:10.224478  3919 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:10.225912  7596 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:10.228921  7644 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:10.232324  3846 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:10.235342  7614 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.146556  7547 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.237588  7547 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.238430  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.243578  3919 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:10.246044  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.248891  3889 leader_election.cc:400] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.250465  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.193524  7673 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.251369  7567 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.259212  7596 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.274570  7596 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:10.277055  7596 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:10.277786  7580 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.252797  7547 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:10.248204  7651 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:22:10.299110  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:10.268900  7714 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.265542  7753 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:10.285383  7606 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:10.333180  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47038.4us
I20260709 12:22:10.336613  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:10.337355  3998 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:10.337414  3999 raft_consensus.cc:2368] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.338378  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.339541  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.339779  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.341262  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.342686  3918 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:10.338755  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.347304  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.348168  3924 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:10.343614  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.367802  3922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:10.368763  3922 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:10.369234  3922 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:10.290932  7605 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:22:10.385250  7763 ts_tablet_manager.cc:933] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.341087  7606 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:10.387506  7755 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:10.258912  7692 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.259104  7707 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.334335  7714 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.429910  3925 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:10.430640  3922 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.445148  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:10.446274  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:10.446923  3846 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:10.447212  3846 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:10.448182  3846 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.449025  3922 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:10.448957  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:10.449705  3846 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:10.446712  7606 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.462613  3846 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:10.456115  7606 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:10.465749  7714 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:10.469377  7759 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.257s	user 0.000s	sys 0.009s
I20260709 12:22:10.494144  3889 leader_election.cc:400] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.494513  3889 leader_election.cc:403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:10.463862  3888 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:10.511829  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.513303  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.514542  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.516011  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.522732  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:10.524067  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:10.527863  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 64086.3us
I20260709 12:22:10.528216  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.530478  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:10.532419  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50530.9us
I20260709 12:22:10.533468  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:10.507666  7451 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11.
I20260709 12:22:10.537639  3843 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:10.500581  7605 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:22:10.561177  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:10.563895  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:10.542160  7750 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.541922  7777 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:10.576185  3999 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:10.580207  7323 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.585542  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:10.572889  7763 tablet_copy_client.cc:323] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:22:10.596330  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.597082  3925 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:10.598943  3918 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:10.599545  3925 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:22:10.599968  3925 pending_rounds.cc:85] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 4
I20260709 12:22:10.600224  3925 pending_rounds.cc:107] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:10.600482  3925 raft_consensus.cc:2889] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:10.599323  3918 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:10.601279  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:10.590040  7777 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:10.601680  3918 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:10.607964  7768 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:22:10.594905  7772 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:10.609681  7652 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:10.627714  7775 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:22:10.627995  7670 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.628980  7652 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.628892  7772 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.638020  7652 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:10.613793  7692 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:10.643705  7772 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:10.674150  7772 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.689296  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:10.690724  3923 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:10.740661  3923 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:10.741325  7779 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:10.743883  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 182496us
I20260709 12:22:10.745165  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.746464  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.674718  7644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46042 (request call id 4) took 1444 ms. Trace:
I20260709 12:22:10.687564  7772 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:10.674880  7650 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.649245  7777 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.740844  7673 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.743935  7685 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:10.753199  7588 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:10.753782  7750 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:10.805581  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.819728  7782 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:10.829607  7782 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.837525  3920 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:10.869136  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:10.869501  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 123691us
W20260709 12:22:10.877439  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 126221us
I20260709 12:22:10.878782  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:10.880714  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.882469  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.883929  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.885800  3918 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:10.754689  7644 rpcz_store.cc:276] 0709 12:22:09.233359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.234227 (+   868us) service_pool.cc:224] Handling call
0709 12:22:09.305725 (+ 71498us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001acaa0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52968a1d 00007fdc5294f1a4 00007fdc529d1447 00007fdc529ee70a 00007fdc529ef76a 00007fdc529ee91b 00007fdc529fa03c 00007fdc529f96b3 00007fdc579b9d29 00007fdc50f381d4
0709 12:22:09.341402 (+ 35677us) log.cc:844] Serialized 499 byte log entry
0709 12:22:09.495114 (+153712us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54001acaa0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52973b26 00007fdc5296d49a 00007fdc5296c714 00007fdc5294ceaa 00007fdc52953d53 00007fdc52953cd9 00007fdc52953c69 00007fdc52953c31 00007fdc52952dfd 0000000000388634
0709 12:22:09.546286 (+ 51172us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18002189e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:09.671843 (+125557us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b54001acaa0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52968dbe 00007fdc52973930 00007fdc529738d8 00007fdc52973858 00007fdc52973813 00007fdc52972a9c 00007fdc5885e2f6 00007fdc58858aa8 00007fdc529af7cb 00007fdc529b22c0
0709 12:22:10.674605 (+1002762us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22676,"raft.queue_time_us":32059,"raft.run_cpu_time_us":4914,"raft.run_wall_time_us":91602,"spinlock_wait_cycles":78577408,"thread_start_us":109275,"threads_started":1,"wal-append.queue_time_us":136051}
I20260709 12:22:10.887665  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.888870  7547 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:10.815721  7707 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.892655  3843 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:10.899672  3846 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:10.758884  7673 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.913334  7673 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.901823  7707 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.898211  7685 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:10.916555  7704 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:10.916776  7685 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.918989  7685 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.927596  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet c9cb9cc431d048dd8cfea736da6af5fa from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:22:10.928296  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet c9cb9cc431d048dd8cfea736da6af5fa from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-c9cb9cc431d048dd8cfea736da6af5fa
I20260709 12:22:10.929104  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:10.929859  3999 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:10.936568  7786 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:22:10.938445  7707 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:10.941090  3997 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:10.943619  3994 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:10.944796  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:10.949417  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:10.950392  7714 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:10.951267  7714 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:10.952991  7323 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:10.953568  7323 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.954623  7772 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:10.956067  7567 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:10.953812  7714 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:10.957811  7323 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:10.907534  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:10.960659  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53248.8us
I20260709 12:22:10.909085  7614 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:10.962244  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:10.998752  3999 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:10.966998  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.973975  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.997790  3920 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:10.974143  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:10.975167  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:11.003667  3849 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:11.008267  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:11.002183  7547 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:11.005671  7782 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:11.050531  3918 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:22:11.052459  3918 pending_rounds.cc:85] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 5
I20260709 12:22:11.052928  3918 pending_rounds.cc:107] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:22:11.054003  3918 raft_consensus.cc:2889] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:11.061812  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:11.007537  7614 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.071313  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:11.071735  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 176681us
W20260709 12:22:11.062948  7422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:22:11.072875  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76635.6us
I20260709 12:22:11.081147  3993 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.082724  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:11.065874  7547 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:11.085644  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:11.074772  7685 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.072512  7707 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.098320  3993 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:11.078996  7650 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.108721  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:11.109206  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70746.5us
I20260709 12:22:11.115059  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.091864  7673 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:11.139902  7650 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:11.140552  7650 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:11.141031  7650 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:11.103940  7670 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.102481  7707 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.132009  7547 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.136579  7614 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:11.160650  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 152490us
I20260709 12:22:11.166072  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.166826  3916 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:11.167728  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.168521  3918 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:11.174369  7636 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:11.176649  7636 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:11.179041  7636 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:11.159019  7707 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.179657  7795 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:11.183748  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.187747  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:11.188687  4583 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:11.191551  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89188.6us
I20260709 12:22:11.194654  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:11.197278  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 88652.6us
W20260709 12:22:11.186173  7652 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
I20260709 12:22:11.198567  3916 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:11.198951  3921 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:11.201839  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:11.205483  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:11.209914  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 82072.5us
I20260709 12:22:11.210047  7800 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:11.211993  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:11.212555  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117821us
I20260709 12:22:11.197692  7795 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.218266  7795 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:11.218617  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet dfad3fb2927f45958c4a0cf0768a8b53: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:11.218704  7795 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.214659  3999 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:11.217360  3934 tablet_copy_source_session.cc:215] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:11.193748  7650 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.200807  7652 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:11.235721  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet e693a63f62764df9a01acfa82fed09e8: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.242686  3848 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:22:11.230722  7796 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:22:11.261379  3962 leader_election.cc:400] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:22:11.261757  3962 leader_election.cc:403] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.244827  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:11.262820  3921 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.263270  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:11.212770  7800 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:11.234238  7650 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:11.281875  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:11.282519  3990 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:11.282850  3998 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:11.284199  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.285025  3920 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:11.285030  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9cb9cc431d048dd8cfea736da6af5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:11.243669  7652 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:11.298408  3921 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:22:11.299053  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 293609us
I20260709 12:22:11.301517  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:11.302574  3918 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:11.286401  7781 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.225268  7797 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:22:11.327836  7804 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:22:11.331831  7707 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.333467  3850 raft_consensus.cc:2368] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:22:11.334383  3964 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:11.334753  3964 leader_election.cc:403] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.336174  7588 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:11.336896  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:11.342598  7803 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:22:11.346048  7704 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:11.346668  7704 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:11.350369  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:11.351861  3921 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.358572  3993 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:11.360344  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:11.361496  3993 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:11.362586  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:11.368112  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:11.369057  3993 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.388028  3994 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:11.334828  7707 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:11.307024  7636 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:22:11.306782  7692 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:22:11.405030  3921 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:11.388851  3999 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:22:11.418223  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 81417.6us
I20260709 12:22:11.422533  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:11.424590  7813 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:11.426489  7816 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:11.404605  7714 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:22:11.430027  3993 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:11.435792  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet ce77a1e41f7b43cc965d6fd6976759cd: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.406006  7704 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.451573  7795 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:11.455426  3962 leader_election.cc:400] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:22:11.456489  3962 leader_election.cc:403] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.457532  7596 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:22:11.412328  7606 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:11.466483  7795 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:11.427276  7816 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:11.510903  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:11.559468  7812 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:22:11.503705  3744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 114) took 11856 ms (client timeout 15000 ms). Trace:
I20260709 12:22:11.587066  3848 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:11.597189  7801 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.597844  7801 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.602509  3847 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:11.602416  4581 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:11.605589  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:11.608996  7779 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:11.609380  7652 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:11.621786  3746 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:11.630759  3746 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.633752  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:11.634009  3746 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 9, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.635687  3746 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.637212  3746 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.638324  3916 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:11.638545  3746 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.640444  3746 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.641645  3746 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.642648  3746 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.643920  3746 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.645143  3746 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.646852  3746 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:11.579660  3744 rpcz_store.cc:269] 0709 12:21:59.627959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.635853 (+  7894us) service_pool.cc:224] Handling call
0709 12:22:11.483842 (+11847989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:10.220048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:10.220607 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:10.220644 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:22:10.220661 (+    17us) tablet.cc:662] Decoding operations
0709 12:22:10.221003 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:10.221056 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:10.221089 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:10.221271 (+   182us) tablet.cc:701] Row locks acquired
0709 12:22:10.221291 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:22:10.221437 (+   146us) write_op.cc:270] Start()
0709 12:22:10.221554 (+   117us) write_op.cc:276] Timestamp: P: 1783599730221392 usec, L: 0
0709 12:22:10.221578 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:10.222284 (+   706us) log.cc:844] Serialized 533 byte log entry
0709 12:22:10.889010 (+666726us) op_driver.cc:464] REPLICATION: finished
0709 12:22:11.274766 (+385756us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18003101e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:11.274902 (+   136us) write_op.cc:301] APPLY: starting
0709 12:22:11.274990 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:11.275089 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:11.275109 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:11.275360 (+   251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:11.275569 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:11.275616 (+    47us) write_op.cc:312] APPLY: finished
0709 12:22:11.275824 (+   208us) log.cc:844] Serialized 23 byte log entry
0709 12:22:11.275993 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:11.276086 (+    93us) write_op.cc:454] Released schema lock
0709 12:22:11.276128 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:11.276549 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:11.276580 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197433,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":213043,"apply.run_cpu_time_us":1578,"apply.run_wall_time_us":1579,"num_ops":1,"prepare.queue_time_us":234056,"prepare.run_cpu_time_us":22153,"prepare.run_wall_time_us":158603,"raft.queue_time_us":179093,"raft.run_cpu_time_us":27813,"raft.run_wall_time_us":233664,"replication_time_us":667252,"spinlock_wait_cycles":2579328,"thread_start_us":520046,"threads_started":4,"wal-append.queue_time_us":204768}]]}
I20260709 12:22:11.648653  3746 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.650720  3746 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.652343  3746 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.653966  3746 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.655417  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.657527  3746 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 6, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:11.659310  3746 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.661038  3746 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 11, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.662935  3746 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 4 to 6, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.664842  3746 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.666301  3746 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.674417  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:11.675100  3848 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:11.676864  3746 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:11.663148  7781 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:22:11.678435  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:11.643152  7652 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:11.680743  3746 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.681826  7729 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:22:11.695256  7652 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:11.709249  7801 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:11.714501  3746 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:11.717525  3990 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:11.720682  3746 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.722108  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:11.722762  3848 raft_consensus.cc:606] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:11.731709  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:11.675354  7797 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:11.737351  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:11.633472  7816 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.745874  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:11.746677  3848 raft_consensus.cc:606] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:11.749372  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:11.740899  7547 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.750211  3850 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:11.750804  3850 raft_consensus.cc:614] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:11.754518  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:11.755362  3850 raft_consensus.cc:606] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:11.756084  3850 raft_consensus.cc:614] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:11.779625  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:11.781605  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.782523  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.798405  3920 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:22:11.807782  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 389240us
W20260709 12:22:11.800007  7817 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:22:11.827544  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:11.828382  3990 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:11.837298  7801 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:22:11.900295  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 47492.6us
W20260709 12:22:11.940090  7821 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:22:11.924818  7802 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.961722  7802 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:11.964112  7802 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:11.965611  7714 raft_consensus.cc:993] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:11.972355  7763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35184 (request call id 476) took 1810 ms. Trace:
I20260709 12:22:11.972867  7763 rpcz_store.cc:276] 0709 12:22:10.161695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.161866 (+   171us) service_pool.cc:224] Handling call
0709 12:22:10.411605 (+249739us) ts_tablet_manager.cc:934] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
0709 12:22:11.283545 (+871940us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:11.528109 (+244564us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:11.528255 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:11.971379 (+443124us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:11.971819 (+   440us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:11.972179 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:11.972240 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":32659,"tablet-copy.queue_time_us":181553,"thread_start_us":209728,"threads_started":2}
I20260709 12:22:11.974470  7763 tablet_copy_client.cc:806] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:11.977785  7704 raft_consensus.cc:993] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:11.984948  7714 raft_consensus.cc:1081] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:11.987303  7811 raft_consensus.cc:1081] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:22:11.934741  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49165.5us
I20260709 12:22:11.975134  7763 tablet_copy_client.cc:670] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:12.011147  3921 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:22:12.033594  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73444.5us
I20260709 12:22:12.035467  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:12.037463  3991 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:12.042289  3991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:12.042831  3990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:12.043483  3992 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:12.043620  3990 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:12.044096  3990 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.042920  3991 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:12.044729  3991 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.048308  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:12.032995  7811 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:22:12.078819  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49535.1us
I20260709 12:22:12.087116  3990 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.091603  3990 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:12.093463  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:12.094424  3848 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:12.094754  3848 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:12.103048  3848 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.110327  3848 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.136605  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:12.139735  3848 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:12.143832  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:12.141952  3991 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.168623  7547 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:12.204877  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.242681  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:12.243741  3848 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:12.244176  3848 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:12.246299  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109775us
I20260709 12:22:12.242558  3991 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:12.256680  4581 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:12.259694  7825 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:12.277926  3848 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.276804  7547 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:12.278245  7677 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:12.303766  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 166178us
I20260709 12:22:12.318301  7801 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:12.328365  7768 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.252s	user 0.000s	sys 0.003s
I20260709 12:22:12.307854  7677 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:12.359814  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.378557  7547 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.544960  7580 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.662336  7763 tablet_copy_client.cc:538] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:12.650395  7580 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:12.748901  7580 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:12.753682  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:12.755425  7832 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.454s	user 0.006s	sys 0.005s
W20260709 12:22:12.752857  7845 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:22:12.832172  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.850566  7422 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:12.851619  7422 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.854736  7677 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:12.855021  7422 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:12.858031  7422 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:12.858779  7422 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.862221  7422 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:12.881052  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:12.883476  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 2463) took 1057 ms. Trace:
I20260709 12:22:12.884050  3998 rpcz_store.cc:276] 0709 12:22:11.826282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.826433 (+   151us) service_pool.cc:224] Handling call
0709 12:22:11.826707 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.849490 (+ 22783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.849520 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.850948 (+  1428us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.947028 (+ 96080us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003c60a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:12.082728 (+135700us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.113352 (+ 30624us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.116510 (+  3158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.116617 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.856299 (+739682us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b18003c60a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8d42a6 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1
0709 12:22:12.881294 (+ 24995us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003c60a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:12.883130 (+  1836us) raft_consensus.cc:1685] finished
0709 12:22:12.883162 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.883377 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89178,"prepare.queue_time_us":32457,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":59,"raft.queue_time_us":29340,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":11151,"spinlock_wait_cycles":200620544,"thread_start_us":135503,"threads_started":1,"wal-append.queue_time_us":277555}
I20260709 12:22:12.911435  3996 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:12.921870  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:12.934446  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:12.936395  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:12.962549  7777 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:12.963260  7777 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:12.992599  3923 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:12.965698  7777 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:12.995539  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46046.1us
I20260709 12:22:13.004607  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.012192  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.013075  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:13.013744  3923 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.016119  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:13.016916  3922 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:13.055976  3848 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:13.069893  3848 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:13.007755  7753 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:13.075747  3922 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:13.080336  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.028558  7777 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:13.076802  7850 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.092314  7547 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.118131  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.120620  3923 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
W20260709 12:22:13.152089  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 419270us
W20260709 12:22:13.172490  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 142309us
W20260709 12:22:13.208041  7853 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:22:13.142932  7753 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.213673  7753 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:13.217336  7584 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:13.218087  7584 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:13.223067  7763 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:22:13.266012  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.158665  7777 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.172187  7850 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.226843  7584 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:13.174115  7547 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:13.305459  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:13.308245  7862 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.341732  7800 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:13.376634  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 162022us
I20260709 12:22:13.386056  7777 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:13.392573  7869 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:13.398046  7547 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:13.405030  7811 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:13.334303  7862 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.408650  7850 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.410794  7862 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.414923  7871 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:13.417680  7871 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.390053  7813 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:22:13.421196  7871 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.433336  7869 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:13.437738  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 56093.8us
W20260709 12:22:13.425644  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 421453us
I20260709 12:22:13.441453  7800 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.447950  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.462638  7670 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.468324  3962 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:13.469764  7670 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:13.470602  7670 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:13.472615  7670 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.477490  7813 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.478718  7813 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.482393  7811 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.484361  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:13.486939  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.483381  7811 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.492708  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.496443  7869 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.492331  7813 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:13.496570  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.504774  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.506465  7811 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:13.503118  7800 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.530728  3849 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:13.533646  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.542511  7800 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:13.543689  7800 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:13.544483  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.542642  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.546729  7800 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:13.559136  7670 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.564428  7772 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:13.572314  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:13.573343  3996 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:13.574163  7670 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.579713  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:13.601193  3888 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.602560  7843 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.611753  7871 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.612798  7871 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:13.581266  7670 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.615850  7750 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.616211  7871 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.616761  7750 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.620932  7750 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.626538  7750 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.627682  7750 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.638072  7652 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:13.640407  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.607128  3744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 115) took 1901 ms. Trace:
I20260709 12:22:13.641330  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.643275  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.645035  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.630728  7750 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.635914  7871 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.655115  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.649956  3744 rpcz_store.cc:276] 0709 12:22:11.705319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.705466 (+   147us) service_pool.cc:224] Handling call
0709 12:22:13.606799 (+1901333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21627,"reported_tablets":10}
I20260709 12:22:13.655301  7871 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.662609  7871 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.681212  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.682395  7753 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.682605  7670 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.683379  7670 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.686082  7670 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.686645  7869 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.687428  7869 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.688109  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.690052  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.690104  7869 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.697355  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.686714  7670 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.700124  7670 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.702605  7670 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.704244  7753 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.712332  3747 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.715365  3747 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 9 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:13.717341  3747 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:13.722878  7750 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:13.729719  3962 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.731068  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.731667  7871 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.733980  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.762408  3996 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:13.787737  7871 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.788517  7871 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.790848  7871 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.801065  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:13.803939  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:13.804687  3996 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:22:13.799817  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:13.807152  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.816365  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.818219  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.822144  7838 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:13.824712  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 215) took 3633 ms. Trace:
I20260709 12:22:13.848210  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.849397  7872 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:13.850102  7872 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.852627  7872 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:13.844074  7750 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.858691  7750 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:13.835206  7869 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:13.860162  7869 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:13.862373  7869 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:13.862914  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63821us
I20260709 12:22:13.868296  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.869132  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.870038  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.871289  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.872619  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.873351  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.874177  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.875921  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.877925  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.880213  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.890578  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.893494  3923 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:13.898236  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.898909  7763 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:13.900372  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.901728  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.846165  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.911744  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:13.825240  3746 rpcz_store.cc:276] 0709 12:22:10.191136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.236475 (+ 45339us) service_pool.cc:224] Handling call
0709 12:22:10.455812 (+219337us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:13.824468 (+3368656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:11.950181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:11.950730 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:11.950761 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:22:11.950778 (+    17us) tablet.cc:662] Decoding operations
0709 12:22:11.952943 (+  2165us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:11.953020 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:11.953049 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:22:12.030183 (+ 77134us) tablet.cc:701] Row locks acquired
0709 12:22:12.032756 (+  2573us) write_op.cc:260] PREPARE: finished
0709 12:22:12.051549 (+ 18793us) write_op.cc:270] Start()
0709 12:22:12.055651 (+  4102us) write_op.cc:276] Timestamp: P: 1783599732047608 usec, L: 0
0709 12:22:12.059261 (+  3610us) op_driver.cc:348] REPLICATION: starting
0709 12:22:12.076249 (+ 16988us) log.cc:844] Serialized 10948 byte log entry
0709 12:22:12.680362 (+604113us) op_driver.cc:464] REPLICATION: finished
0709 12:22:13.095223 (+414861us) write_op.cc:301] APPLY: starting
0709 12:22:13.097046 (+  1823us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:13.220675 (+123629us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:13.220830 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:13.405215 (+184385us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:13.405922 (+   707us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:22:13.406008 (+    86us) write_op.cc:312] APPLY: finished
0709 12:22:13.440781 (+ 34773us) log.cc:844] Serialized 188 byte log entry
0709 12:22:13.449612 (+  8831us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:13.450860 (+  1248us) write_op.cc:454] Released schema lock
0709 12:22:13.450991 (+   131us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:13.451979 (+   988us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:13.452020 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14691,"reported_tablets":40,"spinlock_wait_cycles":279402112,"child_traces":[["op",{"apply.queue_time_us":377171,"apply.run_cpu_time_us":11947,"apply.run_wall_time_us":372434,"num_ops":28,"prepare.queue_time_us":96217,"prepare.run_cpu_time_us":7211,"prepare.run_wall_time_us":133207,"replication_time_us":593058,"thread_start_us":261314,"threads_started":2}]]}
I20260709 12:22:13.919750  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:13.925249  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:13.934978  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:13.979758  7763 tablet_bootstrap.cc:492] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:13.968648  3747 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.022452  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:14.023373  3850 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:14.028338  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:14.029135  3843 raft_consensus.cc:606] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:14.022805  3747 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 6, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:14.094072  7750 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:14.096185  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:14.099939  7636 raft_consensus.cc:993] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:14.100754  7811 raft_consensus.cc:1081] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
W20260709 12:22:14.115883  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 136429us
I20260709 12:22:14.079944  7763 ts_tablet_manager.cc:1403] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.857s	user 0.041s	sys 0.012s
I20260709 12:22:14.141642  3844 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:14.121129  3747 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.155884  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.164913  7861 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:22:14.177038  7843 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:14.177592  7843 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:14.178035  7843 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:14.179739  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 106813us
I20260709 12:22:14.161785  3747 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:14.208953  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:14.209647  3843 raft_consensus.cc:606] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:14.211789  3920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:14.186818  7763 raft_consensus.cc:359] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:14.237577  7763 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:14.239192  7763 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:14.243891  7763 ts_tablet_manager.cc:1434] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:22:14.248297  3920 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:14.276119  3920 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.203953  3747 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:14.285681  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 127631us
I20260709 12:22:14.324349  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c9cb9cc431d048dd8cfea736da6af5fa received from {username='slave'} at 127.0.0.1:46046
I20260709 12:22:14.325028  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c9cb9cc431d048dd8cfea736da6af5fa on tablet c9cb9cc431d048dd8cfea736da6af5fa with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:14.326087  7843 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.332168  3918 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:14.339040  3920 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.397007  7843 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:14.482709  3920 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:14.749692  7897 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:14.751219  7897 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:14.755609  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56957.5us
I20260709 12:22:14.755934  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:14.773943  3843 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:14.774251  3843 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:14.771389  7897 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:14.774613  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:14.776012  3847 raft_consensus.cc:606] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:14.776360  3847 raft_consensus.cc:614] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:14.766842  7838 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:14.777391  7838 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.753870  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:14.765126  7750 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:14.782301  7750 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.784346  7869 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:14.784853  7750 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:14.785033  7869 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:14.786389  7750 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:14.775091  3843 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.765607  7806 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:14.787918  7806 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.788465  7869 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:14.790378  7806 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:14.791273  3843 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.793830  7838 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:14.794529  7838 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.794777  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:14.795050  7838 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.795436  3849 raft_consensus.cc:606] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:14.795795  3849 raft_consensus.cc:614] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:14.797169  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:14.800457  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:14.802824  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.804093  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.805330  7838 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:14.825136  7869 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:14.826058  7869 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:14.787019  7750 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:14.849320  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.854015  3842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.015s	sys 0.033s
W20260709 12:22:14.854454  3842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.016s	sys 0.033s
I20260709 12:22:14.868395  7869 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:14.873274  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:14.877383  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 154053us
I20260709 12:22:14.881412  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:14.882987  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.883100  7869 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:14.884071  7891 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.884783  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.885768  7891 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:14.886652  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.887643  7891 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:14.889496  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.892046  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:14.920794  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:15.045658  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 124989us
I20260709 12:22:15.046581  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.051929  7750 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.050834  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.047263  7869 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:15.054651  7728 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:15.055280  7728 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.057442  7728 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.060377  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.065826  3843 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:15.015911  7891 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:15.072543  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 309459us
I20260709 12:22:15.077651  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.069339  7750 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.068970  7869 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.079258  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.081445  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.083048  7750 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.075605  7772 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:22:15.084568  7636 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:15.084928  7636 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:15.086134  7892 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:15.085799  7636 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.087177  7636 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:15.081813  7869 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.091972  7869 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.079005  7891 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.104465  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.099244  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.109099  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.110476  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:15.112603  7890 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:15.113179  7890 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:15.114018  7890 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.116927  4581 raft_consensus.cc:1217] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 12:22:15.128593  7729 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.129652  7729 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.140869  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.142544  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.145867  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.144905  7869 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.149407  7872 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:15.145077  7861 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:15.150396  7871 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.144989  7729 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.164836  7905 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:22:15.166746  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.175120  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.179582  7636 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:15.228888  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.233508  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:15.237222  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.241539  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:15.251847  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.254506  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.257584  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.244756  7842 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:15.246556  7813 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:15.265107  3925 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:15.267130  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 84039.6us
I20260709 12:22:15.264572  7813 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.249634  7652 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.275681  7842 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.275381  7813 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:15.289510  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.290503  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:15.278105  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80608.3us
I20260709 12:22:15.292140  7905 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.292809  7905 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.278573  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.283735  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.283964  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.288062  7842 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.305205  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.319351  7905 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.326757  7909 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:15.327656  7909 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.330765  7909 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:15.333768  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 69045.6us
W20260709 12:22:15.337242  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84567.9us
I20260709 12:22:15.339838  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.342866  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.350965  7871 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.351702  7871 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.354200  7871 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.356015  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.356153  3744 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 9 to 10, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:15.361454  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68353.8us
W20260709 12:22:15.346895  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.727s (SENT) [suppressed 30 similar messages]
I20260709 12:22:15.380764  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.395951  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.399032  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:15.405323  3990 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.405421  7795 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:15.405975  7795 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.374991  7729 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:15.411836  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65356us
I20260709 12:22:15.436971  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:15.437649  3996 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:15.408454  7813 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.408422  7795 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.446852  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.449278  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:15.450814  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103953us
I20260709 12:22:15.451076  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.409840  7729 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.441442  7891 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.441202  7861 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.442111  7905 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.443194  7750 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.463400  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.465168  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.466632  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.448479  7909 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.480844  7909 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.483027  7909 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.483511  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.486943  7813 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.457350  7891 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.489439  7891 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.448655  7892 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.491818  7892 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.466506  7750 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.466632  7670 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.477346  7800 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:15.477913  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.479315  7729 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:15.497763  3990 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:15.452672  7871 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:15.463351  7861 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.501428  7869 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:15.464500  7905 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.504011  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.519400  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.510878  3996 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:15.515327  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.525058  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:15.527259  7869 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.527885  7914 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.529632  7869 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.529815  7750 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.530516  7871 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.532791  7871 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.533547  7905 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.538417  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.540499  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:15.542348  7888 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.544500  7905 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:15.548092  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.517553  7843 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.550695  7905 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.551805  7890 raft_consensus.cc:1064] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:15.553000  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.554291  7905 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.556169  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:15.557354  7905 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.559319  7892 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.561075  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.562345  7905 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.562564  7861 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.564081  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.518431  7800 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:15.565023  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08000cac20 after lost signal to thread 2680
I20260709 12:22:15.565407  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.565798  7905 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.566404  7800 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.566601  7905 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.567800  7800 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:15.568439  7800 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:15.569321  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 113452us
I20260709 12:22:15.515895  7670 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.566624  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:15.566174  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4480 after lost signal to thread 3782
I20260709 12:22:15.572319  7861 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.573138  7670 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:15.573526  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08001788e0 after lost signal to thread 3874
W20260709 12:22:15.573895  4020 debug-util.cc:398] Leaking SignalData structure 0x7b0800172060 after lost signal to thread 3875
I20260709 12:22:15.574777  7800 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:15.575137  4020 debug-util.cc:398] Leaking SignalData structure 0x7b080024f600 after lost signal to thread 3949
I20260709 12:22:15.576606  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.576956  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.578627  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:15.580940  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0760 after lost signal to thread 3950
I20260709 12:22:15.581377  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:15.583149  4020 debug-util.cc:398] Leaking SignalData structure 0x7b0800359da0 after lost signal to thread 4023
W20260709 12:22:15.583756  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08000f3760 after lost signal to thread 4024
I20260709 12:22:15.587406  7871 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:15.582175  3999 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
W20260709 12:22:15.595008  4020 debug-util.cc:398] Leaking SignalData structure 0x7b080030b7a0 after lost signal to thread 4608
W20260709 12:22:15.593194  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 138275us
I20260709 12:22:15.592381  7911 raft_consensus.cc:993] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:22:15.595412  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfca0 after lost signal to thread 4609
I20260709 12:22:15.597577  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.602525  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.606017  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.610108  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.609637  7652 raft_consensus.cc:1081] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:15.612308  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.615178  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.614704  7890 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.628175  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.632720  3744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 116) took 1958 ms. Trace:
I20260709 12:22:15.637126  3745 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.633193  3744 rpcz_store.cc:276] 0709 12:22:13.674084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.679807 (+  5723us) service_pool.cc:224] Handling call
0709 12:22:15.632649 (+1952842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:15.392543 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:15.464202 (+ 71659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:15.466681 (+  2479us) write_op.cc:435] Acquired schema lock
0709 12:22:15.483488 (+ 16807us) tablet.cc:662] Decoding operations
0709 12:22:15.483908 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:15.483962 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:15.483992 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:15.484182 (+   190us) tablet.cc:701] Row locks acquired
0709 12:22:15.484199 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:22:15.484346 (+   147us) write_op.cc:270] Start()
0709 12:22:15.484484 (+   138us) write_op.cc:276] Timestamp: P: 1783599735484300 usec, L: 0
0709 12:22:15.484513 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:22:15.485108 (+   595us) log.cc:844] Serialized 533 byte log entry
0709 12:22:15.487849 (+  2741us) op_driver.cc:464] REPLICATION: finished
0709 12:22:15.488413 (+   564us) write_op.cc:301] APPLY: starting
0709 12:22:15.488500 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:15.488607 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:15.488704 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:15.488943 (+   239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:15.489119 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:15.489160 (+    41us) write_op.cc:312] APPLY: finished
0709 12:22:15.489346 (+   186us) log.cc:844] Serialized 23 byte log entry
0709 12:22:15.489517 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.489602 (+    85us) write_op.cc:454] Released schema lock
0709 12:22:15.489639 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:15.490014 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.490039 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167403,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":290,"apply.run_cpu_time_us":1545,"apply.run_wall_time_us":1546,"num_ops":1,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":3061,"prepare.run_wall_time_us":97719,"replication_time_us":3193}]]}
I20260709 12:22:15.653643  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.656255  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:15.657851  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.656497  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 192) took 4533 ms. Trace:
I20260709 12:22:15.664702  7906 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:15.663810  3747 rpcz_store.cc:276] 0709 12:22:11.122960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.123187 (+   227us) service_pool.cc:224] Handling call
0709 12:22:15.655871 (+4532684us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b24003c8d08. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc4fa9e970 00007fdc4faaba8f 00007fdc588b0ae4 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc
0709 12:22:15.656399 (+   528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:14.806417 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:14.807051 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:14.807108 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:22:14.807133 (+    25us) tablet.cc:662] Decoding operations
0709 12:22:14.808360 (+  1227us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:14.808460 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:14.808494 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:22:14.809285 (+   791us) tablet.cc:701] Row locks acquired
0709 12:22:14.809344 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:22:14.809536 (+   192us) write_op.cc:270] Start()
0709 12:22:14.809681 (+   145us) write_op.cc:276] Timestamp: P: 1783599734809463 usec, L: 0
0709 12:22:14.809697 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:22:14.810436 (+   739us) log.cc:844] Serialized 3671 byte log entry
0709 12:22:15.052024 (+241588us) op_driver.cc:464] REPLICATION: finished
0709 12:22:15.134202 (+ 82178us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc4f8e90ac 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc56429ef0
0709 12:22:15.319348 (+185146us) write_op.cc:301] APPLY: starting
0709 12:22:15.319494 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:15.319773 (+   279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:15.319808 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:15.320886 (+  1078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:15.321132 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:22:15.321185 (+    53us) write_op.cc:312] APPLY: finished
0709 12:22:15.321507 (+   322us) log.cc:844] Serialized 71 byte log entry
0709 12:22:15.321709 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.321845 (+   136us) write_op.cc:454] Released schema lock
0709 12:22:15.321897 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:15.324510 (+  2613us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.324597 (+    87us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34029,"reported_tablets":39,"spinlock_wait_cycles":16231680,"child_traces":[["op",{"apply.queue_time_us":267004,"apply.run_cpu_time_us":2977,"apply.run_wall_time_us":5122,"num_ops":9,"prepare.queue_time_us":22943,"prepare.run_cpu_time_us":13935,"prepare.run_wall_time_us":60627,"raft.queue_time_us":186572,"raft.run_cpu_time_us":35533,"raft.run_wall_time_us":196774,"replication_time_us":242139,"spinlock_wait_cycles":21388544,"thread_start_us":409165,"threads_started":4,"wal-append.queue_time_us":53122}]]}
I20260709 12:22:15.672643  3849 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:15.674502  7728 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:15.677099  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.678654  7904 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:15.680243  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:15.680881  3992 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:15.680572  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.693816  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.698230  7843 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:15.704458  7843 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:15.705442  3995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:15.706046  3995 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.706408  3995 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.697191  7728 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:15.714025  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.722764  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.725703  3992 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:15.728413  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.730262  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.732249  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:15.732604  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.733908  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.734051  7805 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.734737  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.735924  7897 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.734859  7805 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.705437  7843 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.742457  3995 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.743784  3998 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:15.735121  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.756629  3995 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:15.764037  7855 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:15.764571  7855 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:15.764953  7855 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.769016  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:15.769708  3845 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:15.770002  3845 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:15.771413  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.771977  3845 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.773633  3845 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.775204  7918 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:15.777100  3847 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:15.799023  3845 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:15.800119  7918 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.771061  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:15.803408  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.810465  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.811689  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.816421  7872 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:15.816946  7861 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.818219  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.818912  7861 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.821158  7917 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:15.821555  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:15.822988  7906 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:15.828004  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49414.8us
I20260709 12:22:15.829376  7887 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:15.832602  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.833581  3846 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:15.835197  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:15.840229  4575 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:15.842381  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.843770  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.844918  7652 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:15.847299  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.852766  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.853921  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.858445  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.858654  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:15.859225  3917 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:15.853799  7729 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:22:15.860803  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:15.861786  7898 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:15.862190  7898 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:15.863330  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.865859  7813 raft_consensus.cc:993] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:15.866420  7813 raft_consensus.cc:1081] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:15.867298  7652 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:15.868412  7652 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.868867  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:15.880333  7728 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:15.842710  7906 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:15.856037  3746 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:15.895817  3992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:15.896498  3992 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.889424  3746 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 14, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.897594  3992 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:15.900997  7906 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:15.903975  7918 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.908921  3992 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.919854  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 200) took 10670 ms. Trace:
I20260709 12:22:15.918000  3746 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:15.922907  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:15.923979  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:15.924348  3845 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:15.924717  3845 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:15.938803  3992 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:15.942346  3845 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:15.939877  3746 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:15.944835  3746 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:15.952247  3746 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:15.955823  3746 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 9, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.959371  3845 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:15.921037  3745 rpcz_store.cc:276] 0709 12:22:05.303637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.319919 (+ 16282us) service_pool.cc:224] Handling call
0709 12:22:15.911708 (+10591789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:15.761073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:15.761602 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:15.761635 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:22:15.761648 (+    13us) tablet.cc:662] Decoding operations
0709 12:22:15.761992 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:15.762049 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:15.762078 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:15.762263 (+   185us) tablet.cc:701] Row locks acquired
0709 12:22:15.762281 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:22:15.762407 (+   126us) write_op.cc:270] Start()
0709 12:22:15.762517 (+   110us) write_op.cc:276] Timestamp: P: 1783599735762366 usec, L: 0
0709 12:22:15.762537 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:15.763164 (+   627us) log.cc:844] Serialized 538 byte log entry
0709 12:22:15.770410 (+  7246us) op_driver.cc:464] REPLICATION: finished
0709 12:22:15.774737 (+  4327us) write_op.cc:301] APPLY: starting
0709 12:22:15.774830 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:15.774932 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:15.775029 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:15.775253 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:15.775418 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:15.775556 (+   138us) write_op.cc:312] APPLY: finished
0709 12:22:15.775766 (+   210us) log.cc:844] Serialized 23 byte log entry
0709 12:22:15.783808 (+  8042us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.783900 (+    92us) write_op.cc:454] Released schema lock
0709 12:22:15.783939 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:15.784301 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:15.784337 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31024,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":2958,"apply.run_cpu_time_us":1706,"apply.run_wall_time_us":9528,"num_ops":1,"prepare.queue_time_us":1965,"prepare.run_cpu_time_us":2430,"prepare.run_wall_time_us":2740,"replication_time_us":3444}]]}
I20260709 12:22:15.965356  3746 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:15.974907  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:15.975687  4583 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:15.982995  7925 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:16.014416  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:15.909262  7898 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:16.023109  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.037955  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.039770  3917 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:16.041092  3916 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:16.040840  3845 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:16.042984  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.050045  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.050186  4583 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:16.056149  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:16.057374  7927 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:16.060026  7917 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:16.062466  7898 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:16.031520  7918 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:16.068531  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.070551  3889 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.075260  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.077476  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:16.083603  7905 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:16.084254  7905 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:16.084707  7918 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:16.085263  7905 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:16.069960  7933 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:16.076380  7890 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:16.096990  7871 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:16.098024  7855 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:16.102886  4574 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:16.097039  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.106081  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:16.106295  7861 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.115262  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:16.119282  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:16.120493  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47073.4us
I20260709 12:22:16.126211  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:16.120175  7861 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:16.116904  7728 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:16.115933  7855 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:16.131750  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.136385  7917 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:16.117304  7932 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:16.125650  7871 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:16.139078  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:16.146865  7861 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:16.153829  3992 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:16.155997  3992 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:16.123468  7911 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:22:16.159224  7911 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:16.159713  7911 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:16.162024  7911 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:16.163678  7911 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:16.200062  7936 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:16.205072  7728 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:16.208657  4574 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:16.234150  7729 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:16.234006  7838 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:16.249166  3846 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:16.252724  3845 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:16.246073  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 216) took 2016 ms. Trace:
I20260709 12:22:16.254426  3746 rpcz_store.cc:276] 0709 12:22:14.229941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.230103 (+   162us) service_pool.cc:224] Handling call
0709 12:22:16.245989 (+2015886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:16.081938 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:16.082531 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:16.082573 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:22:16.082593 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:16.102904 (+ 20311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:16.102978 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:16.103006 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:16.103694 (+   688us) tablet.cc:701] Row locks acquired
0709 12:22:16.103708 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:22:16.103846 (+   138us) write_op.cc:270] Start()
0709 12:22:16.104012 (+   166us) write_op.cc:276] Timestamp: P: 1783599736103805 usec, L: 0
0709 12:22:16.104033 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:22:16.139576 (+ 35543us) log.cc:844] Serialized 3230 byte log entry
0709 12:22:16.183103 (+ 43527us) op_driver.cc:464] REPLICATION: finished
0709 12:22:16.183527 (+   424us) write_op.cc:301] APPLY: starting
0709 12:22:16.183630 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:16.183864 (+   234us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:16.183983 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:16.185021 (+  1038us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:16.185236 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:16.185287 (+    51us) write_op.cc:312] APPLY: finished
0709 12:22:16.185617 (+   330us) log.cc:844] Serialized 65 byte log entry
0709 12:22:16.185814 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.185954 (+   140us) write_op.cc:454] Released schema lock
0709 12:22:16.186019 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:16.186414 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.186446 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32947,"reported_tablets":25,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":2845,"apply.run_wall_time_us":2845,"num_ops":8,"prepare.queue_time_us":1338,"prepare.run_cpu_time_us":4259,"prepare.run_wall_time_us":88915,"replication_time_us":78862}]]}
I20260709 12:22:16.250849  3745 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:16.261482  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:16.265513  7838 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:22:16.289836  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:16.291115  7855 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.304976  3746 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 6 to 7, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:16.261094  3745 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.314138  3999 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:16.336975  3998 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:16.344365  7898 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:16.365804  3744 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 12 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.368207  3999 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:16.376111  7911 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:16.379761  3744 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 11, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.403407  3849 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:16.405233  7872 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:16.495887  3747 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.523193  3919 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:16.524161  3916 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:16.534759  3849 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:16.542832  7652 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.549190  7872 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:16.557488  7905 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:22:16.562083  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 95575.7us
I20260709 12:22:16.652776  4574 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:16.622187  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.672082  7905 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 12:22:16.953269  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 273680us
I20260709 12:22:17.071607  3924 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:17.084380  4574 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:17.086419  7924 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:17.114988  3841 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:22:17.138056  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65387.9us
I20260709 12:22:17.204270  7924 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:17.238031  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77466.9us
W20260709 12:22:17.319700  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72407us
W20260709 12:22:17.366439  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 109995us
W20260709 12:22:17.373823  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103964us
W20260709 12:22:17.420673  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 166833us
I20260709 12:22:17.425938  7961 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:17.444057  7961 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:17.446676  7961 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:17.474893  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:17.475864  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 106599us
I20260709 12:22:17.479066  7970 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.495115  3737 maintenance_manager.cc:419] P 8bd543252a59424d81c6f755d59f4ddf: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033383
W20260709 12:22:17.516427  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.523393  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 153794us
W20260709 12:22:17.535771  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 108887us
W20260709 12:22:17.551038  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57199.2us
I20260709 12:22:17.534940  7970 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:17.601728  3849 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:17.621414  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:17.629153  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 86933.6us
I20260709 12:22:17.630676  4575 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:22:17.710170  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50052.3us
I20260709 12:22:17.670197  7890 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:17.809298  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:17.810547  4575 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:17.800004  7970 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:17.811729  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:17.822019  4575 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:17.827540  3845 raft_consensus.cc:2955] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:17.839545  7978 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:17.840022  7978 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.840371  7978 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.849711  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:17.856740  3998 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
W20260709 12:22:17.860983  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47855.4us
I20260709 12:22:17.882290  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:17.908311  7800 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:17.922281  7800 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:17.922727  7800 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:17.924533  3746 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 7 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:17.938478  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 62429.3us
W20260709 12:22:17.939846  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56435.3us
I20260709 12:22:17.965690  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9cb9cc431d048dd8cfea736da6af5fa with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:17.998400  7800 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:18.005383  7978 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:18.017596  7978 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:18.018317  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:18.021224  4575 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.008642  7800 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:18.034279  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:18.034693  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:18.035244  3999 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.042225  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:18.042903  3923 raft_consensus.cc:606] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:18.045360  4574 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:18.052585  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:18.053143  3923 raft_consensus.cc:606] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:18.059152  4575 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:18.060084  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:18.059544  3999 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:18.063416  3849 raft_consensus.cc:2368] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:18.065483  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:18.067638  7983 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.068230  7983 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:18.084757  3962 leader_election.cc:400] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:18.085162  3962 leader_election.cc:403] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:22:18.091785  7983 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:18.098296  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:18.098958  3923 raft_consensus.cc:606] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:18.102715  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:18.103302  3923 raft_consensus.cc:606] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:18.120666  7924 raft_consensus.cc:993] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:18.121258  7924 raft_consensus.cc:1081] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:18.112821  7670 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:18.125653  3916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:18.126320  3916 raft_consensus.cc:606] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:18.134066  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:18.135051  3916 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:18.136157  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.139046  3843 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:18.146713  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:22:18.147336  3999 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.147730  3999 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:18.143239  7916 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:22:18.149580  7933 raft_consensus.cc:993] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.150101  7933 raft_consensus.cc:1081] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.152719  7999 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:18.162601  3843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:18.163271  3843 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.163686  3843 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.173112  3999 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.186509  3843 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.198424  3999 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:18.200706  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:18.203671  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.205147  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:18.205432  3843 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:18.205751  3923 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:18.206111  3923 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:18.206661  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:18.207239  3921 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:18.206117  3849 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:18.207839  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:18.208483  3999 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.207213  3923 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.217448  3923 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.207737  3921 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:18.220293  3921 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.231521  3921 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:18.247517  7933 raft_consensus.cc:993] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.248085  7933 raft_consensus.cc:1081] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.252568  3841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:18.253456  3841 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.253897  3841 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.270511  3923 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:18.272069  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:18.272045  3849 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:18.274600  3962 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:18.275564  7670 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:18.276088  7670 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:18.276805  7728 raft_consensus.cc:993] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:18.277550  7997 raft_consensus.cc:1081] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:18.277064  7670 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.286361  3999 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:18.289186  3992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:22:18.289911  3992 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.290275  3992 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.295818  7811 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:18.296469  7811 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:18.300948  3992 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.310039  3921 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:18.314088  3841 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.322808  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:18.323552  3843 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.341185  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:18.341938  3922 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:18.342283  3922 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:18.344311  3843 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:18.345911  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:18.343611  3922 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.350958  3992 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:18.354743  3922 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.363992  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:18.364821  3921 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:18.365211  3921 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:18.352373  7961 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:18.371762  3921 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.373476  3841 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:18.312536  7811 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.375684  3921 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.390697  7961 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:18.404356  7961 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.424332  3921 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:18.429900  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:18.430773  3992 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.481096  3746 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 8, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.492973  3992 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:18.496613  3916 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:18.464761  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet c9cb9cc431d048dd8cfea736da6af5fa with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:52848
I20260709 12:22:18.518887  3922 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:18.521366  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:18.531106  4574 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:18.527565  7811 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:18.536067  7811 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:18.539232  7811 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:18.546998  7959 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:18.547385  7995 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:18.615346  3843 raft_consensus.cc:2955] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 5 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:18.651331  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48825.5us
I20260709 12:22:18.599726  7967 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:18.728246  8015 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:22:18.668761  7967 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:18.765789  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 66980.9us
W20260709 12:22:18.768695  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 74480.6us
W20260709 12:22:18.774155  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 95725.4us
I20260709 12:22:18.768527  3747 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:18.786880  8011 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:22:18.783705  3747 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.840775  3998 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:22:18.830498  8014 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:22:18.841617  8016 tablet_replica.cc:333] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:22:18.895758  7890 raft_consensus.cc:993] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.896553  7967 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:18.943122  7998 raft_consensus.cc:1081] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:18.984331  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3bacd87db564c3ba5256af726514f84 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 12:22:19.005586  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74650.3us
I20260709 12:22:19.019582  8016 raft_consensus.cc:2243] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.018968  3745 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 5 to 8, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:19.020612  8016 raft_consensus.cc:2272] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.025563  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:19.032219  3924 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:19.034945  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:19.046497  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:22:19.048448  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 201508us
I20260709 12:22:19.054069  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:19.054704  3845 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.055106  3845 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.070017  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:19.078419  3964 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:19.078765  8016 ts_tablet_manager.cc:1916] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:19.080765  3844 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:19.083396  3841 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:19.106276  3845 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:19.116550  3845 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:19.114331  3964 raft_consensus.cc:2686] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:22:19.126312  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47991.7us
W20260709 12:22:19.124785  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52611.9us
I20260709 12:22:19.152274  7970 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:22:19.153777  7965 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:19.125161  8031 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:22:19.163991  8006 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:22:19.186511  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:19.187247  3916 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:19.187700  3916 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:19.196247  3916 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:19.199306  3916 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:19.204952  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 77787.4us
I20260709 12:22:19.217032  3916 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:22:19.216226  7992 consensus_queue.cc:1175] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
W20260709 12:22:19.235960  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 108098us
I20260709 12:22:19.237907  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:19.243407  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 178970us
I20260709 12:22:19.246860  7800 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:22:19.253822  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 125433us
I20260709 12:22:19.263214  7967 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:19.245450  7978 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:19.276260  7978 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:19.277289  7978 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:19.293685  3916 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:19.299075  3992 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:19.302886  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:19.303542  3992 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.304623  8017 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:19.319077  3916 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:19.327211  3999 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:19.351063  3992 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:19.350841  3747 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 10 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.364748  8026 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:22:19.344825  7979 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:22:19.371886  8017 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:22:19.461125  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.519070  8016 ts_tablet_manager.cc:1929] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 12:22:19.519707  8016 log.cc:1199] T c9cb9cc431d048dd8cfea736da6af5fa P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/c9cb9cc431d048dd8cfea736da6af5fa
I20260709 12:22:19.595342  7961 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:19.596225  7961 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:19.603696  8016 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52848 (request call id 77) took 1193 ms. Trace:
I20260709 12:22:19.619896  8016 rpcz_store.cc:276] 0709 12:22:18.407381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.421805 (+ 14424us) service_pool.cc:224] Handling call
0709 12:22:18.776698 (+354893us) ts_tablet_manager.cc:1151] Deleting tablet c9cb9cc431d048dd8cfea736da6af5fa
0709 12:22:18.810229 (+ 33531us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:19.357927 (+547698us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:19.518896 (+160969us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:19.599985 (+ 81089us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123119,"tablet-delete.queue_time_us":191131,"thread_start_us":155651,"threads_started":1}
I20260709 12:22:19.694754  7961 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:19.698884  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:19.707057  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:19.720193  3746 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:19.629966  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet c9cb9cc431d048dd8cfea736da6af5fa (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:22:19.732672  3964 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:19.733806  3923 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:19.739246  7961 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:19.740330  3733 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 110487us
I20260709 12:22:19.774130  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:19.752488  8042 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:22:19.792438  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:19.793169  3996 raft_consensus.cc:606] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:19.797884  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet f3bacd87db564c3ba5256af726514f84 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:52848
I20260709 12:22:19.798982  8016 tablet_replica.cc:333] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:22:19.834321  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:19.835134  3920 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:19.838625  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:19.839260  3920 raft_consensus.cc:606] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:19.839629  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 43513.5us
I20260709 12:22:19.861631  8016 raft_consensus.cc:2243] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:19.862716  8016 raft_consensus.cc:2272] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:19.870618  8016 ts_tablet_manager.cc:1916] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:19.901645  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:19.902092  8027 raft_consensus.cc:993] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:19.941663  8027 raft_consensus.cc:1081] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:19.890854  3746 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:19.946115  3990 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:19.947669  7933 raft_consensus.cc:993] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:19.948186  8022 raft_consensus.cc:1081] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:19.951936  3920 raft_consensus.cc:606] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:19.956137  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:19.956789  3924 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:19.958199  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:19.968566  3843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:19.969226  3843 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.969610  3843 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.975526  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:19.976445  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.978081  8041 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:19.989216  3843 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.003924  8016 ts_tablet_manager.cc:1929] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 12:22:20.004033  3920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:22:20.004804  3920 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.005198  3920 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.007920  8016 log.cc:1199] T f3bacd87db564c3ba5256af726514f84 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/f3bacd87db564c3ba5256af726514f84
I20260709 12:22:20.014217  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:20.014874  3916 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:20.015192  3916 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:20.016064  3916 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.020941  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet f3bacd87db564c3ba5256af726514f84 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:22:20.022089  3920 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.023558  3843 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:20.024294  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:20.031905  3995 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:20.024300  3920 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:20.027351  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:20.035915  3845 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.035987  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:20.036825  3992 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:20.037216  3992 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:20.028083  3916 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:20.038152  3992 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.040223  3992 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.044649  3845 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:20.045667  3916 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:20.046968  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:20.047946  8041 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:20.048501  8041 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:20.049410  8041 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.058274  3888 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:20.059405  7838 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:20.059994  7838 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:20.060940  7838 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.081933  3995 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:20.083714  3992 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:20.102370  3744 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.166880  3746 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.230791  7997 raft_consensus.cc:993] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.231328  7997 raft_consensus.cc:1081] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.248785  3843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:20.249456  3843 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.249883  3843 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.254328  7997 raft_consensus.cc:993] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.254855  7977 raft_consensus.cc:1081] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.256155  3920 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:20.262110  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:20.262737  3845 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.263083  3845 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.272950  3845 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.272850  3843 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.275785  3843 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:20.276701  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:20.277174  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:20.277318  3992 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.277755  3922 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:20.278124  3922 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:20.278476  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:20.279023  3995 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.278911  3922 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.280121  3922 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:20.282579  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:20.283249  3916 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:20.283552  3916 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:20.287832  3916 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.289743  3916 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:20.290699  3995 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:20.291625  3845 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:20.291810  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:20.292673  8044 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:20.293280  8044 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:20.287812  3992 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:20.294634  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:20.294359  8044 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.295627  8017 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:20.296294  8017 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:20.297255  8017 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.302919  3916 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:20.318526  3922 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:20.335913  7977 raft_consensus.cc:993] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.336606  7977 raft_consensus.cc:1081] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:20.338620  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:20.339249  3845 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.339663  3845 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.350620  3746 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.363798  3845 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:20.369875  3890 consensus_peers.cc:597] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99966b4924ae49f889200899350931bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.370114  3845 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:20.370673  3992 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:20.372227  7977 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:20.372687  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:20.373335  3992 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.373490  3845 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:20.376035  7977 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:20.397109  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:20.397754  3922 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:20.409255  3746 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.398088  3922 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:20.417323  3922 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.418802  3922 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:20.415041  3992 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:20.422906  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:20.424661  8042 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:20.425812  8042 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:20.428530  8042 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:20.432642  3922 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:20.453215  7997 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:20.457617  3995 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:20.456410  3841 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:20.482545  3736 maintenance_manager.cc:643] P 8bd543252a59424d81c6f755d59f4ddf: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.928s	user 0.196s	sys 0.034s Metrics: {"bytes_written":30037,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":106973,"dirs.run_cpu_time_us":452,"dirs.run_wall_time_us":2132,"drs_written":1,"lbm_read_time_us":439,"lbm_reads_lt_1ms":4,"lbm_write_time_us":31196,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":75392,"threads_started":1,"update_count":10}
I20260709 12:22:20.495458  3746 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.512032  3737 maintenance_manager.cc:419] P 8bd543252a59424d81c6f755d59f4ddf: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10369 bytes on disk
I20260709 12:22:20.511113  3744 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:20.525144  3736 maintenance_manager.cc:643] P 8bd543252a59424d81c6f755d59f4ddf: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.009s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":365,"lbm_reads_lt_1ms":4}
I20260709 12:22:20.530009  3841 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:20.554800  3990 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:20.566009  8017 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:20.639827  3920 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:20.641425  8017 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:20.647233  3844 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:20.650928  7898 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:20.670002  3995 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:22:20.678519  3815 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a29f44dfd3d24dccaa224167c983a5a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:20.697333  3995 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:20.701148  7997 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:22:20.702518  7811 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:22:20.735167  3922 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:20.737236  3916 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:20.752733  8041 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:22:20.768277  8085 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:22:20.825806  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 84250.5us
W20260709 12:22:20.844343  8080 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:22:21.001235  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 296501us
I20260709 12:22:21.008354  3992 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:21.081159  8094 ts_tablet_manager.cc:933] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:21.116377  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 86689.9us
W20260709 12:22:21.130086  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89070.8us
I20260709 12:22:21.137130  3992 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:21.193373  8094 tablet_copy_client.cc:323] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
W20260709 12:22:21.194069  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65413.1us
I20260709 12:22:21.209777  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.210175  3924 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:22:21.220419  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 190455us
W20260709 12:22:21.224702  8098 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:22:21.234259  3923 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:21.238813  8017 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:21.244391  8041 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:21.329468  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56790.8us
W20260709 12:22:21.329545  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53358.1us
W20260709 12:22:21.339430  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 218738us
I20260709 12:22:21.365397  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:21.366110  3841 raft_consensus.cc:606] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:21.345674  8103 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:21.379859  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 99966b4924ae49f889200899350931bb from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:22:21.403064  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 99966b4924ae49f889200899350931bb from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-99966b4924ae49f889200899350931bb
I20260709 12:22:21.417543  3995 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:21.412490  8029 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:21.415788  3924 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:21.389094  8085 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:21.433969  3843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:21.434612  3843 raft_consensus.cc:606] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:21.484274  3995 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:21.486882  3934 tablet_copy_source_session.cc:215] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:22:21.492307  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49080us
I20260709 12:22:21.500029  8017 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:22:21.492017  8124 ts_tablet_manager.cc:933] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
W20260709 12:22:21.524783  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 87652.4us
I20260709 12:22:21.525493  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:21.526921  3844 raft_consensus.cc:606] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:21.581176  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 97298.6us
W20260709 12:22:21.586961  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 179813us
I20260709 12:22:21.610334  8124 tablet_copy_client.cc:323] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:22:21.611039  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99966b4924ae49f889200899350931bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:21.612074  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:21.632274  3746 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 10, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:22:21.649895  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59084.3us
I20260709 12:22:21.671147  3844 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:21.674448  8042 raft_consensus.cc:993] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:21.674985  8042 raft_consensus.cc:1081] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:21.676203  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet a29f44dfd3d24dccaa224167c983a5a4 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:22:21.677057  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet a29f44dfd3d24dccaa224167c983a5a4 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-a29f44dfd3d24dccaa224167c983a5a4
I20260709 12:22:21.680992  3923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:21.681782  3923 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.682255  3923 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.713436  3923 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:21.716545  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:21.718595  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:21.720299  8091 raft_consensus.cc:993] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:21.720868  8097 raft_consensus.cc:1081] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:21.723567  3921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:21.724148  3921 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:21.724586  3921 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.727806  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:21.728418  3844 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:21.728603  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:21.728511  3923 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:21.728775  3844 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:21.729311  3998 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.729779  3844 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:21.730906  3844 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.738844  8029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36248 (request call id 11) took 1214 ms. Trace:
I20260709 12:22:21.744885  3998 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:21.739480  8029 rpcz_store.cc:276] 0709 12:22:20.524820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.528278 (+  3458us) service_pool.cc:224] Handling call
0709 12:22:20.635391 (+107113us) log.cc:844] Serialized 499 byte log entry
0709 12:22:21.738737 (+1103346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18010,"raft.run_cpu_time_us":2016,"raft.run_wall_time_us":27872,"thread_start_us":25761,"threads_started":1,"wal-append.queue_time_us":5387,"wal-append.run_cpu_time_us":1555,"wal-append.run_wall_time_us":1007326}
I20260709 12:22:21.746393  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:22:21.843762  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 97497.2us
I20260709 12:22:21.747104  3921 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:21.844802  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77915.7us
I20260709 12:22:21.849802  3921 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:21.851806  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:21.852664  3998 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.870151  3998 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:21.874276  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.850312  7997 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:21.880039  8137 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:22:21.911026  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:21.919234  8107 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:21.918629  7997 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:21.949076  8107 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:21.949956  7997 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:21.950207  8107 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:21.950922  3860 tablet_copy_source_session.cc:215] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:21.958120  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:21.958921  3841 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:21.959277  3841 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:21.959342  3844 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:21.960191  3841 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:21.961591  3841 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.009620  3841 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:22.045915  3999 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:22.054423  8124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29f44dfd3d24dccaa224167c983a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.064607  8094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35184 (request call id 572) took 1212 ms. Trace:
I20260709 12:22:22.065124  8094 rpcz_store.cc:276] 0709 12:22:20.816666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.816818 (+   152us) service_pool.cc:224] Handling call
0709 12:22:21.104149 (+287331us) ts_tablet_manager.cc:934] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
0709 12:22:21.593082 (+488933us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:21.848703 (+255621us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:21.855610 (+  6907us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:21.981869 (+126259us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:21.982240 (+   371us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:22.022048 (+ 39808us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:22.029315 (+  7267us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":387,"tablet-copy.queue_time_us":216700,"thread_start_us":224364,"threads_started":2}
I20260709 12:22:22.067200  8094 tablet_copy_client.cc:806] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:22.067799  8094 tablet_copy_client.cc:670] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
W20260709 12:22:22.107574  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 82463.6us
W20260709 12:22:22.114470  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 96303.4us
I20260709 12:22:22.137058  3746 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 13 to 14, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:22.157531  8094 tablet_copy_client.cc:538] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:22.138847  3746 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:22.176535  3845 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:22.178453  8001 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:22.197543  8094 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:22:22.200038  3964 consensus_peers.cc:597] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e693a63f62764df9a01acfa82fed09e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:22.200590  8124 tablet_copy_client.cc:806] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:22.207263  8124 tablet_copy_client.cc:670] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:22.212996  8124 tablet_copy_client.cc:538] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:22.227331  8124 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:22:22.263358  8094 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:22.264647  8094 tablet_bootstrap.cc:492] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:22.265671  8094 ts_tablet_manager.cc:1403] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.068s	user 0.045s	sys 0.004s
I20260709 12:22:22.267612  8149 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:22.269601  8094 raft_consensus.cc:359] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:22.270936  8094 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:22.272011  8094 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:22.274201  3847 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:22.285550  8094 ts_tablet_manager.cc:1434] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:22:22.289812  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-99966b4924ae49f889200899350931bb received from {username='slave'} at 127.0.0.1:46046
I20260709 12:22:22.291141  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-99966b4924ae49f889200899350931bb on tablet 99966b4924ae49f889200899350931bb with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:22.314642  8141 raft_consensus.cc:993] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:22.315253  8141 raft_consensus.cc:1081] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:22.333585  3921 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:22.344882  3746 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:22.368129  3847 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:22.377379  8116 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:22.387130  3916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:22.387748  3916 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:22.388098  3916 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.401693  8126 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:22:22.432979  8095 raft_consensus.cc:993] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:22.433629  8095 raft_consensus.cc:1081] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:22.436964  3999 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:22.456667  3916 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:22.469431  3916 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:22.469594  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:22.470249  3841 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:22.470580  3841 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:22.471309  3841 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:22.472378  3841 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.475811  3996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:22.476488  3996 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:22.476827  3996 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:22.488020  3841 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:22.489601  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:22.493877  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:22.494415  3992 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.492376  3996 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:22.492628  3920 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:22.508431  3992 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:22.513407  3841 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:22.516851  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:22.517518  3841 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:22.517815  3841 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:22.519043  3841 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:22.520136  3841 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:22.524168  3916 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:22.525171  3996 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:22.527144  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:22.527796  3922 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:22.499063  8145 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:22.531038  8145 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:22.531992  8145 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:22.535388  3922 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:22.536036  3996 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:22.538074  3841 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:22.545161  4574 raft_consensus.cc:1217] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:22:22.546118  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:22.523339  8110 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:22:22.568221  8146 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:22.540746  8149 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:22.565729  8105 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:22.608052  8105 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:22.609107  8105 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:22.631080  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 71341.5us
W20260709 12:22:22.634615  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 87353.5us
W20260709 12:22:22.660496  3964 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67af26a7a42843f6855950af7a5b7781. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:22.660995  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 99490.7us
I20260709 12:22:22.717252  3847 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:22:22.751760  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57730.3us
W20260709 12:22:22.756422  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72484.1us
W20260709 12:22:22.765267  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44373.9us
I20260709 12:22:22.771890  3992 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:22:22.756726  8153 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:22:22.816644  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 93774.4us
W20260709 12:22:22.833351  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56121.2us
W20260709 12:22:22.837422  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63037.7us
W20260709 12:22:22.767302  8143 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:22:22.849649  3744 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:22.859912  3747 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 8 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:22.806805  8093 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:22:22.859238  8116 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:22:22.940341  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45135.8us
W20260709 12:22:22.999779  8158 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:22:23.023962  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 141364us
W20260709 12:22:23.046649  8168 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:22:23.126048  8124 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:23.127337  8124 tablet_bootstrap.cc:492] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:23.128443  8124 ts_tablet_manager.cc:1403] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.901s	user 0.091s	sys 0.077s
I20260709 12:22:23.132897  8124 raft_consensus.cc:359] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:23.133899  8124 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:23.134886  8124 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:23.137574  8124 ts_tablet_manager.cc:1434] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 12:22:23.141492  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 166958us
W20260709 12:22:23.155947  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 187953us
W20260709 12:22:23.180532  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 301436us
I20260709 12:22:23.186115  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-a29f44dfd3d24dccaa224167c983a5a4 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:22:23.186844  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-a29f44dfd3d24dccaa224167c983a5a4 on tablet a29f44dfd3d24dccaa224167c983a5a4 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:23.187520  4574 raft_consensus.cc:1217] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:22:23.190932  3996 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:22:23.202171  3847 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:22:23.203600  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50647.6us
I20260709 12:22:23.216125  8083 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:23.219393  8160 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:23.220960  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:23.233218  3843 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:23.243237  8202 ts_tablet_manager.cc:933] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:23.249215  8124 ts_tablet_manager.cc:933] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:23.282002  3847 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:23.293068  8116 raft_consensus.cc:1064] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:23.308871  8124 tablet_copy_client.cc:323] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:22:23.311717  8116 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:23.368712  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44752.8us
W20260709 12:22:23.370699  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54170.8us
I20260709 12:22:23.373709  8170 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:23.305522  8123 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:22:23.382347  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 61996.1us
W20260709 12:22:23.376165  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55043.9us
W20260709 12:22:23.382421  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62109.2us
W20260709 12:22:23.382596  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84291.7us
I20260709 12:22:23.395426  3916 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:23.397342  3916 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:23.443475  8185 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:23.430944  3744 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index -1 to 7, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:23.484611  4009 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 67af26a7a42843f6855950af7a5b7781 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:22:23.485298  4009 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 67af26a7a42843f6855950af7a5b7781 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-67af26a7a42843f6855950af7a5b7781
I20260709 12:22:23.488557  4581 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:23.490571  8190 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:23.457619  8202 tablet_copy_client.cc:323] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:22:23.509207  3992 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:23.530797  3843 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:23.531966  4008 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet e693a63f62764df9a01acfa82fed09e8 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:22:23.539656  4008 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet e693a63f62764df9a01acfa82fed09e8 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-e693a63f62764df9a01acfa82fed09e8
I20260709 12:22:23.552842  4009 tablet_copy_source_session.cc:215] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:23.557652  8124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67af26a7a42843f6855950af7a5b7781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.540122  8190 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:22:23.569133  8116 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:23.572471  8095 raft_consensus.cc:1064] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:23.575335  8095 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:23.632544  4008 tablet_copy_source_session.cc:215] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:23.701475  8124 tablet_copy_client.cc:806] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:23.702184  8124 tablet_copy_client.cc:670] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:23.816203  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e693a63f62764df9a01acfa82fed09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.829864  4581 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:23.837121  3998 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:23.840327  8110 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:23.911940  8157 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:23.924065  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:23.925132  3996 raft_consensus.cc:606] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:23.951750  8114 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:23.960892  8124 tablet_copy_client.cc:538] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:23.961927  3921 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:23.987798  3921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:23.970172  4579 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.091744  3921 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:24.093204  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 197187us
W20260709 12:22:24.093236  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65698.4us
I20260709 12:22:24.096016  3845 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.104069  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:24.104800  3849 raft_consensus.cc:606] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:24.106487  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:24.111377  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:24.112565  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:24.123620  8090 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:24.157407  8106 raft_consensus.cc:993] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:24.167023  8106 raft_consensus.cc:1081] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:24.177377  3997 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.208545  3745 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.241223  8042 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.253309  8114 raft_consensus.cc:993] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:24.254233  8114 raft_consensus.cc:1081] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:24.260335  8124 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:22:24.317519  8202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35180 (request call id 569) took 1103 ms. Trace:
I20260709 12:22:24.318197  8202 rpcz_store.cc:276] 0709 12:22:23.214459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.214709 (+   250us) service_pool.cc:224] Handling call
0709 12:22:23.264282 (+ 49573us) ts_tablet_manager.cc:934] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
0709 12:22:23.813757 (+549475us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:24.062456 (+248699us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:24.062581 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:24.258126 (+195545us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:24.265891 (+  7765us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:24.302795 (+ 36904us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:24.317383 (+ 14588us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":35163,"tablet-copy.queue_time_us":27979,"thread_start_us":177975,"threads_started":2}
W20260709 12:22:24.353554  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 47892.6us
I20260709 12:22:24.371658  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:24.404788  3998 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.405232  3998 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:24.397228  3999 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.433439  8202 tablet_copy_client.cc:806] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:24.434300  8202 tablet_copy_client.cc:670] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:24.456524  8167 raft_consensus.cc:993] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:24.457168  8167 raft_consensus.cc:1081] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
W20260709 12:22:24.469558  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 110781us
I20260709 12:22:24.492703  3920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:22:24.493316  3920 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.493747  3920 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:24.524194  3998 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:24.528039  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102777us
I20260709 12:22:24.536082  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:24.536763  3845 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.537132  3845 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.554334  3998 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:24.555781  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 70284us
I20260709 12:22:24.556862  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:24.557958  3846 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:24.558319  3846 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:24.559332  3846 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:24.560434  3846 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:24.511129  3920 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:24.569434  3921 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.580363  3845 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:24.580677  3846 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
W20260709 12:22:24.583747  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 89631.9us
W20260709 12:22:24.584851  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 83146.7us
I20260709 12:22:24.590369  3847 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:24.593967  4579 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.615684  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:24.616397  3847 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:24.621431  3920 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:24.623332  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:24.624603  8046 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:24.625174  8046 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:24.628531  8167 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:24.629701  8167 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:24.630028  8167 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:24.631572  8046 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:24.631688  8167 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:24.633137  8167 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.635955  3845 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:24.638499  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:24.640409  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:24.641013  4579 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.650518  4579 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:24.670280  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:24.671011  3924 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:24.686553  3847 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:24.694598  3924 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:24.698963  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:24.700328  8170 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:24.700917  8170 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:24.702133  8170 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:24.718489  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:24.719228  3990 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:24.719725  3990 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:24.720655  3990 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:24.721952  3990 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:24.748046  3920 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:24.749651  3990 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:24.761071  3734 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 146eb0cb8a2f4846ae6ef2b8758dd6a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.771391  3744 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 10 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.801010  3999 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:24.806494  3745 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 7 to 8, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.807644  3845 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:24.816016  4579 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:24.816210  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:24.817653  8231 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:24.818205  8231 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:24.819239  8231 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:24.821350  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:24.821988  3996 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.822446  8230 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:24.830376  3996 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:24.830696  8230 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.843288  4579 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.852736  3747 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.858294  3990 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:24.879141  3745 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 11 to 12, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:24.886451  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a29f44dfd3d24dccaa224167c983a5a4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:24.888839  8124 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:24.893930  8124 tablet_bootstrap.cc:492] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:24.894831  8124 ts_tablet_manager.cc:1403] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.635s	user 0.040s	sys 0.015s
I20260709 12:22:24.907543  3746 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 12 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.908322  8124 raft_consensus.cc:359] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:24.909336  8124 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:24.910055  8124 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:24.912881  8124 ts_tablet_manager.cc:1434] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
W20260709 12:22:24.960068  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.960425  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet a29f44dfd3d24dccaa224167c983a5a4 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45270
I20260709 12:22:24.973083  8095 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:24.982246  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34144
I20260709 12:22:24.983058  3845 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership
I20260709 12:22:24.991259  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34144
I20260709 12:22:24.992039  3845 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership
W20260709 12:22:25.002058  3732 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 99966b4924ae49f889200899350931bb already in progress
I20260709 12:22:25.006160  8237 tablet_replica.cc:333] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:22:25.007730  8237 raft_consensus.cc:2243] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:25.008853  8237 raft_consensus.cc:2272] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:25.017922  4008 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-67af26a7a42843f6855950af7a5b7781 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:22:25.018566  4008 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-67af26a7a42843f6855950af7a5b7781 on tablet 67af26a7a42843f6855950af7a5b7781 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:25.012040  8202 tablet_copy_client.cc:538] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:25.035073  8237 ts_tablet_manager.cc:1916] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:25.068460  3920 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:25.073976  3732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 72726.8us
I20260709 12:22:25.057410  3995 raft_consensus.cc:2955] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.076668  8227 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:25.104038  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34144
I20260709 12:22:25.104669  3845 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership
I20260709 12:22:25.141294  8202 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:22:25.144326  3796 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:22:25.166797  3796 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 99966b4924ae49f889200899350931bb already in progress
W20260709 12:22:25.167199  3796 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 99966b4924ae49f889200899350931bb already in progress
W20260709 12:22:25.154145  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): ChangeConfig:REMOVE_PEER RPC failed for tablet 99966b4924ae49f889200899350931bb: Remote error: Service unavailable: leader transfer in progress
I20260709 12:22:25.175542  3845 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:25.200973  8106 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:25.214133  3922 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:25.218479  8095 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:25.231943  4579 raft_consensus.cc:1217] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:22:25.256661  8095 raft_consensus.cc:993] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:25.257319  8141 raft_consensus.cc:1081] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:25.270814  3996 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:25.274940  7997 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:25.269356  3922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:25.276440  3922 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.278158  3922 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.279842  3846 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:25.284664  8170 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:22:25.297736  4574 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:25.316972  3922 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:25.323804  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:25.328567  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:25.329298  3996 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.302173  8095 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:25.338155  3845 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:25.338584  3845 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:25.339514  3845 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:25.343122  3996 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:25.351986  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:25.354172  3922 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:25.406977  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54554.1us
I20260709 12:22:25.445179  3845 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.473176  8237 ts_tablet_manager.cc:1929] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:22:25.474682  8237 log.cc:1199] T a29f44dfd3d24dccaa224167c983a5a4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/a29f44dfd3d24dccaa224167c983a5a4
W20260709 12:22:25.518291  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48685.5us
I20260709 12:22:25.555720  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet a29f44dfd3d24dccaa224167c983a5a4 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:22:25.519021  3845 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:25.610028  8202 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:25.611092  8202 tablet_bootstrap.cc:492] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:25.611939  8202 ts_tablet_manager.cc:1403] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.471s	user 0.051s	sys 0.022s
I20260709 12:22:25.615224  8202 raft_consensus.cc:359] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:25.624222  8202 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:25.625013  8202 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:25.640406  8202 ts_tablet_manager.cc:1434] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:22:25.644495  4008 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e693a63f62764df9a01acfa82fed09e8 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:22:25.645013  4008 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e693a63f62764df9a01acfa82fed09e8 on tablet e693a63f62764df9a01acfa82fed09e8 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:25.658073  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:25.660130  8107 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:25.660764  8107 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:25.661687  8107 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:25.676435  8106 raft_consensus.cc:1064] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:25.679659  8106 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:25.683997  3746 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.750332  3916 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:25.751055  4579 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:25.751122  3845 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:25.753823  8227 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:25.756342  8227 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:25.766397  8046 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:25.857707  8227 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.866576  3924 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.874140  4579 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.922672  3746 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 7 to 8, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.969245  3845 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:25.983273  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.027504  4574 raft_consensus.cc:1217] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 12:22:26.034988  3995 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:26.085012  3845 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:26.094099  8046 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:26.096295  4574 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:26.105232  8227 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:26.124272  3734 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:26.127925  8106 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:26.133796  3845 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:26.145373  4579 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:26.183879  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45189.2us
I20260709 12:22:26.214720  3999 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:26.220369  8170 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:26.227722  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67af26a7a42843f6855950af7a5b7781 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:26.229817  4574 raft_consensus.cc:2955] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:26.254735  3747 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 8 to 9, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.275543  3841 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:26.278822  8170 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:26.312315  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet 67af26a7a42843f6855950af7a5b7781 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:45270
I20260709 12:22:26.318193  4579 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:26.325407  8267 tablet_replica.cc:333] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:22:26.326771  8267 raft_consensus.cc:2243] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:26.327834  8267 raft_consensus.cc:2272] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:26.335739  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:26.329811  8262 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:22:26.336445  3990 raft_consensus.cc:606] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:26.353600  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:26.354318  3920 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:26.360108  3916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:26.360782  3916 raft_consensus.cc:606] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:26.368778  8170 raft_consensus.cc:993] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:26.373138  8267 ts_tablet_manager.cc:1916] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:26.379624  8107 raft_consensus.cc:1081] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:26.399757  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:26.400461  3845 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.400954  3845 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.407810  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:26.408525  3920 raft_consensus.cc:606] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:26.422591  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:26.424520  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.425411  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.429667  8227 raft_consensus.cc:993] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:26.430220  8263 raft_consensus.cc:1081] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:26.450340  3920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:22:26.451138  3920 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.451537  3920 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.454036  3845 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.457301  3845 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:26.460927  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:26.462239  3916 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:26.462530  3916 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:26.466181  8267 ts_tablet_manager.cc:1929] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:22:26.466751  8267 log.cc:1199] T 67af26a7a42843f6855950af7a5b7781 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/67af26a7a42843f6855950af7a5b7781
I20260709 12:22:26.468312  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:26.468946  3990 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.470873  3916 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.472141  3916 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.475906  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet 67af26a7a42843f6855950af7a5b7781 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:22:26.496229  3990 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:26.521776  3916 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:26.530138  3920 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.531589  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:26.532524  8264 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:26.533258  8264 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:26.536351  8264 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.537246  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:26.538103  3845 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.544046  3920 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:26.549536  3845 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:26.550966  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:26.551942  8262 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:26.552469  8262 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:26.553365  8262 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.555214  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:26.555835  3996 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:26.556147  3996 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:26.562668  8263 raft_consensus.cc:1064] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:26.570879  3996 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:26.566383  8263 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:26.591144  3996 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.609612  3996 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:26.625718  3745 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:26.659785  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67298.1us
I20260709 12:22:26.685190  3746 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 10, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.662475  8274 raft_consensus.cc:993] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:26.704046  8167 raft_consensus.cc:1081] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
W20260709 12:22:26.712910  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 75679.8us
I20260709 12:22:26.715397  3841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:26.716054  3841 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.716413  3841 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.759835  4579 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:26.763139  3846 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:26.762771  8232 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:26.768890  3916 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:26.769740  8263 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:26.789288  8263 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:26.831408  3841 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:26.873152  8232 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:26.930372  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:26.931135  3916 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:26.931473  3916 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:26.928833  3846 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:26.932344  3916 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:26.933995  3916 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.945391  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:26.946071  4579 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.946461  3841 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:26.953354  3920 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:26.948523  3916 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:26.994381  3745 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.000409  3920 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:27.002897  8110 raft_consensus.cc:993] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:27.003546  8110 raft_consensus.cc:1081] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:27.005807  8252 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:27.013556  3841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:27.014217  3841 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.014649  3841 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.013974  3847 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.016948  3846 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:27.018677  8167 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:27.055915  3999 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:27.065917  4574 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.077675  4579 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:27.087793  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:27.088526  3995 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.089746  3841 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:27.098124  3999 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:27.101078  3994 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:27.101480  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:27.106817  3841 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:27.116070  8277 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:27.120085  8252 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:27.117519  3995 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:27.123191  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:27.130990  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:27.131417  3916 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:27.133117  3916 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:27.134088  3916 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:27.131708  4579 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.147507  3916 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.159802  4579 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:27.145545  8252 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:27.161578  8252 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:27.166496  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:27.169488  8230 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:27.170089  8230 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:27.171072  8230 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:27.186446  3734 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 146eb0cb8a2f4846ae6ef2b8758dd6a6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.229995  3745 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.258100  3916 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
W20260709 12:22:27.282891  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 177119us
W20260709 12:22:27.294960  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 59169.9us
I20260709 12:22:27.298641  3920 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:27.299885  4579 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:22:27.330538  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74379.8us
I20260709 12:22:27.366420  8292 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:27.346525  8227 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:22:27.416301  3745 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:27.423925  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 76595.1us
I20260709 12:22:27.482961  8296 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:27.516837  8046 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.542418  4581 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.548913  3920 raft_consensus.cc:2955] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.556856  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e693a63f62764df9a01acfa82fed09e8 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:27.575255  3745 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 9 to 10, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 9 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:27.589843  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet e693a63f62764df9a01acfa82fed09e8 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:34144
I20260709 12:22:27.631587  3999 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:27.631383  8299 tablet_replica.cc:333] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:22:27.640314  8264 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:27.667505  8299 raft_consensus.cc:2243] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:27.668407  8299 raft_consensus.cc:2272] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:27.674067  4581 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:27.675346  8299 ts_tablet_manager.cc:1916] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:27.679719  8264 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:27.684222  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.691499  4579 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:27.698841  8292 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:27.699270  8299 ts_tablet_manager.cc:1929] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 12:22:27.700006  8299 log.cc:1199] T e693a63f62764df9a01acfa82fed09e8 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/e693a63f62764df9a01acfa82fed09e8
I20260709 12:22:27.704527  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet e693a63f62764df9a01acfa82fed09e8 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:22:27.743559  3920 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:27.752302  3920 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:27.762753  8095 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:27.765328  8293 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:28.012421  3920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:28.013146  3920 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:28.026886  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:28.027596  3845 raft_consensus.cc:606] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:28.031646  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:28.032294  3841 raft_consensus.cc:606] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:28.034089  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:28.036448  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.037338  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.287680  8095 raft_consensus.cc:993] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:28.288252  8095 raft_consensus.cc:1081] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:28.296830  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:28.298743  3999 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.299263  3999 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:28.302500  8293 raft_consensus.cc:993] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:28.308926  8293 raft_consensus.cc:1081] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:28.311461  3920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:28.312551  3920 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.313067  3920 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.358454  3999 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:28.362249  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:28.362931  3845 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:28.363030  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:28.363433  3845 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:28.363749  4581 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:28.364318  3845 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:28.365685  3845 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:28.323827  3920 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.370002  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:28.370677  3841 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:28.370999  3841 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:28.371861  3841 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.373227  3841 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.377103  3845 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:28.371899  4581 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:28.380546  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:28.381614  8308 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:28.382205  8308 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:28.383181  8308 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:28.393033  3841 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:28.393721  3999 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:28.394678  3920 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:28.395879  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:28.401805  3994 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.414203  3994 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:28.415608  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:28.414891  3746 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 14, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.416973  8167 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:28.417505  8167 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:28.418501  8167 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.500267  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 11 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:28.526367  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54263.5us
I20260709 12:22:28.600597  8167 raft_consensus.cc:993] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:28.636830  8167 raft_consensus.cc:1081] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:28.664047  3994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:22:28.664762  3994 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.665239  3994 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.746186  3994 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.752733  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:28.753532  3841 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:28.768329  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67129.1us
I20260709 12:22:28.769611  3841 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:28.800191  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:28.773473  3994 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:28.801211  8319 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:28.802994  8319 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:28.804112  8319 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.777498  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:28.808477  3920 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:28.808915  3920 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:28.809782  3920 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:28.811291  3920 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.843737  3841 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:28.846621  8308 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:28.853106  3920 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:28.840323  3747 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:28.915988  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet 56a5b44f8f3e46ae9582b9f86d191610: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:28.922488  3920 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:28.940629  4581 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:28.943743  8319 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:22:28.956148  3890 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bf551f0b2a843aa8a6b0ebdf7ba8fef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:28.956278  3994 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:28.957480  3841 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:28.959141  8314 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:28.961720  8167 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:28.987982  8317 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:28.998868  3999 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:29.007382  3998 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:29.013849  8313 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:29.056493  3845 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:29.062692  3747 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:29.064185  8262 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:29.173638  3841 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:29.177349  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.279760  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:29.280519  3996 raft_consensus.cc:606] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:29.281633  3916 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:29.290885  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:29.291594  3924 raft_consensus.cc:606] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:29.298344  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
W20260709 12:22:29.298609  3890 consensus_peers.cc:597] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfad3fb2927f45958c4a0cf0768a8b53. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:29.298969  3996 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:29.312206  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:29.315500  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.318540  3846 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:29.316447  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.326673  8167 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:29.329161  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 88251.7us
I20260709 12:22:29.333582  3843 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:29.337222  3920 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:29.364460  3995 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:29.370375  8106 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:29.377513  8332 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:22:29.394774  8175 raft_consensus.cc:993] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:29.395323  8175 raft_consensus.cc:1081] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:29.398833  8317 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:29.411234  3843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34162
I20260709 12:22:29.411862  3843 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:29.412240  3843 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.433594  3996 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:22:29.437332  3843 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:29.439914  3843 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:29.452546  8349 ts_tablet_manager.cc:933] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:29.458168  3844 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:22:29.460345  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer bd47d64594f743eba2922d79251c1c5c from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:29.463594  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 72285.3us
I20260709 12:22:29.466117  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:29.466741  3922 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:29.467036  3922 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:29.467854  3922 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:29.469431  3922 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.480930  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:29.481611  3994 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.483382  3922 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:29.489259  3994 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:29.495842  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:29.496697  8348 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:29.497334  8348 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:29.498868  8348 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:29.504559  8335 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:22:29.524996  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet f8842b18207e4c90a92bd153fe9d059e: Remote error: Service unavailable: leader transfer in progress
I20260709 12:22:29.540086  8106 raft_consensus.cc:993] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:29.541050  8106 raft_consensus.cc:1081] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:22:29.543064  8349 tablet_copy_client.cc:323] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:22:29.546285  3845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:22:29.553450  3845 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:29.553850  3845 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:29.570031  3845 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:29.551633  8340 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.005s	sys 0.007s
I20260709 12:22:29.579855  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:22:29.580499  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-2bf551f0b2a843aa8a6b0ebdf7ba8fef
I20260709 12:22:29.578600  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 9, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.590782  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:29.594193  8263 raft_consensus.cc:993] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:29.594820  8263 raft_consensus.cc:1081] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:29.595943  4581 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:29.605623  3934 tablet_copy_source_session.cc:215] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:29.612484  4581 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:29.620198  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:29.628973  3996 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:29.629330  3996 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:29.624138  3922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:22:29.631659  3922 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:29.578622  3845 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:29.633188  3922 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:29.635207  8310 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.019s
I20260709 12:22:29.630944  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:29.634717  3746 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.637516  8348 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:29.638037  8348 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:29.638976  8348 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:29.649761  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.652158  3996 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:29.653774  3996 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:29.756780  3996 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:29.777768  8354 ts_tablet_manager.cc:933] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:29.784857  3922 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:29.793604  3922 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:29.794039  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:29.794754  3841 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:29.795775  8354 tablet_copy_client.cc:323] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:22:29.799670  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet dfad3fb2927f45958c4a0cf0768a8b53 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:22:29.800261  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet dfad3fb2927f45958c4a0cf0768a8b53 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-dfad3fb2927f45958c4a0cf0768a8b53
I20260709 12:22:29.803544  3841 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:29.805047  3888 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:29.808184  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.809540  8175 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:29.810892  8175 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:29.811599  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:29.814586  3996 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:29.815762  3996 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:29.812650  8175 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:29.817792  3996 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:29.825737  3996 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:29.818759  3934 tablet_copy_source_session.cc:215] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:29.839417  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfad3fb2927f45958c4a0cf0768a8b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.860105  3746 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 8 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.823223  8349 tablet_copy_client.cc:806] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:29.864053  8349 tablet_copy_client.cc:670] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:29.873685  8349 tablet_copy_client.cc:538] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:29.879908  3996 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:29.943765  3922 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:29.952589  8348 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:29.954937  8354 tablet_copy_client.cc:806] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:29.955687  8354 tablet_copy_client.cc:670] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:29.962534  8354 tablet_copy_client.cc:538] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:29.980526  3996 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:29.983256  8295 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:30.015268  3815 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.065975  8349 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:22:30.084334  8354 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:22:30.093112  4581 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:30.097788  3996 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:30.098757  8348 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:30.106101  8295 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:30.296026  8349 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:30.297138  8349 tablet_bootstrap.cc:492] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:30.297973  8349 ts_tablet_manager.cc:1403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.232s	user 0.037s	sys 0.012s
I20260709 12:22:30.305243  8349 raft_consensus.cc:359] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:30.306417  8349 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:30.309381  8349 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:30.328151  8349 ts_tablet_manager.cc:1434] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 12:22:30.330183  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2bf551f0b2a843aa8a6b0ebdf7ba8fef received from {username='slave'} at 127.0.0.1:46046
I20260709 12:22:30.330665  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2bf551f0b2a843aa8a6b0ebdf7ba8fef on tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:30.363673  3998 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:30.366659  8175 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:30.417115  8354 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:30.418347  8354 tablet_bootstrap.cc:492] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:22:30.420557  3841 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:30.423362  8335 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:30.475786  8354 ts_tablet_manager.cc:1403] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.392s	user 0.039s	sys 0.026s
I20260709 12:22:30.489749  8354 raft_consensus.cc:359] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:30.491824  8354 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:22:30.521471  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.543941  8354 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:30.566860  8354 ts_tablet_manager.cc:1434] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 12:22:30.587412  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-dfad3fb2927f45958c4a0cf0768a8b53 received from {username='slave'} at 127.0.0.1:46046
I20260709 12:22:30.587965  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-dfad3fb2927f45958c4a0cf0768a8b53 on tablet dfad3fb2927f45958c4a0cf0768a8b53 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:30.713157  3922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:30.713845  3922 raft_consensus.cc:606] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:30.720325  4581 raft_consensus.cc:1217] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:22:30.726082  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:30.726733  3845 raft_consensus.cc:606] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:30.733167  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:30.733861  3841 raft_consensus.cc:606] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:30.736410  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:30.739534  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.740448  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:32.073484  8372 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.074249  8372 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.076893  8372 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:32.080785  3962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.011s	sys 0.001s
W20260709 12:22:32.081322  3962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.011s	sys 0.001s
W20260709 12:22:32.097973  3813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.010s	sys 0.007s
I20260709 12:22:32.098284  8377 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:32.098626  3813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.010s	sys 0.007s
I20260709 12:22:32.098999  8375 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.099042  8377 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.099731  8375 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.098551  8376 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.100817  8374 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.101023  8376 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.101557  8374 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.104514  8376 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:32.107416  2682 debug-util.cc:398] Leaking SignalData structure 0x7b0800332620 after lost signal to thread 3815
I20260709 12:22:32.107491  8377 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:32.108278  2682 kernel_stack_watchdog.cc:198] Thread 3815 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 194ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:22:32.105857  8374 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.111641  8373 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.112044  8375 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.107126  8376 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.112311  8373 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.112941  8376 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.114837  8373 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.119184  8372 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.115208  8376 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.119858  8372 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.121891  8372 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.133014  8377 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.133898  8377 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.143142  8308 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:32.143882  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 2680
I20260709 12:22:32.143932  8308 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.146531  8308 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.154740  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 556) took 1152 ms. Trace:
I20260709 12:22:32.155220  3998 rpcz_store.cc:276] 0709 12:22:31.002025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.153840 (+1151815us) service_pool.cc:224] Handling call
0709 12:22:32.154211 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.154409 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.154433 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.154471 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:32.154499 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.154562 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.154676 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:32.178084  8383 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.186451  8378 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.187207  8378 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.200763  8308 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.201027  8363 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.200539  8378 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:32.198455  3965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.004s	sys 0.007s
I20260709 12:22:32.201733  8363 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:32.216184  3965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.005s	sys 0.008s
I20260709 12:22:32.215557  8367 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.201543  8308 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.284219  8384 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.193600  8344 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.191797  8380 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.280258  8374 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.287878  8374 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.288969  8378 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.289523  8378 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.290113  8374 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.266297  8372 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.290946  8372 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.293465  8372 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.223912  8375 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.294281  8375 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.284714  8385 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.183624  8383 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.223812  8376 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.223522  8363 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.241055  8348 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.223385  8379 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.223855  8367 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.300081  8378 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.311470  8367 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.304875  8348 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.312331  8367 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.300133  8376 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.223773  8381 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.300522  8385 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.318965  8308 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.319692  8382 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.320137  8376 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.304656  8377 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.329201  8308 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.329069  8382 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.329470  8389 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.329914  8308 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.330255  8389 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.295639  8380 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.332660  8375 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.332646  8389 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.333807  8389 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.316751  8348 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.334189  8382 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.298215  8344 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.297953  8384 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.320622  8367 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.337214  8380 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.344300  8382 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.351198  8382 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.320847  8379 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.343827  8348 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.323136  8381 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.353071  8378 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.352862  8376 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.339537  8389 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.386898  8390 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.387538  8387 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.356478  8380 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.389096  8385 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.389691  8393 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.386740  8374 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.355979  8373 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.365036  8363 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.363487  8348 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.571662  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.592478  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.570055  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.386727  8388 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.616523  8403 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.404250  8308 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:32.623772  3779 debug-util.cc:398] Leaking SignalData structure 0x7b080008a5a0 after lost signal to thread 3782
I20260709 12:22:32.570680  8386 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.423004  8337 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.570967  8368 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.423097  8391 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.425532  8383 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.616873  8395 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.423930  8372 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.612896  8385 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.484216  8384 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.406117  8378 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.657682  8391 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.634123  8339 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.654788  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.459474  8376 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.634706  8308 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.677371  3844 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:32.618238  8374 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.618086  8363 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.617722  8373 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.623337  8380 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.657680  8375 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.691524  8367 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.614665  8390 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.677088  8384 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.618410  8393 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.614387  8387 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:32.713238  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.80053e+06us
I20260709 12:22:32.680425  8382 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.688803  8339 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:32.717418  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63183.6us
W20260709 12:22:32.715293  3779 debug-util.cc:398] Leaking SignalData structure 0x7b080035f000 after lost signal to thread 3874
I20260709 12:22:32.667114  8372 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.702947  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.622972  8388 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.672503  8385 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.646201  8386 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.729610  8339 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.722124  8379 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:32.732487  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa8e0 after lost signal to thread 3949
I20260709 12:22:32.732869  3850 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:22:32.701606  8375 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.651397  8337 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.635248  8403 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.690197  8308 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:32.741633  3779 debug-util.cc:398] Leaking SignalData structure 0x7b0800316660 after lost signal to thread 4023
W20260709 12:22:32.742908  3779 debug-util.cc:398] Leaking SignalData structure 0x7b080030e9e0 after lost signal to thread 4608
I20260709 12:22:32.658161  8368 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:32.756439  8376 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.757210  8368 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.757968  8373 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.759027  8385 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.759183  8412 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.759718  8404 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.760178  8344 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.748391  8379 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.760354  8404 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.749730  8391 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.751801  8278 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.761133  8372 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.761940  8337 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.761689  8278 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.763049  8404 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.763582  8400 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.763980  8403 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.764067  8390 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.759822  8412 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.766044  8308 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.766441  8386 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.767135  8412 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.767396  8348 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.767521  8398 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.761134  8379 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.768280  8398 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.769852  8388 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.665800  8395 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.735020  8384 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.787873  8377 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.788549  8377 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:32.768157  8363 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.789635  8363 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.789788  8384 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.776042  8408 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.790146  8363 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.790966  8376 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.790778  8408 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.767145  8378 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.791532  8376 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.746793  8389 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.792984  8408 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.793656  8376 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.793290  8363 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.764259  8278 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.794749  8379 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.794219  8393 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.794984  8395 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.768142  8405 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.764184  8400 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.795975  8405 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.798199  8405 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.798270  8400 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.771628  8380 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.798794  8405 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.779031  8387 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.771772  8381 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.799503  8387 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.800125  8387 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.766049  8374 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.771226  8398 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.793011  8375 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:32.830336  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 96608.5us
I20260709 12:22:32.790796  8377 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.843603  8335 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.844251  8335 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.846314  8335 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.846784  8335 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.847795  8419 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.848361  8419 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.849185  8393 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.849735  8393 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.850498  8397 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.850641  8419 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.851055  8397 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.851719  8399 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.851984  8393 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.852566  8393 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.848572  8413 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.853017  8412 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.853335  8397 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.853190  8413 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.853596  8412 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.855739  8407 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.821460  8404 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.852248  8399 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.856325  8407 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.856477  8404 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.858700  8407 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.858745  8404 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.858744  8399 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.859419  8387 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.859814  8413 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.799324  8405 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.859956  8393 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.861624  8388 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.861914  8405 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.862207  8388 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.864674  8393 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.866207  8393 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.848385  8392 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.867064  8392 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.867657  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.868357  3844 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:32.869983  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.848493  8410 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.869529  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.871560  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.871903  3841 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:22:32.869496  8392 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.871475  8410 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.870043  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.853888  8397 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.873010  3850 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:32.851123  8419 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.870635  8335 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.880503  8397 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.880873  8419 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.887277  8419 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.888294  8388 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.891840  8418 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.892509  8418 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.884591  8397 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.879319  8391 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.900498  8391 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.898867  8399 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.903358  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.903712  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.904007  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.903852  8399 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.906917  8399 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.899634  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.907809  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.908784  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.909212  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.909042  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.910506  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.882133  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:32.928635  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:32.939709  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44092.9us
I20260709 12:22:32.940109  4579 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:32.911861  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:32.940620  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 58621.8us
I20260709 12:22:32.927541  3841 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:32.926721  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.941859  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.929509  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.936918  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.936517  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.944527  8373 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:32.944801  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.945178  8373 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.945569  8373 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:32.944554  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.946411  3920 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:32.930708  8410 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.927253  8420 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.948546  8418 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.948999  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.948815  8420 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.941563  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:32.930925  8391 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.953004  8413 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:32.954267  8413 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.954818  8407 raft_consensus.cc:1064] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:32.955556  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.956351  3916 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:32.957324  8413 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.953284  8405 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.957719  8407 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.958729  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.958482  8405 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:32.960477  8420 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.950284  8335 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.929852  8412 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.961107  8405 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.952922  8374 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:32.963229  8374 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.963653  8374 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:32.963778  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.964408  3920 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:22:32.965298  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.965909  3916 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:32.966804  8387 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.967324  8387 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.967993  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.969496  8387 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.967671  8413 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:32.970358  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.970290  8413 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.972460  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:32.973097  3923 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:32.974982  8413 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:32.975140  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.976161  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.976429  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.976908  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.980639  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.980929  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.981525  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.982129  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.982692  3849 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:32.982208  3841 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:32.983789  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.929093  8422 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.985848  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:32.984650  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 43723.6us
I20260709 12:22:32.984730  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:32.878738  8393 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.988829  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.990047  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.990211  8392 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.990777  8393 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:32.990828  8392 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.993237  8392 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:32.992937  8373 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.995589  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.997707  8390 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:32.997993  8424 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:32.998382  8390 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.998548  8424 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:32.982918  8374 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:32.999938  4579 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:33.000774  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.001240  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.001567  8390 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.002161  8392 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:33.002095  8418 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:33.004436  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.005288  8418 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.007572  8418 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.002804  8392 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.002739  8373 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.008716  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.008948  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.009586  8392 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.009737  4575 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:33.008311  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.011591  8399 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:33.012210  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.012149  8399 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:33.012694  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.013646  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.014385  8399 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.015008  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.011092  4575 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:33.015805  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:32.986503  8335 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.016391  8412 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.016993  8412 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.018918  8412 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.019604  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.020761  8374 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.021715  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.021946  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.024816  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.026587  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.030267  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.030905  3844 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:33.031818  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.033253  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.034250  8424 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.036039  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.038518  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.044234  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.045486  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.046129  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.048345  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.049500  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.049862  8398 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.050251  8398 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.050657  8398 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.055872  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.056212  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.057318  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.057799  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.058656  8387 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:33.058980  3962 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.059062  8387 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.061106  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.055889  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.061755  3922 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:33.021234  8335 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.064039  8335 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.061197  8405 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:33.064656  8405 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.065073  8405 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:33.065011  3962 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.066072  8423 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.066802  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.061199  8387 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:33.066484  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.069738  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.070955  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.072642  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.077298  8387 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.079033  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.103593  8380 raft_consensus.cc:1064] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:22:33.104898  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.002606  8422 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.087765  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.106069  3923 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:22:33.088104  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.088487  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.088738  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.108439  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.109678  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.110106  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.110263  3921 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:33.111239  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.112107  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.112382  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.113229  3923 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:33.089268  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.116374  3919 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:33.089376  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.087802  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.119313  3917 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:33.090528  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.090829  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.048419  3890 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:22:33.121264  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 72913us
I20260709 12:22:33.121708  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.121974  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.122609  3998 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:22:33.100567  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.066468  8423 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.123904  8390 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:33.124408  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.124744  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.125038  8422 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.119954  8380 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.121348  8424 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:33.123947  8423 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.082280  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.103399  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.125638  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.129046  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.111177  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.125851  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.120862  8387 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.139431  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.092206  8398 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.142446  3998 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:33.144076  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.144743  3996 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 2.
I20260709 12:22:33.144783  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.125520  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.147192  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.147554  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.147852  3999 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:33.142798  8424 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.148756  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:33.150241  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.148845  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.148926  8424 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.155069  8377 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.155722  8377 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.156286  8377 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.154981  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.164940  8413 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:33.165407  8413 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:33.165786  8413 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.169378  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.169539  4548 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.171434  8374 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:33.173919  4548 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:33.174988  8413 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.175848  8374 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:33.176293  8374 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.176678  8374 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.177325  8413 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.178905  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.180539  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.182124  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.183658  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.184959  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.220822  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.191967  8377 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.220525  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.222711  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:33.220242  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.223660  8377 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.223737  3996 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:33.201084  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.195252  8374 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.225041  3962 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.225625  8417 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:33.228981  4583 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:33.229383  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.228855  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.232227  8413 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:33.232731  8413 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:33.232873  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.233690  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.234658  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.235483  8388 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:33.235867  8388 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.236231  8388 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.240242  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:33.241287  8393 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:33.241701  8393 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.242084  8393 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.242584  8422 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:33.243559  8374 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.244233  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:33.248469  8413 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.247876  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.249969  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.250730  3996 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
W20260709 12:22:33.196369  8425 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:33.251291  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.254916  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.254583  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:33.258337  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.258448  8424 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.259745  3921 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:33.199712  8398 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.263765  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.252369  8391 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.249114  8379 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:33.263082  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.249732  8384 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.268544  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.196988  8405 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.310199  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.320729  3999 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
W20260709 12:22:33.321420  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 66933.4us
I20260709 12:22:33.288975  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:33.283238  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.311323  2682 debug-util.cc:398] Leaking SignalData structure 0x7b0800391aa0 after lost signal to thread 3815
I20260709 12:22:33.275380  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.306541  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.327312  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.327484  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.328613  8389 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:33.329051  8389 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:33.329417  8389 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.330641  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.332787  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.334556  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.336197  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.338896  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:33.339174  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:33.339624  3847 raft_consensus.cc:606] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.339488  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:33.340827  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.340086  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.276080  8379 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:33.342994  8379 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:33.346247  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.346568  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.348649  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:33.268819  8391 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.351554  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.350171  3916 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:33.352579  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.353933  4583 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:33.326905  8384 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:33.263620  8423 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.359923  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:33.360085  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.361666  3847 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:33.362614  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.365978  8424 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.367344  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:33.353773  8391 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.361426  8384 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.379487  8423 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.385356  3998 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:33.387378  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:33.390466  3847 raft_consensus.cc:606] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:33.392766  3999 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:33.387814  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.399019  3999 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:33.401870  3999 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:33.405040  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.360786  8348 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:22:33.412943  3922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:33.420776  3922 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.419265  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.437661  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.441381  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.442487  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:33.444996  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.445873  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.452286  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:33.462975  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 99161.6us
I20260709 12:22:33.464928  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.467259  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.468822  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.472056  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.474047  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.474707  3998 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:33.481247  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.481395  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.483951  8424 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:33.484702  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.484922  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.485891  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.487918  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.491659  8405 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.497925  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.498227  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.499487  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.499688  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.500155  3995 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:33.500257  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.500435  3999 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:33.483850  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.501753  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.506718  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.507550  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.506958  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.508639  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.499779  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.510304  3996 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:33.516198  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.516578  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.518138  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.519377  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.521092  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:33.523712  8383 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:33.524148  8383 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:33.524518  8383 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.525095  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.516908  3991 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:33.526968  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.527055  8389 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.528014  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.522253  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.532014  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.532655  3998 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:33.547919  3920 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:33.554057  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.550233  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.556587  3844 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:33.557122  3998 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:33.537185  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.528465  8335 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.491300  8391 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.609905  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:33.559558  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:33.633113  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer bd47d64594f743eba2922d79251c1c5c from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:33.634904  8390 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.606163  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.528491  8393 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:33.636487  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77015.9us
I20260709 12:22:33.606441  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.637786  8390 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:33.638346  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.639067  8393 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.520458  8422 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:33.640276  3995 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:33.590548  8417 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:22:33.641286  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.636798  3841 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:33.576822  8379 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.643262  3847 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:33.641415  8374 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:33.591741  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.644302  8374 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:33.644604  3998 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:33.645875  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.560931  8407 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.545912  8337 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:33.647728  8337 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.648187  8337 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:33.649689  8398 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:33.649802  8384 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.651684  3843 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.652076  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.566476  8389 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.645536  8374 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.574363  8413 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:33.657716  3990 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:33.609000  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.658987  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.561544  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.660112  3997 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:33.660338  3994 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:33.651139  8398 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:33.636505  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.668098  8398 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:33.668324  8384 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.668998  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.669260  8398 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.634982  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.670200  8417 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:33.670724  8398 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:33.671012  3993 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:33.672086  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.656651  8374 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:33.676607  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.548101  8410 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:33.528380  8388 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.679294  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.681316  8388 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:33.682096  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.682186  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.661269  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.565042  8416 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:33.592099  3996 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.684257  8416 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.684360  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.685016  8416 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.685177  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.685722  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:33.686132  3996 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:33.661646  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.687016  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.690042  8391 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:33.693660  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.687021  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.561618  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.659623  8373 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:22:33.662446  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 112323us
I20260709 12:22:33.666100  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.667508  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.678270  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:33.683248  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.661316  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.670316  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.688038  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.697796  3991 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:33.687959  3850 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.569906  8383 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.688299  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:33.701891  8405 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:33.702632  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:33.702792  3849 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:33.703307  8428 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:33.703784  8428 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:33.704771  8428 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.705516  8389 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:33.706010  8389 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:33.702688  3998 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:33.706066  8383 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.706451  8389 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:33.706015  8428 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.709759  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:33.716053  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.723563  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.730093  3996 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:22:33.732429  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.733747  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:33.734412  8393 raft_consensus.cc:993] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
W20260709 12:22:33.738759  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74092.1us
I20260709 12:22:33.740837  3814 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:33.739199  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81239.4us
I20260709 12:22:33.751056  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.749640  8380 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.758669  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.763789  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.739589  8348 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:22:33.766388  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:33.752306  8391 raft_consensus.cc:1081] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:22:33.754328  8394 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:33.747939  8424 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:22:33.761014  8401 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.742404  8410 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:22:33.745839  8422 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:33.755131  8413 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:33.780829  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.792744  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.785673  8374 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:33.786295  8432 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:33.748212  8407 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:22:33.768092  8384 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:33.786244  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 91258.3us
I20260709 12:22:33.769810  8431 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:33.795953  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.788939  8430 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.792251  8387 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:33.808425  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.794754  8374 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:33.800567  8423 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:33.812944  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.802665  8431 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:33.816869  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:33.806418  8413 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:33.819104  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.849066  3849 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:33.849476  3843 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:33.928088  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109031us
I20260709 12:22:33.928993  3964 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.930474  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:33.838188  8437 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:22:33.932314  8408 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.815523  8394 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:33.815187  8405 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:33.816704  8379 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:33.840878  8432 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:33.951655  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 198813us
W20260709 12:22:33.952677  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.954418  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:33.956801  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130391us
I20260709 12:22:33.958570  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:33.978551  3999 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:33.982054  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:33.926714  8389 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:33.987915  8374 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:33.949149  8408 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:33.951107  8413 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:33.819578  8414 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:34.114811  8423 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:22:33.843528  8431 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.497321  8431 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:33.951023  8432 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:34.499660  8432 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:34.400133  8337 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.005s
W20260709 12:22:34.512785  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 582166us
W20260709 12:22:34.356297  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.413417  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:34.428334  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 468820us
I20260709 12:22:34.517464  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:34.444770  8410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.006s
W20260709 12:22:34.519763  8410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.006s	sys 0.006s
I20260709 12:22:34.520318  8446 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:34.472236  8434 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.443817  8417 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:34.521672  8434 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:34.521901  8417 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:34.523563  8417 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.434057  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:34.514310  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.512122  8337 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:34.503301  4576 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.525s	user 0.020s	sys 0.013s
W20260709 12:22:34.536397  8433 consensus_queue.cc:1175] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:34.538429  3847 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:34.539476  3814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.702s (SENT) [suppressed 1 similar messages]
I20260709 12:22:34.538751  8453 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:34.540392  8453 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:34.521031  8446 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:34.545739  4576 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:34.554004  8434 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.554898  8463 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.555721  8463 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.540408  8337 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.558326  8463 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:34.559008  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44937.8us
I20260709 12:22:34.570905  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.559635  8449 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:34.573339  8449 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:34.560453  8437 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:34.550385  8446 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.562927  8453 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.565040  8434 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.562232  8443 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:34.580080  8443 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:34.581601  8443 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.574724  8449 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.585448  8449 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.590843  8389 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.598242  3843 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:34.598384  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.599102  8440 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:34.599776  8440 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:34.601300  8440 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.599792  8373 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:34.604360  8373 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.606319  8440 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:34.607820  8423 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:34.608939  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.609020  8373 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.610621  8387 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:34.612004  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.614149  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.615929  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:34.618065  8416 consensus_meta.cc:287] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.020s
I20260709 12:22:34.621799  8416 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.623584  3843 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:34.624804  8380 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.862s	user 0.012s	sys 0.014s
I20260709 12:22:34.625422  8380 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:34.626334  3850 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:34.628340  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 78742.9us
W20260709 12:22:34.628968  3889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.010s	sys 0.007s
I20260709 12:22:34.583312  8443 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.636606  8335 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:34.637494  8398 consensus_meta.cc:287] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.019s
I20260709 12:22:34.641775  8374 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.643764  8437 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.645013  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.645205  8387 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:34.646205  8416 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:34.646906  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.647428  8448 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:34.643749  8453 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:34.676203  3993 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:34.676728  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.677662  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 2966) took 1066 ms. Trace:
W20260709 12:22:34.678633  4548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.009s
I20260709 12:22:34.679062  8448 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:34.680559  8448 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.682093  8448 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.651090  8460 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:34.684352  8460 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:34.685197  8460 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:34.685642  8460 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:34.686930  8460 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.688344  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.689631  8465 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:34.679124  4548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.010s
I20260709 12:22:34.657047  8377 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:34.670792  3889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.011s	sys 0.007s
I20260709 12:22:34.676071  8437 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:34.678156  3993 rpcz_store.cc:276] 0709 12:22:33.611895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.671826 (+ 59931us) service_pool.cc:224] Handling call
0709 12:22:34.677446 (+1005620us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400392454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:34.677581 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305223424}
I20260709 12:22:34.688545  8460 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.658572  8413 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:34.671125  8335 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:34.695338  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 955530us
I20260709 12:22:34.696373  8335 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.698192  8335 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.696869  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.702953  8450 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:34.705689  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:34.669272  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 129931us
I20260709 12:22:34.706796  8440 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.707348  8413 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:34.707861  8413 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:34.708007  8408 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:34.708503  8408 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:34.709327  8413 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.709635  8408 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.710896  8413 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:34.711017  8408 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.712885  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:34.718958  8394 consensus_meta.cc:287] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.772s	user 0.016s	sys 0.005s
I20260709 12:22:34.719359  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.722013  8390 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:34.726562  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.768031  8394 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:34.768955  3850 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:34.769048  8390 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:34.769493  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.732033  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:34.771196  8460 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.771689  8398 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:34.722399  8440 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:34.751320  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:34.758312  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:34.670390  8417 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.793705  8417 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.763916  8446 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.769616  8390 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:34.795374  8390 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.799209  8389 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:34.749418  8432 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.800031  8389 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:34.801566  8432 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.801244  8389 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.771153  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.774142  8450 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:34.775141  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 62441.5us
W20260709 12:22:34.787336  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 114288us
I20260709 12:22:34.788014  8434 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:34.807611  8434 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.808059  8434 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.808943  8446 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.790212  4575 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:34.804198  8390 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:34.804720  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.814489  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:34.815650  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44669.3us
I20260709 12:22:34.816114  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.816529  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.817677  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.818178  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.806794  4579 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:34.788537  8468 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:34.832090  8469 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:34.832640  8469 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.833031  8469 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.833811  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:34.834936  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.828871  8446 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:34.825263  8413 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.825076  8398 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:34.837857  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:34.841485  4547 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.841560  8433 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:34.842160  8433 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:34.842641  8433 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.826464  8431 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:34.843775  8431 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.843904  8417 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.844213  8431 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:34.843322  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.827780  8443 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:34.848618  8417 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:34.850613  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.827924  8432 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:34.860685  8432 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:34.860992  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.861099  8432 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:34.861824  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:34.851151  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.853297  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:34.854992  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.857550  8394 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:34.863430  8398 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:34.863912  8394 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:34.864086  8398 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.864956  8394 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.866094  8416 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:34.857882  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:34.866693  8416 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:34.857812  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:34.867941  8416 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.860162  8417 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.870527  8417 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.866525  8398 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:34.873749  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:34.875998  8448 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.876598  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.877763  8448 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:34.878263  8448 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.878742  8448 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.879566  3747 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 10, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.878394  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.889720  8450 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:34.889669  8446 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:34.892319  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.892642  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.893496  8433 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:34.896314  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78254.6us
I20260709 12:22:34.899422  8450 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:34.900631  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:34.911917  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55890.9us
I20260709 12:22:34.918294  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.910624  8450 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:34.919344  8443 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:34.919852  8450 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.921109  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.923568  8443 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:34.928694  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:34.930402  8443 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:34.932229  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:34.874698  8417 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.942319  8446 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:34.943604  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51086.4us
I20260709 12:22:34.944633  4547 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:34.947499  8445 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:34.937640  8390 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.937629  8443 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:34.953290  8434 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.955684  4579 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:34.957733  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:34.962744  4548 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:34.964697  8337 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:22:34.972044  8469 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:34.972499  8337 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:34.972896  8337 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:34.973899  8337 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:34.974438  8469 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:34.977955  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:34.971714  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:34.979346  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:34.966790  8374 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:34.981599  8337 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:34.986008  8469 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:34.992363  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 91851.2us
I20260709 12:22:34.960505  8431 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.004269  8433 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.005115  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:34.996294  8469 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.008220  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.008580  4575 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:35.008682  4579 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:35.009068  3848 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:35.010493  4579 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.011114  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.013598  8431 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.015507  4579 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:35.020720  8390 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:35.024148  8335 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:35.024626  8335 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:35.025674  8335 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.003101  8450 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.027521  8335 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.029498  8469 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:35.032234  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.995738  8434 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.014298  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.036441  4579 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:35.037429  8449 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:35.039248  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 107167us
I20260709 12:22:35.038223  8390 consensus_queue.cc:1059] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:22:35.054795  8422 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:35.055342  8390 raft_consensus.cc:3055] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:35.055697  8449 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:35.060075  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63366.1us
I20260709 12:22:35.041285  8469 consensus_queue.cc:1059] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:22:35.064523  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.061450  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.051851  8458 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:35.055310  8422 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.056257  8390 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:35.073975  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.066468  8458 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:35.066982  8422 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.063383  8449 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:35.084647  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.075635  8443 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:35.092810  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.087163  8450 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.097288  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.092078  8440 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:35.086436  8432 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.102491  8440 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:35.118852  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.106382  8468 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.120414  8469 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.100394  8448 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.156147  8407 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:35.156653  8407 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.157030  8407 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.160980  8432 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.120317  8408 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:22:35.163511  8458 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.170883  8458 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.176894  8435 raft_consensus.cc:3055] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.177385  8435 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:35.176641  3746 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 9 to 10, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.178382  8435 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.180377  8449 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:35.181226  4575 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:35.163563  8469 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.182613  4576 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:35.182621  8407 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.184644  8469 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.184592  8337 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:35.186347  8337 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:35.186712  8435 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.190147  8407 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.186781  8337 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:35.170114  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.192304  8337 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.193800  8337 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.200404  8443 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:35.200996  8443 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:35.202149  8443 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.204512  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.205137  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.204008  8443 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:35.109088  8390 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.220666  8390 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.228811  8335 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.229498  8335 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.233178  8335 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.233556  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.233731  8335 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.234494  8335 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.237505  8335 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:35.238950  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 155384us
I20260709 12:22:35.239887  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.240775  8335 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:35.241153  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.241638  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:35.242161  8469 raft_consensus.cc:993] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:22:35.241161  8335 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:35.242990  8475 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:35.243713  8335 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.243607  8440 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.245223  8440 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.251904  8468 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.254313  8468 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:35.258239  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.255055  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:35.261654  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.268421  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:35.269676  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.260183  8449 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:35.271860  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:35.264163  8469 raft_consensus.cc:1081] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:22:35.278779  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 108770us
I20260709 12:22:35.279791  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:35.267407  8408 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.270396  8407 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:35.285029  8416 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:35.286741  8416 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.289026  8416 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.292507  8448 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.292162  8407 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.294822  8407 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:35.297122  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.297362  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.298484  8468 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:35.299681  8408 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:35.300938  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.301016  8398 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:35.301364  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:35.301623  8398 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:35.302249  4575 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:35.302357  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:35.303145  8413 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:35.302933  8398 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.305689  8398 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.305725  4576 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:35.306361  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.307972  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.309460  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.309495  8394 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:35.311062  8458 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:35.311672  8469 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:35.312218  8435 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:35.313870  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.314790  8413 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.315265  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.315686  8413 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:35.316603  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:35.316565  8413 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:35.313880  8435 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.320231  8435 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.317889  8443 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.316542  3890 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.323621  8469 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:35.325021  3890 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.326107  8469 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:35.327325  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.329861  8469 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.331792  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:35.333215  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.334932  8335 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.283617  8422 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.338722  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.338762  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:35.339737  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.342453  8469 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:35.344019  8443 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:35.345912  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.327214  3850 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:35.349378  8335 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.354666  8440 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:35.354452  8435 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:35.337551  8422 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.359903  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.361933  4579 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:35.335150  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.367892  8335 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:35.374589  8348 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:35.378536  8348 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:35.379055  8348 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:35.380259  8348 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.382328  8348 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.375677  8422 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:35.376866  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:35.388388  8432 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:35.389108  8432 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:35.390239  8432 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.391695  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:35.392320  8394 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:35.398404  4579 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:35.400645  8416 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:35.401087  8469 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:35.401242  8335 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:35.401798  8469 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:35.402297  8335 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.402990  8469 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.404888  8469 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.377121  8435 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.407112  8435 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:35.408694  8435 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:35.409590  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.412590  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.423162  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.444911  8469 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:35.451159  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.460011  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.460749  3921 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.460971  3993 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:35.463094  3918 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:35.453233  8469 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.474081  4574 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:35.475510  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.475652  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.476225  3995 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.476454  3998 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.478941  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.479416  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.479796  3990 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:35.479974  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.480165  3996 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.480675  3997 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.480983  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.481079  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.464020  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:35.488597  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.485334  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.495293  3992 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.495896  3994 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.485564  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.497184  3999 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.495366  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.500656  3991 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:35.501816  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.508450  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.509156  3918 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.509167  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.511646  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.511960  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.512362  3920 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.512650  3925 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.515725  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.515879  3919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:35.516727  3919 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.517118  3919 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.518244  3916 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.516180  3917 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.519507  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.520263  3924 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.526338  8435 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:35.529249  3992 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:35.530640  3993 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:22:35.532853  3995 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:22:35.532358  3991 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.532951  3994 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:22:35.533697  3997 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:35.535981  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:35.537200  3999 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:35.538183  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.541085  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.542270  3917 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:22:35.543684  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:35.532642  8416 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:22:35.549381  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.550076  3997 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:35.549603  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.551875  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.548642  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:35.557032  3918 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:35.558461  3999 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:35.558605  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.559831  3995 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:35.534785  3919 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.560791  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.561278  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:35.561558  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.562146  3991 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:35.562918  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.563333  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.564077  3997 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:35.564834  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.566715  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.567363  3996 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:35.568552  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.569362  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.570807  3991 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:35.570000  3996 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:35.575798  3998 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:35.578860  3997 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.583886  3925 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.587628  3924 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 7.
I20260709 12:22:35.578022  8469 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:35.589178  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.589906  3999 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:35.591593  3919 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.557127  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.592483  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:35.592907  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.593403  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:35.593595  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.591100  4547 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.594424  3920 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:35.593604  3993 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:35.595386  3995 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:35.598519  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.600162  3990 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:35.601416  3923 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.602376  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.605355  4547 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:35.610114  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.614075  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.507916  8335 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.615921  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.613101  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:35.616495  3923 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:35.616647  3994 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:35.618465  3995 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:35.619268  3996 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.620889  3850 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:35.623641  3850 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:35.621176  3990 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.625372  3999 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:35.626610  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.623202  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:35.619097  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.613101  8440 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:35.629096  3746 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 6 to 7, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 7 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:35.638598  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.631108  3917 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 11. Ops: []
I20260709 12:22:35.628049  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.637885  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.638645  3993 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:35.629705  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.619410  8431 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:35.645390  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.621764  8416 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:35.643236  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.650064  3999 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:35.618021  8337 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:35.643368  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.646076  3998 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:35.647722  3992 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.647847  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.648311  3995 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.648546  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:35.661120  3994 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:35.661958  3917 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.651238  3850 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.666213  3999 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:35.668895  3990 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:35.669346  3996 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.670312  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:22:35.671114  3998 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.671620  3998 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.648422  8431 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:35.682515  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54543.4us
I20260709 12:22:35.653581  8413 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:35.664836  8434 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.706424  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.707154  3997 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:35.708881  3850 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.716648  3995 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:35.672813  8416 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:35.720731  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:35.721560  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.681586  8389 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:35.722689  3850 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:35.718686  3998 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.686316  8431 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.777711  3999 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:35.781423  3921 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:35.784489  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 156723us
W20260709 12:22:35.718415  8471 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:22:35.740826  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.800196  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:35.778553  3917 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:35.779856  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.777882  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.801726  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 196430us
I20260709 12:22:35.803014  4547 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:35.714272  8394 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:35.776919  8474 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:35.809993  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:35.812350  3992 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
W20260709 12:22:35.816707  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 193571us
I20260709 12:22:35.817569  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:35.731374  8434 raft_consensus.cc:697] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:35.777455  8389 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:35.782423  8435 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:35.827908  3998 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:35.829053  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:35.831017  3923 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:35.833963  3997 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:35.808983  8417 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.808292  8337 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:35.850735  8416 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:35.851393  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.851665  8337 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.848729  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:35.818841  8440 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:35.854018  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.857425  3923 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.838289  8389 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:35.862634  8491 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.870879  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:35.882977  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:35.889333  3920 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:35.899256  3918 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:35.908174  3920 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:35.893447  8490 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:35.909844  8490 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:35.910807  8490 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.911679  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.917369  8499 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.918095  8499 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.885649  8440 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:35.921401  8440 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:35.923895  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.932971  8434 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.941147  8489 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:35.941715  8489 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:35.942339  8431 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.942660  8489 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:35.891219  8335 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:35.952078  3923 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:35.954627  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.955560  3991 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.943190  3918 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:35.924068  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:35.962989  3992 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.869787  8498 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:35.992044  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:35.982884  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.995873  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.997613  3848 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:36.003599  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.858182  8417 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.006955  3917 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:36.007359  3920 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:36.014796  3992 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
W20260709 12:22:36.008355  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 179368us
I20260709 12:22:36.022408  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:36.004824  8498 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:36.061712  3991 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:36.070366  3848 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
W20260709 12:22:36.110621  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.117504  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45987.5us
I20260709 12:22:36.057816  8499 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.134301  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:36.146325  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 124012us
I20260709 12:22:36.147425  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:36.134977  8479 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:22:36.149228  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 142114us
I20260709 12:22:36.133724  8435 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.143386  8478 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:22:36.154982  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:36.166043  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 348535us
I20260709 12:22:36.171900  8335 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.172080  8390 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:36.172574  8390 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:36.172755  8515 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:36.172515  8335 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.173125  8390 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:36.173298  8515 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:36.174299  8515 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.175055  8335 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.180440  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.136503  8337 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:22:36.192338  4576 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:36.193190  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.151149  8413 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:36.209869  8495 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:36.209878  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.216410  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.183288  8512 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:36.198436  8335 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.218365  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:36.167362  8435 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.238206  8440 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:36.214596  8413 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:36.262436  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:36.219643  8520 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:36.218998  8469 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:36.271386  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.272171  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:22:36.275228  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:36.276057  8504 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:22:36.276340  3997 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:36.278453  8508 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:36.278884  8508 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.275480  8505 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:22:36.287485  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71129.5us
I20260709 12:22:36.288981  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.269395  8394 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:36.271703  8469 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:36.281831  8492 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:22:36.268512  8337 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.286700  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:36.224181  8499 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:22:36.298872  3844 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:22:36.269196  8440 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:36.285641  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:36.268577  8512 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:36.272209  8520 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:36.303431  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96963.6us
I20260709 12:22:36.307359  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:36.306972  8440 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:36.309000  8516 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:36.311548  8431 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.312698  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:36.314136  8509 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:22:36.296150  8469 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:36.315658  4547 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.317602  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.319700  3920 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:36.222474  8498 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.308298  8520 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:36.318759  8432 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:36.348340  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68085.5us
I20260709 12:22:36.338045  8515 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.340813  8491 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:36.357437  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:36.351212  8485 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:36.346321  8432 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.294202  8508 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.340026  8519 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:22:36.351264  8522 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:36.370726  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:36.379238  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80684.2us
I20260709 12:22:36.362979  8432 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.343885  8413 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.392582  8398 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.394732  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44204.6us
I20260709 12:22:36.395865  8390 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.396719  8522 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.398782  8417 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:36.369663  8523 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:22:36.369470  8507 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:36.419577  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68733.7us
W20260709 12:22:36.418295  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.388774  8435 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.387547  8485 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.399649  8530 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.426723  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:36.421715  8389 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.003s
I20260709 12:22:36.427906  3920 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
I20260709 12:22:36.436229  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:36.436507  8528 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:36.431892  8530 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.441061  8390 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.444238  8348 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:36.445699  8440 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.446472  8522 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.436074  8494 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:36.422585  8398 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.426782  8499 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:36.429620  8508 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:36.437296  8416 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:22:36.388513  8512 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.434307  8435 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.471378  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.472003  8533 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.465353  8348 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.434762  8389 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.494437  8493 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:36.494236  3744 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 11, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.495605  8493 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:36.495860  8389 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.495994  8493 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.455689  8485 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.497078  8493 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.498528  8493 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.492197  8533 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.501217  8520 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:36.486819  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 186330us
I20260709 12:22:36.504312  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.475617  8440 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.483616  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.505504  3841 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:36.506424  8335 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:36.506961  8335 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:36.507848  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.508697  3843 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 5: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:36.508139  8335 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.480520  8491 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:36.511560  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:36.487224  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.479254  8494 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:36.496999  8408 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.506896  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:36.481665  8522 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.515650  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:36.525947  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 89801.1us
I20260709 12:22:36.531087  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.530164  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.532792  3843 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:36.511935  8491 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:36.533789  8491 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.520689  8494 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.536398  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:36.547960  8533 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.521142  8440 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.555704  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.557040  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.557915  8537 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:36.489707  8435 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.527889  8520 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.570329  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.573163  8544 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:36.574818  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.577047  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.580756  3889 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:36.582492  3920 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:36.586048  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.586932  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.527273  8507 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:22:36.600090  3848 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:36.530989  8416 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:22:36.497108  8348 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:36.617421  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88524.2us
I20260709 12:22:36.528084  8408 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.531210  8522 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.574710  8533 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:36.578056  8390 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:36.588665  8528 raft_consensus.cc:2764] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Leader election decision vote started in defunct term 10: won
I20260709 12:22:36.587782  8394 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:36.673525  8394 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.674523  8394 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.676280  8394 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:36.608422  8520 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:36.570673  8440 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.664851  8522 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.667292  8548 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.667933  8524 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:36.668325  8536 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.668751  8502 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.668965  8435 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:36.670136  8540 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:22:36.670235  8534 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:22:36.670812  8501 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:36.725617  8501 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.727589  8505 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:36.728082  8505 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.656796  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:36.728935  8505 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:36.729746  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 73079us
I20260709 12:22:36.730612  8505 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:36.688026  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 94836.7us
I20260709 12:22:36.731608  8522 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:36.732129  8539 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:36.732239  8522 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.733466  8389 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:36.734059  8389 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:36.734483  8389 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:36.734690  8492 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:36.734939  8522 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.735159  8492 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.735659  4576 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:36.735749  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.736164  8492 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.689296  8537 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:22:36.647320  8431 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:22:36.704322  8348 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:36.675180  8491 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.731287  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:36.704489  8508 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:36.740480  8508 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.740772  8491 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.740935  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:36.741458  8491 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:36.741394  8508 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.741986  8491 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:36.742427  3843 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:36.742797  8508 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:36.745241  8440 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.745645  8507 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:36.746181  8507 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.709040  8390 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:36.747130  8507 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.748420  8390 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.750383  8530 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.737772  8492 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:36.741884  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:36.707289  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.754881  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:36.752597  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 171963us
I20260709 12:22:36.756731  3890 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:36.705967  8499 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:36.763041  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:36.704697  8524 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.763509  8416 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:36.707258  8443 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.768247  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.772001  3843 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:36.776538  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:36.777321  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 256059us
I20260709 12:22:36.742446  8491 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:36.751190  8522 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.789865  3917 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:36.728950  8501 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:36.793527  3925 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:36.767926  8533 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:36.771059  8524 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:36.761129  8398 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:36.801083  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.926213  4576 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:36.792791  3924 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:36.836447  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:36.709645  8548 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.717485  8536 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.838748  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.930625  8548 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:36.753131  8502 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.930634  8536 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.933024  8502 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:36.789167  8394 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:36.790884  8530 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.933777  8530 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.830041  8525 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:36.935670  8525 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.936061  8525 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:36.842252  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.785140  8443 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.852392  8408 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.791596  8522 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:36.940460  8530 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.941300  8522 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:36.863639  8531 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:36.863863  8499 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.942080  8531 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:36.943075  8531 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.945873  8533 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.871837  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:36.868304  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:36.948184  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 79969.9us
I20260709 12:22:36.792384  3917 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:36.877357  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.950291  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.951164  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.915977  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 153008us
I20260709 12:22:36.843540  8532 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.785010  8440 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 12:22:36.920773  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.882767  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.957072  8530 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.957335  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.968658  3843 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:36.968794  3924 raft_consensus.cc:2376] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13. Re-sending same reply.
I20260709 12:22:36.957731  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.969923  3925 raft_consensus.cc:2376] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9. Re-sending same reply.
I20260709 12:22:36.958561  8443 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:36.960197  3923 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:36.972618  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:36.973969  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.957093  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:36.918632  8469 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 12:22:36.966575  3917 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:36.968240  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.985776  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:36.986438  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.986701  3997 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:36.970304  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:36.876889  8507 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:36.968701  8530 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:36.963474  8543 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.963940  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.975911  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.000228  3920 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:37.001573  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.002298  3997 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:36.972680  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:36.988365  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:36.985762  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:36.957125  8408 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:37.009120  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.009222  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.992359  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:36.994154  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:36.974947  3919 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.996555  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:37.003548  3998 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:37.004122  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.054556  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.004711  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.055308  3993 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.004942  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:37.005291  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.056514  3994 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:37.055347  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59485.7us
I20260709 12:22:37.006807  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.057693  3996 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 3.
I20260709 12:22:37.057638  3920 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:37.007346  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.058866  3992 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:36.998184  4576 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:37.025599  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.050652  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.060163  3999 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:37.061336  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.048986  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:36.918923  8494 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.062148  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:37.056032  3916 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:37.063488  3997 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:37.062901  3923 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:37.064113  3845 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:37.061563  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.067566  8551 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.068045  8529 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:22:37.068462  3917 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:37.068346  8551 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.069829  8536 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:37.070269  8536 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.070648  8536 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.072388  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.073153  3842 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:37.073922  8398 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.074059  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.074615  8398 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.061245  8443 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.075884  8443 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.077183  8535 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.078192  3925 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:37.067826  3999 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:37.064630  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.081171  3991 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:37.083011  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.959276  8532 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.090591  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.091315  3996 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:37.088229  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:37.093511  3924 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:37.093950  3844 raft_consensus.cc:606] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:37.096127  3997 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:37.008694  8408 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.067632  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.106647  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:37.107587  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.058768  8440 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:36.990228  8469 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.113850  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:36.997006  8507 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.132939  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.133594  3842 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:37.134492  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.134829  8507 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.114461  3841 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:37.113551  3845 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:37.135984  3843 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:37.136085  8532 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.136960  8413 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.137508  8413 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.110767  3846 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:37.061059  8433 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.119240  8558 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.139341  8433 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.139811  8558 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:37.140925  8337 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.004s
I20260709 12:22:37.141346  8337 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:37.141579  8433 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.142109  3850 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:37.142230  8558 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.077766  8535 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:37.143726  8563 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:22:37.145208  8535 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.113511  8408 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:37.120844  8560 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:22:37.122924  8398 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:37.123215  8545 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:37.010283  8543 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:37.127821  8432 consensus_meta.cc:287] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.712s	user 0.003s	sys 0.009s
I20260709 12:22:37.008710  8522 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:22:37.128190  3993 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:37.097599  8389 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.130956  8494 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.078075  8443 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.148864  4574 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:37.155277  8552 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.188593  8552 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.157873  8413 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.127141  8525 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.159559  8551 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.164286  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.167740  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.195372  3919 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 5.
I20260709 12:22:37.180928  3994 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:37.197763  3992 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:37.198503  3919 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:37.182219  3998 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:37.183327  8532 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:37.183552  8543 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.185762  8389 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.186561  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:37.200773  3917 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:37.187762  3849 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:37.191769  3993 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:37.193660  3842 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:37.193923  3924 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:37.193408  8408 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.194077  8552 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.204695  3998 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:37.206619  3918 raft_consensus.cc:2368] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14.
I20260709 12:22:37.208977  8408 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.210018  3990 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:37.191619  8416 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:37.152230  8440 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.162384  8491 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.223831  3847 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:37.212693  4548 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:37.167384  8432 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.200161  8532 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:37.241171  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:37.244386  3998 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:37.246799  8549 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.237740  8537 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.247546  8549 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.247859  8537 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.249790  8549 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.249846  8491 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.250758  8537 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.255890  3850 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:37.269107  4575 raft_consensus.cc:2368] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:22:37.241176  8515 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:37.271095  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 133003us
I20260709 12:22:37.273607  8533 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.229547  8551 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:37.268875  8537 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:37.284302  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52492.2us
I20260709 12:22:37.285564  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:37.270377  8549 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.288688  8549 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.291627  8498 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.292011  8335 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:37.292469  8335 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.292282  8498 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.292833  8335 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:37.298234  8498 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.301604  3889 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:37.308118  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.308897  3848 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:37.303114  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:37.310151  3925 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:37.276706  8515 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.310392  4547 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:37.312976  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.266345  8536 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.311689  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.319023  4579 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:37.313165  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.315294  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.315209  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:37.315974  3844 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:37.308480  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:37.316258  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:37.334554  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.346848  3841 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:37.347270  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:37.321149  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:37.277783  8524 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.345798  3847 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:37.312119  8548 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.291426  8549 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.313910  8515 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.346815  3846 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.311404  8556 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:37.283996  8533 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.312768  8512 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:37.348626  8537 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:37.354640  8529 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.352687  8501 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:37.368227  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.316438  8433 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:22:37.311703  8532 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.398712  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.358770  8556 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.367944  8537 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.369760  8520 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:37.358632  8434 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:22:37.379093  8533 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:37.375072  8568 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:22:37.380764  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 134400us
I20260709 12:22:37.382638  8524 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.388504  8536 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.357309  8548 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.372689  8501 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.390518  8515 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.392659  8440 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.393386  8432 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.394424  8529 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:37.394503  8525 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:37.397894  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 198968us
I20260709 12:22:37.489336  8335 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.493487  3999 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:37.494082  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:37.494637  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.457670  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:37.466681  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68078.6us
I20260709 12:22:37.495307  8555 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:37.495836  8543 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:37.496533  8543 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:37.473053  3994 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:37.497570  8543 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.499030  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.427026  8502 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:37.499603  8408 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.500053  8502 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.476312  3998 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:37.500274  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.501223  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.501906  3998 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:37.501606  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.502975  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:37.503436  8558 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.504033  8558 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.499634  8416 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:22:37.506363  8558 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.508953  8515 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.510144  8335 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:37.511593  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a268ae9485472a8208827344502203"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:22:37.512300  3925 raft_consensus.cc:606] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:37.512681  3925 raft_consensus.cc:614] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:37.513110  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.513679  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.514127  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.428632  8537 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:37.479838  8535 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.516984  8535 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.473793  8532 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.480489  8501 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:37.473486  8570 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:37.531620  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.531935  8570 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.533154  3994 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.534574  8570 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.536610  3922 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:37.495965  3918 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.458357  8520 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:37.539698  8520 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.539983  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.540871  3990 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:37.542354  3990 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:37.539724  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.548799  3744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 263) took 1260 ms. Trace:
I20260709 12:22:37.519305  8535 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.467638  8398 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:37.551986  8398 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.552414  8398 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:37.553931  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:37.554812  3845 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.555821  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.556520  3848 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:37.557581  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.558250  3848 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:22:37.558687  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 714) took 1080 ms. Trace:
I20260709 12:22:37.557767  3747 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 10 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.559090  4575 rpcz_store.cc:276] 0709 12:22:36.478597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.478793 (+   196us) service_pool.cc:224] Handling call
0709 12:22:37.558452 (+1079659us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54005e01d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:37.558593 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739682048}
I20260709 12:22:37.560961  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.500229  8408 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.457484  8443 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.573020  8443 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.574836  8502 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:37.576169  8469 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.489980  3993 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:37.428402  8556 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.491789  3996 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:37.456951  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 105707us
I20260709 12:22:37.499435  8494 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:37.580279  8494 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:37.580703  8494 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:37.484985  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.583626  8577 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.583977  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:37.584209  3990 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:37.584331  8577 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:37.559198  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.585772  3890 leader_election.cc:400] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:22:37.586139  3890 leader_election.cc:403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:37.586303  3848 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:37.486599  3992 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:37.587330  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.490716  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:37.589136  3997 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:37.537040  3922 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:37.592175  3918 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
W20260709 12:22:37.596127  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.602861  3846 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:37.590919  3922 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.608973  3922 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:37.609824  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.617360  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.618564  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.619302  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.620554  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.621124  3848 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:37.625469  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.623262  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:37.627483  3848 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:37.630584  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:37.630636  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45062us
I20260709 12:22:37.632141  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.636090  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.636868  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:37.637935  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:37.638928  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.640957  4576 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:37.641651  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:37.642534  4575 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.646291  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:37.638574  3849 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:37.615171  8535 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:22:37.551043  3994 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:37.660904  3998 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:37.628707  8549 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:37.667953  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:37.669757  3815 leader_election.cc:336] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.688s (SENT)
I20260709 12:22:37.709964  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:37.629370  8570 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:37.682401  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.626911  8536 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:37.712266  8536 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.712800  8536 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:37.711771  8570 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:37.716089  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 213031us
I20260709 12:22:37.716101  8570 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:37.719060  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:37.725955  8525 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:37.726514  8525 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.726959  8525 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:37.731710  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49422.2us
I20260709 12:22:37.732996  8524 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:37.734503  8440 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:37.734982  8440 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:37.735950  8440 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.751135  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.753592  4548 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:37.635663  8390 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 5. Current term is 6.
I20260709 12:22:37.758106  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.760179  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.761365  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:37.762065  3846 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.763386  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.768916  3847 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:37.769560  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:37.774013  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52246.1us
I20260709 12:22:37.773641  3842 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:37.773823  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 426591us
I20260709 12:22:37.549229  3744 rpcz_store.cc:276] 0709 12:22:36.288243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.288475 (+   232us) service_pool.cc:224] Handling call
0709 12:22:37.548703 (+1260228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:36.665542 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:36.666191 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:36.666228 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:22:36.666249 (+    21us) tablet.cc:662] Decoding operations
0709 12:22:36.666608 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:36.666664 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:36.666698 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:36.666914 (+   216us) tablet.cc:701] Row locks acquired
0709 12:22:36.666941 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:22:36.667109 (+   168us) write_op.cc:270] Start()
0709 12:22:36.667247 (+   138us) write_op.cc:276] Timestamp: P: 1783599756667042 usec, L: 0
0709 12:22:36.667273 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:22:36.864923 (+197650us) log.cc:844] Serialized 538 byte log entry
0709 12:22:36.866725 (+  1802us) op_driver.cc:464] REPLICATION: finished
0709 12:22:36.938195 (+ 71470us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529eee28 00007fdc56429581 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901 00007fdc5642cb2d 0000000000388634 0000000000388479
0709 12:22:37.090302 (+152107us) write_op.cc:301] APPLY: starting
0709 12:22:37.098776 (+  8474us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:37.121607 (+ 22831us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:37.121638 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:37.158851 (+ 37213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:37.159077 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:22:37.159131 (+    54us) write_op.cc:312] APPLY: finished
0709 12:22:37.159347 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 12:22:37.159550 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:37.159632 (+    82us) write_op.cc:454] Released schema lock
0709 12:22:37.159676 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:37.160120 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:37.160148 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":142685,"apply.run_cpu_time_us":5033,"apply.run_wall_time_us":98015,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":168173,"prepare.run_cpu_time_us":5777,"prepare.run_wall_time_us":272876,"replication_time_us":199310,"spinlock_wait_cycles":124556416,"thread_start_us":172376,"threads_started":2}]]}
I20260709 12:22:37.771858  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:37.777156  3848 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:37.778486  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 148353us
I20260709 12:22:37.780290  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.705071  8335 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:37.786928  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:37.814100  3916 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.747880  8558 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:37.814100  3841 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:37.815873  4575 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:37.840725  3842 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:37.828480  3846 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
W20260709 12:22:37.830536  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 160830us
I20260709 12:22:37.831518  8548 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.848485  8548 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:37.849067  8548 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.849519  8548 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.749398  8398 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.852548  8570 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.854385  8398 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.854938  8570 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.859647  8416 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:37.863726  8542 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:22:37.770470  8574 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:22:37.834178  8530 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:37.752518  8512 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:37.748328  8549 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.769795  8498 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:37.832650  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:37.837394  8573 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:22:37.889726  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 135080us
I20260709 12:22:37.915405  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:37.919600  4575 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:37.659521  8494 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.760725  8515 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 12:22:37.925850  3848 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:22:37.893735  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135747us
I20260709 12:22:37.893004  8335 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:37.893893  8512 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.941794  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.896747  8549 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:37.949843  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.934868  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:37.867115  8544 consensus_queue.cc:1059] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:22:37.947310  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:37.947297  3919 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:37.905486  8528 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.952251  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:37.967555  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:37.968779  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:37.970744  3916 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
W20260709 12:22:37.951323  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 195319us
I20260709 12:22:37.882982  8469 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:22:37.894471  8390 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:22:37.977034  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 130597us
I20260709 12:22:37.942487  8555 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.980270  3845 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:37.923081  8498 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:37.981805  3922 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:37.944273  8443 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:37.950053  8335 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.952512  8512 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:37.991560  4575 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:37.960459  8522 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:37.995702  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2400) took 1193 ms. Trace:
I20260709 12:22:37.997793  3922 rpcz_store.cc:276] 0709 12:22:36.794812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.794939 (+   127us) service_pool.cc:224] Handling call
0709 12:22:37.536470 (+741531us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b540048b0a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296adc0 00007fdc529f6e18 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:37.987814 (+451344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176735488}
W20260709 12:22:38.007901  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.976614  8511 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:22:38.033862  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:38.035815  3845 raft_consensus.cc:606] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:38.037178  3845 raft_consensus.cc:614] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:37.999882  8443 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.057396  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:37.991925  8591 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:37.993974  8531 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:22:37.998054  8335 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:37.981282  8528 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.060092  3844 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:38.040063  8544 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:38.003764  8522 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.023592  8491 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:38.007426  8583 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:38.059486  8501 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
W20260709 12:22:38.066443  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 278972us
I20260709 12:22:38.026948  8589 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:37.992348  8555 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:37.994743  8525 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.028502  8533 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:22:38.063961  8591 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.042009  8576 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:37.997767  8581 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 12:22:38.082647  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 305062us
I20260709 12:22:38.083824  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.101540  3990 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:38.105432  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:38.109282  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:38.075989  8522 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.110255  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.073001  8544 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:38.110404  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.113230  3998 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:38.111219  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:38.003258  8536 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.067715  8443 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.115887  3992 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
W20260709 12:22:38.124320  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 155579us
W20260709 12:22:38.102259  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 269696us
I20260709 12:22:38.119328  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:38.124244  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.132411  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:38.133364  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.107249  8595 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.101280  8592 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.136366  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:38.107553  8591 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.113696  8543 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.076444  8556 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:38.130607  8520 consensus_meta.cc:287] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.002s
W20260709 12:22:38.147296  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.082262  8583 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.159739  8440 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.100981  8589 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.158152  3845 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:38.118171  8586 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:38.082472  8501 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.144024  8543 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:38.169997  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50780.7us
I20260709 12:22:38.142318  8533 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:38.081229  8498 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.132855  8417 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:22:38.196970  3924 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:38.142000  8594 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:38.147845  8530 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:22:38.170204  8413 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:38.210942  4583 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:38.171187  8398 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:38.214210  3844 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:22:38.153368  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.216557  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80281.4us
W20260709 12:22:38.218300  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 241809us
I20260709 12:22:38.220006  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:38.198952  8533 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:38.165714  8520 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.235116  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:38.205055  8586 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:38.149904  8595 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.214346  8413 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:38.270144  3922 raft_consensus.cc:1240] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:38.161010  8544 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.218789  8599 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:38.311499  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.312980  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.313827  8501 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:38.320833  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 122433us
I20260709 12:22:38.240000  8533 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.320256  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.321997  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.269567  8413 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.314666  8525 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.330833  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.268975  8511 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:38.331363  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 222150us
I20260709 12:22:38.331707  3848 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.332777  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.334460  3850 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.310068  8599 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.336844  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.337184  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.342221  3843 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.344887  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.347935  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.316351  8601 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:38.329847  8528 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.366531  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:38.345286  8587 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:22:38.333819  8491 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:38.345108  8544 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.335021  8555 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.352942  8594 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.346524  8599 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.404857  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.363826  8536 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.349407  8596 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:38.409679  8596 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:38.353057  8511 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:38.409548  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 174524us
I20260709 12:22:38.420975  8595 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.377336  8528 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:38.372886  8592 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:38.433401  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:38.434363  3850 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:38.434919  3917 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:38.438148  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.438767  3917 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:38.439797  3849 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:38.409485  8593 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.440320  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.368121  8525 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:22:38.448110  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.443742  3848 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:38.414198  8443 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.444455  8612 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:38.413990  8604 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:38.448808  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.452919  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.429405  8591 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.454789  3917 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:38.434870  8556 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:38.456837  8543 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:38.455966  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 302958us
W20260709 12:22:38.457850  8502 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.882s	user 0.014s	sys 0.000s
I20260709 12:22:38.458294  8502 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.460250  3998 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:38.460503  3993 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:38.437124  8595 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:22:38.461766  8595 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:38.462128  8595 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:38.463742  3998 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:38.463131  8512 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.466323  4579 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:38.469583  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:38.448130  8537 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.933s	user 0.013s	sys 0.000s
I20260709 12:22:38.429836  8594 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.481528  3992 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:22:38.483191  8611 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:38.474483  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:38.477444  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:38.451409  8592 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.480052  8604 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.519322  3990 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:38.480537  8588 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.480738  8612 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.406376  8586 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.439139  8608 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:38.506868  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.440759  8528 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:38.518229  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.462898  8595 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.522253  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.473089  8440 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.525552  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.532472  3995 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.532704  3990 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.480093  8543 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:38.530493  3993 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:38.536408  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:38.517696  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.537768  8615 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:22:38.539270  8615 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:38.540268  8616 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:22:38.542400  8511 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.506027  8491 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:38.533617  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.450484  8605 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:38.553211  3990 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:38.410686  8596 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.476756  8555 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:22:38.557019  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.519863  8443 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:38.503703  8515 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:22:38.524627  8589 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.564234  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.561595  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:38.547096  8548 consensus_meta.cc:287] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.001s
I20260709 12:22:38.504902  8537 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.565620  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.564131  3995 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:38.525483  8588 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.574098  3992 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:38.573552  3993 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:38.576761  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.548889  8608 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.579638  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.556011  8605 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.405766  8601 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.556277  8543 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:38.590420  8618 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:38.562551  8622 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:38.566581  8556 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.594825  3995 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:38.451138  8593 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.563234  8491 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:38.547834  8440 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.562569  8530 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:38.547554  8413 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.602008  3925 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:38.602944  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:38.586054  8532 consensus_meta.cc:287] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.002s
I20260709 12:22:38.584211  8443 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:38.609933  8598 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:22:38.584427  8595 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:38.650918  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.652020  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.655346  3990 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:38.657184  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.593722  8605 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:38.597528  8512 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.658059  3990 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.646260  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.602820  8525 raft_consensus.cc:476] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:38.596335  8536 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:38.584025  8548 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.668274  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.669912  3842 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.669222  3992 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:22:38.670907  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 163772us
I20260709 12:22:38.673444  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.674358  8553 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.675985  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.676602  3992 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:38.675266  3990 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:22:38.683506  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.683881  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.684438  3997 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.610349  8606 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:22:38.680078  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:38.684484  3999 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:38.687727  3917 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:22:38.679848  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.679142  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.688531  3990 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:38.689189  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.689354  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.689841  3995 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:38.615016  8556 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.610780  8617 raft_consensus.cc:2764] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:38.686581  8616 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:38.679724  8549 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.001s
I20260709 12:22:38.693127  4583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 706) took 1072 ms. Trace:
I20260709 12:22:38.647207  8530 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.674932  8553 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:38.702768  8620 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:22:38.703687  8603 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:22:38.688179  8591 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.712625  3999 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:38.713598  4583 rpcz_store.cc:276] 0709 12:22:37.616936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.617073 (+   137us) service_pool.cc:224] Handling call
0709 12:22:37.617376 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.217987 (+600611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.689472 (+471485us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400631354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:38.689641 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358017792}
I20260709 12:22:38.615135  8618 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.682686  8593 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.717204  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.679847  8607 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.198s
I20260709 12:22:38.719398  8588 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.720875  8443 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:38.721367  8335 consensus_meta.cc:287] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
W20260709 12:22:38.714787  8602 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:22:38.730880  3917 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:38.574976  8592 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.678825  8536 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.728806  8558 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.744102  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.744583  8530 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:38.697345  8543 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.611344  8604 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.750070  3917 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:38.750358  8528 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.738549  8413 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.717592  8549 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.753062  8558 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:38.761595  8625 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:22:38.763036  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.717024  8491 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.765638  3917 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:38.739367  8335 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.769510  3923 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:38.766340  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.717893  8616 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.776108  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:38.777702  8591 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:38.778236  8591 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.778627  8591 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:38.778942  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 165) took 3269 ms. Trace:
I20260709 12:22:38.779331  3746 rpcz_store.cc:276] 0709 12:22:35.509387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.526638 (+ 17251us) service_pool.cc:224] Handling call
0709 12:22:38.778823 (+3252185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:35.693783 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:35.873126 (+179343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:35.885266 (+ 12140us) write_op.cc:435] Acquired schema lock
0709 12:22:35.885299 (+    33us) tablet.cc:662] Decoding operations
0709 12:22:35.954088 (+ 68789us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:35.954152 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:35.954191 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:35.954572 (+   381us) tablet.cc:701] Row locks acquired
0709 12:22:35.954588 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:35.954755 (+   167us) write_op.cc:270] Start()
0709 12:22:35.954888 (+   133us) write_op.cc:276] Timestamp: P: 1783599755954705 usec, L: 0
0709 12:22:35.954910 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:22:35.955728 (+   818us) log.cc:844] Serialized 913 byte log entry
0709 12:22:36.465157 (+509429us) op_driver.cc:464] REPLICATION: finished
0709 12:22:37.052146 (+586989us) write_op.cc:301] APPLY: starting
0709 12:22:37.061193 (+  9047us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:37.192524 (+131331us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b2400001328. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc5272223f 00007fdc527320be 00007fdc52734af7 00007fdc52735fb0 00007fdc5644a1bb 00007fdc5644a532 00007fdc56491b93 00007fdc5633ede3
0709 12:22:37.194019 (+  1495us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:37.194047 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:37.221329 (+ 27282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:37.221547 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:22:37.221639 (+    92us) write_op.cc:312] APPLY: finished
0709 12:22:37.221929 (+   290us) log.cc:844] Serialized 33 byte log entry
0709 12:22:37.222139 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:37.222230 (+    91us) write_op.cc:454] Released schema lock
0709 12:22:37.222276 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:37.222721 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:37.222749 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":344881,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":510239,"apply.run_cpu_time_us":9201,"apply.run_wall_time_us":225455,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":2219,"prepare.run_cpu_time_us":4000,"prepare.run_wall_time_us":275659,"replication_time_us":476783,"spinlock_wait_cycles":2059264,"thread_start_us":221267,"threads_started":1}]]}
I20260709 12:22:38.782495  8536 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.784803  3745 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 9, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.785209  8435 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:38.611313  8612 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.789863  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:38.760423  8537 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.794509  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.690825  8608 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.809026  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.809967  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:38.809509  3996 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:38.815413  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:38.816258  3917 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:38.789863  8435 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.818382  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.794013  8524 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:38.770861  8530 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:22:38.812719  8522 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.008s
I20260709 12:22:38.820408  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.807981  8536 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.771502  8528 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:22:38.815851  8535 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:38.816169  8548 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:38.829862  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.831519  8553 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.832396  8536 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:38.838048  8623 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:22:38.820199  8413 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:38.823937  8626 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:22:38.848402  8616 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.849975  3994 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:38.826241  8524 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:38.842338  8614 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:38.861310  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:38.833214  8556 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.861972  3996 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.860064  8408 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.826637  8522 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.860651  8614 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.876122  8549 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.878141  8522 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:38.879556  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:38.883447  3997 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:38.880997  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:38.894523  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.898448  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.899369  3848 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:38.902185  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.907199  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.908155  3848 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:38.912138  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:38.913115  3923 raft_consensus.cc:2376] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9. Re-sending same reply.
I20260709 12:22:38.917169  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.867885  8435 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:38.919627  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.920469  3842 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:38.920835  3846 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:38.923815  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:38.924477  3842 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:38.926641  8435 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:38.935899  8614 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:38.936606  8536 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:38.948573  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:38.949347  8519 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:38.950753  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.951903  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.952643  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:38.953574  3923 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:38.959779  3842 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
W20260709 12:22:38.964572  8599 consensus_meta.cc:287] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.004s
I20260709 12:22:38.989974  8599 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.968219  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.911773  8524 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:38.969121  8605 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.005302  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.006096  3925 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.008415  8605 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.009265  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1200) took 1251 ms. Trace:
I20260709 12:22:39.009730  3924 rpcz_store.cc:276] 0709 12:22:37.757695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.758000 (+   305us) service_pool.cc:224] Handling call
0709 12:22:37.758444 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.206365 (+447921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.008945 (+802580us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002d1254. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:39.009173 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992588032}
I20260709 12:22:39.011644  8577 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:39.011795  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:39.012735  4575 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:39.016108  8520 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.017580  8618 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:39.018425  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.972981  8558 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.019361  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.020380  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.021296  8558 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.021409  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:38.975834  8494 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.022500  8398 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:39.022723  8536 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:39.024358  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.991298  3845 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:22:38.986578  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.028412  4547 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.981037  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:38.982401  8576 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:38.983788  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:39.030745  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 47056.7us
I20260709 12:22:39.031797  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:38.985484  8533 consensus_meta.cc:287] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.005s
I20260709 12:22:38.986981  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:38.987327  3848 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:22:38.989018  3996 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:22:39.032610  3993 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:39.033448  3994 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:39.011284  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:39.052119  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71160.4us
I20260709 12:22:39.052520  3924 raft_consensus.cc:2376] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8. Re-sending same reply.
I20260709 12:22:39.041532  3923 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:39.023401  8536 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:39.048071  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.032110  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.023175  8398 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:39.068051  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.071722  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.073223  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:39.075042  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:39.075754  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.072769  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.078998  3925 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:39.059144  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.055029  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.080386  3923 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:39.081199  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.083595  3923 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:39.084558  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.083003  3842 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:22:39.078153  3888 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.069044  8618 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:39.087934  8618 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.088227  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:39.088845  8636 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:22:39.088371  8618 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:39.089758  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.091871  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:39.092625  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.093487  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.057300  8599 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.046901  8615 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.048820  8576 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:39.097537  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.069489  8519 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:39.070565  8612 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.123025  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.123721  3917 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:39.117758  3923 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:39.101006  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46277us
I20260709 12:22:39.069402  8416 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:39.082629  8544 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.085638  8432 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:39.127688  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.086283  8520 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:22:39.076860  8591 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.094977  8531 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:39.141052  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.069664  8390 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:22:39.099141  8617 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:39.072548  8533 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.127718  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.157377  8432 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.137379  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.137732  3924 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:39.138478  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52937.6us
I20260709 12:22:39.160367  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.158625  8432 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.091382  8614 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:39.091550  8522 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:39.102120  8632 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:39.118988  8588 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.141767  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:39.129582  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.145568  8389 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:39.133245  8544 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.131832  8416 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.161944  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.103308  8592 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:39.168669  3920 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:39.172171  4547 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.172938  4548 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.159827  8531 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:39.191509  8637 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:22:39.192548  3917 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:39.141939  8612 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:39.205755  3919 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:39.206199  8544 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.165954  8390 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:39.206718  8389 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.164391  8615 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:39.211609  3918 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:39.135257  8589 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:22:39.226524  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64706.8us
I20260709 12:22:39.237622  3917 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:22:39.236382  3923 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:39.237339  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65319.3us
W20260709 12:22:39.241576  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68774.8us
I20260709 12:22:39.160867  8606 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:22:39.232053  8556 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.282198  8606 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:39.164909  8519 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:22:39.226172  8500 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:39.225534  8416 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:39.156400  8617 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.141144  8536 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:39.288100  4579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 699) took 1373 ms (client timeout 1584 ms). Trace:
I20260709 12:22:39.292910  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.235633  8612 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.294611  3916 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:39.366710  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73886.3us
W20260709 12:22:39.366123  4579 rpcz_store.cc:269] 0709 12:22:37.914732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.933955 (+ 19223us) service_pool.cc:224] Handling call
0709 12:22:39.287865 (+1353910us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54008d3bd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:39.288024 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184652544}
I20260709 12:22:39.367611  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.297710  8529 consensus_queue.cc:1059] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:39.282778  8615 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:39.300683  8644 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 12:22:39.235639  8614 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:39.303109  8519 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:39.274915  8503 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:39.290828  8606 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:39.374503  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.310556  8389 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.210639  8576 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.283856  8522 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.313715  8533 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.238129  8531 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.380625  8606 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.382072  8606 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:39.299101  8588 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.383152  8588 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.383852  8614 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.327358  8544 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.365685  8605 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.387133  8544 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.331936  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 285) took 2463 ms. Trace:
I20260709 12:22:39.235461  8524 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:22:39.237617  8551 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:39.397128  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1054) took 1080 ms. Trace:
I20260709 12:22:39.397324  8551 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.397929  8551 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:39.388058  3747 rpcz_store.cc:276] 0709 12:22:36.869025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.869153 (+   128us) service_pool.cc:224] Handling call
0709 12:22:36.993923 (+124770us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:39.331856 (+2337933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:38.104490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:38.215245 (+110755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:38.220405 (+  5160us) write_op.cc:435] Acquired schema lock
0709 12:22:38.223097 (+  2692us) tablet.cc:662] Decoding operations
0709 12:22:38.311093 (+ 87996us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:38.320562 (+  9469us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:38.322912 (+  2350us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:38.338132 (+ 15220us) tablet.cc:701] Row locks acquired
0709 12:22:38.345694 (+  7562us) write_op.cc:260] PREPARE: finished
0709 12:22:38.369679 (+ 23985us) write_op.cc:270] Start()
0709 12:22:38.377386 (+  7707us) write_op.cc:276] Timestamp: P: 1783599758366301 usec, L: 0
0709 12:22:38.393733 (+ 16347us) op_driver.cc:348] REPLICATION: starting
0709 12:22:38.446837 (+ 53104us) log.cc:844] Serialized 538 byte log entry
0709 12:22:39.088739 (+641902us) op_driver.cc:464] REPLICATION: finished
0709 12:22:39.188715 (+ 99976us) write_op.cc:301] APPLY: starting
0709 12:22:39.188803 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:39.190026 (+  1223us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:39.190123 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:39.211640 (+ 21517us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:39.243912 (+ 32272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:22:39.284254 (+ 40342us) write_op.cc:312] APPLY: finished
0709 12:22:39.327498 (+ 43244us) log.cc:844] Serialized 25 byte log entry
0709 12:22:39.327834 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:39.327944 (+   110us) write_op.cc:454] Released schema lock
0709 12:22:39.328002 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:39.328645 (+   643us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:39.328688 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":247829,"reported_tablets":2,"spinlock_wait_cycles":47773056,"child_traces":[["op",{"apply.queue_time_us":99690,"apply.run_cpu_time_us":4190,"apply.run_wall_time_us":139872,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":472306,"prepare.run_cpu_time_us":50507,"prepare.run_wall_time_us":484631,"raft.queue_time_us":440556,"raft.run_cpu_time_us":16162,"raft.run_wall_time_us":264933,"replication_time_us":692592,"thread_start_us":513912,"threads_started":4,"wal-append.queue_time_us":151561}]]}
I20260709 12:22:39.399804  8503 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.400906  8503 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.369436  8612 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:39.407277  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:39.370378  8643 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.205s	user 0.005s	sys 0.000s
I20260709 12:22:39.352085  3992 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 17. Ops: []
I20260709 12:22:39.407823  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:39.357363  3964 leader_election.cc:336] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.622s (SENT)
I20260709 12:22:39.413447  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.374105  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.378763  8617 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.323623  8417 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:39.379859  8522 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.386801  8605 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.164098  8398 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.389400  3850 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:39.351332  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:39.367671  8609 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:39.397698  3845 rpcz_store.cc:276] 0709 12:22:38.316731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.318947 (+  2216us) service_pool.cc:224] Handling call
0709 12:22:38.329474 (+ 10527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.026906 (+697432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.396791 (+369885us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54000a55d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:39.397028 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521392000}
I20260709 12:22:39.291396  8592 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:39.370167  8607 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:39.438870  8607 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.440188  8607 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.445452  8522 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.430500  8596 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:39.372236  8519 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.447816  8522 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:39.447763  8519 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.448486  8522 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.412375  8390 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.449234  8519 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:39.370591  8577 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:39.455094  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:39.417722  8435 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:39.457530  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100205us
I20260709 12:22:39.456118  3841 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:39.459923  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:39.419790  8632 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:39.429949  8613 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.505546  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:39.506393  3992 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.478302  3998 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:39.449982  8390 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.523248  8613 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.463712  8591 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.478992  8435 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.477777  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.480252  3888 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.453037  8577 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:39.597064  3964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.321s (SENT) [suppressed 27 similar messages]
I20260709 12:22:39.616743  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.615868  3848 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:39.513118  8544 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:22:39.568945  8335 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.599962  3992 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:39.618009  3919 raft_consensus.cc:2393] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:22:39.618636  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 138499us
W20260709 12:22:39.598560  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 185242us
I20260709 12:22:39.637066  3846 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:39.603699  8597 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.603423  8416 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.656644  3848 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:39.657260  3845 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:39.620088  8577 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:39.639891  8618 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.004s
I20260709 12:22:39.623796  8591 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:39.661142  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:39.619729  8548 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:39.662222  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 246980us
I20260709 12:22:39.632198  8596 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:39.650306  8608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.006s	sys 0.022s
W20260709 12:22:39.673758  3815 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.944s (SENT)
I20260709 12:22:39.680622  3849 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:22:39.682781  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.633651  8389 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:22:39.694199  8502 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:39.668026  8591 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:39.708179  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.685454  8608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.007s	sys 0.023s
I20260709 12:22:39.667855  8335 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:22:39.667378  8544 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:39.650694  8597 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.661178  8581 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:22:39.720709  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.687794  8616 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.721772  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:39.730104  3848 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:39.681742  8596 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.689702  8531 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:39.725121  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.686833  8530 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.671607  8618 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.744750  8530 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.746506  8618 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.747746  3916 raft_consensus.cc:2368] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:39.748212  8502 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.748747  8502 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.750825  8502 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:39.751731  8531 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:39.724311  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:39.752882  8531 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.753230  8612 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.754738  3925 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:39.684617  8522 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.758034  8551 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.729168  3850 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:39.678270  8548 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.731725  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.733348  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:39.753345  3846 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:39.726079  8544 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:39.669122  8665 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:22:39.717976  8591 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.734804  8616 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.747157  8530 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.717216  8604 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:22:39.789232  3815 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.085s (SENT)
I20260709 12:22:39.791325  4579 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:39.792740  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.801102  8597 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.803328  8616 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.803869  8613 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:39.829564  3842 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:39.751109  8615 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.830380  8616 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:39.831955  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.840435  8616 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:39.847862  8612 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.850484  8648 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.851184  8648 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.852761  8503 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.805269  8596 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.805866  8548 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.817261  8577 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.820367  8604 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:39.822928  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.880555  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.828037  8591 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.802846  8544 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.865147  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.876832  4583 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:39.877931  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:39.883519  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:39.884279  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.884732  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:39.884675  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.888819  8589 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:39.880987  3919 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:39.893344  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.902037  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:39.852875  8601 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.912019  3919 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:39.911912  4575 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:39.878553  8608 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.880924  8612 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.889626  8604 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:39.912668  8588 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.012s
I20260709 12:22:39.923734  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.924252  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.894644  8589 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.929903  3843 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:39.930133  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.897490  8648 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:39.893373  8503 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:39.942950  3917 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:39.914207  8617 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:39.911224  8616 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:22:39.942257  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2422) took 1245 ms. Trace:
I20260709 12:22:39.969422  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.979171  3920 rpcz_store.cc:276] 0709 12:22:38.696622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.018990 (+322368us) service_pool.cc:224] Handling call
0709 12:22:39.941975 (+922985us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003728d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:39.942172 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330173312}
I20260709 12:22:39.935225  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:39.932737  8599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.011s	sys 0.015s
I20260709 12:22:39.967870  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:39.939030  8335 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:39.938303  8609 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:39.920673  8519 raft_consensus.cc:3055] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:39.980283  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:39.986655  3841 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:40.037086  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:40.045773  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65580.1us
I20260709 12:22:39.990125  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2952) took 1421 ms. Trace:
I20260709 12:22:39.938570  3890 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:40.038375  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.989400  3921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2415) took 1550 ms (client timeout 1622 ms). Trace:
I20260709 12:22:40.020009  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.982182  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1206) took 1786 ms. Trace:
I20260709 12:22:39.991873  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.987771  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.988678  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:39.959462  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:39.975199  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.046859  8519 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:39.974888  8679 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:22:40.050779  3925 rpcz_store.cc:276] 0709 12:22:38.569076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.159040 (+589964us) service_pool.cc:224] Handling call
0709 12:22:39.159350 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.755137 (+595787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.989875 (+234738us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400303ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:39.990063 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368839936}
I20260709 12:22:40.080849  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:39.991997  8596 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:40.081909  3921 rpcz_store.cc:269] 0709 12:22:38.439586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.467122 (+ 27536us) service_pool.cc:224] Handling call
0709 12:22:39.989153 (+1522031us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540017dc54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:39.989330 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667358976}
I20260709 12:22:39.965879  8662 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:22:39.942981  8588 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.082472  3918 rpcz_store.cc:276] 0709 12:22:38.196216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.196385 (+   169us) service_pool.cc:224] Handling call
0709 12:22:38.207658 (+ 11273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.282824 (+1075166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.981886 (+699062us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d70d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:39.982110 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308392320}
I20260709 12:22:40.092358  3842 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:39.931548  8608 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:40.094249  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 155762us
I20260709 12:22:40.139741  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.140693  3921 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:40.141638  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.141891  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.020213  8616 consensus_queue.cc:1243] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:22:39.976778  8617 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:40.146266  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:39.936821  8604 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:39.978224  8673 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:22:40.095803  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.097097  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.152662  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.153460  3925 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:40.153950  3921 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:40.154773  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.093305  8522 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:40.100188  8591 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:39.985152  8408 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.101866  8503 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.102500  8606 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.934253  8612 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:40.040866  8599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.013s	sys 0.033s
I20260709 12:22:40.107349  8577 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.094367  8589 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.047297  8609 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.080727  8613 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:40.122097  8605 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.039556  8678 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.172214  8408 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.176250  8613 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:40.181310  8613 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:40.182068  8408 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.092207  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.139245  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:40.143790  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 176022us
I20260709 12:22:40.043942  8530 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:22:40.146266  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.147257  3916 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16.
I20260709 12:22:40.148537  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.151158  8686 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.119288  8390 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.157557  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.180194  8678 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.126080  8596 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:40.162966  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.149303  8617 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:40.174530  8522 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:40.171612  8519 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:40.184474  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 92359.6us
I20260709 12:22:40.187224  3842 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:40.189018  3925 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:40.152736  3841 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:40.162978  8606 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:40.177233  8648 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:40.186954  8408 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:40.195014  8608 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.195878  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:40.196578  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.197125  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1066) took 1241 ms. Trace:
I20260709 12:22:40.197263  8614 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:40.198508  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.205713  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.212497  4580 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:40.216930  3925 raft_consensus.cc:2393] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 4: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:40.205871  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:40.206532  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 64995.7us
I20260709 12:22:40.192035  8612 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.208616  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.221625  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.210187  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.210980  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.209666  8606 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:40.219362  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.235944  3992 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
I20260709 12:22:40.236147  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.237001  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.220892  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.238196  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.211714  8519 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:40.213894  3844 rpcz_store.cc:276] 0709 12:22:38.956124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.956276 (+   152us) service_pool.cc:224] Handling call
0709 12:22:38.956572 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.965595 (+  9023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.965650 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.966399 (+   749us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.807913 (+841514us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180026cce0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:39.973189 (+165276us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:39.973230 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.973283 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.196820 (+223537us) raft_consensus.cc:1685] finished
0709 12:22:40.196840 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.197063 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5385,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":44530432,"thread_start_us":165059,"threads_started":1,"wal-append.queue_time_us":1077330}
I20260709 12:22:40.223325  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.224277  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.224834  8608 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:40.225307  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.226209  8588 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.227545  3995 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:40.227794  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.252009  3991 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:40.231155  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:40.232049  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.232327  8548 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:40.261765  8440 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.248749  8608 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.264416  8608 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:40.232872  8596 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.233645  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.237973  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1205) took 2057 ms. Trace:
I20260709 12:22:40.273263  3922 rpcz_store.cc:276] 0709 12:22:38.180439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.180608 (+   169us) service_pool.cc:224] Handling call
0709 12:22:38.181035 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.270619 (+ 89584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.237708 (+1967089us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b5400078354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:40.237910 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204507008}
I20260709 12:22:40.238281  3841 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:40.238710  3998 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:40.237195  3921 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:40.275309  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.276520  3997 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:40.213284  3845 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:40.237229  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.277900  3997 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:40.239988  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.247623  3842 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:40.278890  3844 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:22:40.279352  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.248217  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.281036  3998 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:40.247331  3994 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.242704  8678 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.201256  8686 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.252717  3996 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:40.215999  8614 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:40.275312  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.247253  3992 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.299546  3997 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:40.237673  8632 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:40.284855  3844 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:22:40.287894  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.303740  3921 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:40.211952  8648 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.304316  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1214) took 1163 ms. Trace:
I20260709 12:22:40.304749  3921 rpcz_store.cc:276] 0709 12:22:39.140967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.303001 (+1162034us) service_pool.cc:224] Handling call
0709 12:22:40.303324 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.304076 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.304257 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.306289  8648 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.291815  3845 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:22:40.249799  8408 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.307157  8408 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.300849  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.309604  3991 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:40.311055  8686 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.312628  8553 consensus_queue.cc:1059] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:40.295936  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1213) took 1174 ms. Trace:
I20260709 12:22:40.317710  3925 rpcz_store.cc:276] 0709 12:22:39.121822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.295064 (+1173242us) service_pool.cc:224] Handling call
0709 12:22:40.295351 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.295565 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.295593 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.295645 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.295683 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.295741 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.295861 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.295235  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.301756  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.307081  3992 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:40.289600  8591 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:40.306389  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1215) took 1158 ms. Trace:
I20260709 12:22:40.348729  3921 rpcz_store.cc:276] 0709 12:22:39.147770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.305522 (+1157752us) service_pool.cc:224] Handling call
0709 12:22:40.305893 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.306076 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.306102 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.306144 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:40.306175 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.306228 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.306334 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.337746  3991 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:40.343150  3842 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:40.334219  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2426) took 1354 ms. Trace:
I20260709 12:22:40.350404  3920 rpcz_store.cc:276] 0709 12:22:38.979866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.290166 (+1310300us) service_pool.cc:224] Handling call
0709 12:22:40.333600 (+ 43434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.333823 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.333854 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.333905 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:40.333954 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.334018 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.334152 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.354475  3994 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:40.355824  3998 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:40.362960  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56208.7us
I20260709 12:22:40.366722  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2436) took 1045 ms. Trace:
I20260709 12:22:40.367276  3921 rpcz_store.cc:276] 0709 12:22:39.321563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.349982 (+1028419us) service_pool.cc:224] Handling call
0709 12:22:40.365867 (+ 15885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.366143 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.366188 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.366255 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.366316 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.366400 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.366631 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:40.403091  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.339942  8632 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:40.330957  8688 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:40.315161  8614 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.421952  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1216) took 1273 ms. Trace:
I20260709 12:22:40.422452  3925 rpcz_store.cc:276] 0709 12:22:39.148161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.319087 (+1170926us) service_pool.cc:224] Handling call
0709 12:22:40.416310 (+ 97223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.416593 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.416635 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.416699 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.416758 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.421325 (+  4567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.421847 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.424942  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2968) took 1069 ms. Trace:
I20260709 12:22:40.425333  3925 rpcz_store.cc:276] 0709 12:22:39.355338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.423901 (+1068563us) service_pool.cc:224] Handling call
0709 12:22:40.424262 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.424513 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.424555 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.424619 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:40.424679 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.424759 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.424876 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.403980  8678 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.435580  3925 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:40.429764  3992 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:40.429906  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:40.422932  8614 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.418159  8688 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:40.458559  8640 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.312s	user 0.000s	sys 0.006s
I20260709 12:22:40.460453  8632 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.415603  8503 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:22:40.445753  8678 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.474344  8678 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.477746  8617 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.479622  3843 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:40.482275  8583 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.482708  8606 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.482969  8609 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.483505  8408 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:40.485090  8609 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.447124  8536 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:40.486474  8688 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.490826  8548 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:40.491134  8613 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.484956  8520 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:40.493821  8520 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:40.498843  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 61119.9us
I20260709 12:22:40.498600  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.501456  3848 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:40.480939  3916 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:40.506256  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.508921  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:40.517733  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.519500  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.518947  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:40.524792  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.495141  8548 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.539513  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.541419  3916 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:40.518085  8591 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:40.519827  8536 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.516141  8600 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:40.523341  8530 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.555716  3999 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:40.556003  3997 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:40.557417  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.558324  3997 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:40.561822  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.564392  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.565249  3999 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:40.566393  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:40.571146  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.572373  8599 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:40.572268  8494 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:40.572908  8599 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.573195  8691 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:40.573484  8599 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:40.573771  8691 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:40.574879  8691 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.576689  8691 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:40.578940  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.581547  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.582418  3999 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:40.583629  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:40.579095  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.546016  8408 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.586050  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.567723  8609 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.519627  8588 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:22:40.588945  8494 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:22:40.600031  8609 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.590564  8491 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:40.602684  8491 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.603106  8491 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:40.604130  8692 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:22:40.606576  3993 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:40.606765  3996 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:40.563143  8530 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.607648  8555 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:40.607793  8530 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.608237  8555 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.608770  8555 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:40.549532  8617 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.550678  8705 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:40.551689  8697 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:40.602214  8693 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
W20260709 12:22:40.620805  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.548978  8600 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.610133  8408 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.563167  8398 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:40.686996  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.709869  3916 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:40.547248  8548 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.711356  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:40.736863  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:40.610255  8591 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:40.744521  8606 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.749195  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.751480  8416 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.751897  8398 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.754014  8548 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.560715  8520 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.551409  8536 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:40.558521  8595 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.400s	user 0.007s	sys 0.046s
I20260709 12:22:40.756366  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2428) took 1465 ms. Trace:
I20260709 12:22:40.769752  3922 rpcz_store.cc:276] 0709 12:22:39.291231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.348072 (+1056841us) service_pool.cc:224] Handling call
0709 12:22:40.416797 (+ 68725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.422491 (+  5694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.422520 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.427712 (+  5192us) log.cc:844] Serialized 26 byte log entry
0709 12:22:40.540826 (+113114us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:40.540864 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.540940 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.755932 (+214992us) raft_consensus.cc:1685] finished
0709 12:22:40.755975 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.756227 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4712,"raft.queue_time_us":4812,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":16290,"thread_start_us":49056,"threads_started":1,"wal-append.queue_time_us":275332}
I20260709 12:22:40.763365  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 3100) took 1037 ms. Trace:
W20260709 12:22:40.756652  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 204483us
I20260709 12:22:40.772426  3846 rpcz_store.cc:276] 0709 12:22:39.726055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.748716 (+1022661us) service_pool.cc:224] Handling call
0709 12:22:40.763295 (+ 14579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.783699  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.786520  3848 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:40.788662  8435 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.715361  8710 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:40.792146  3843 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:40.794996  3842 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:40.759141  8701 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.778053  8595 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.008s	sys 0.046s
I20260709 12:22:40.644642  8705 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:40.838970  3846 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:40.789705  8710 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.794417  8520 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:40.844444  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.854460  3919 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:40.714486  8697 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:40.850690  8519 consensus_meta.cc:287] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 12:22:40.798792  8417 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:22:40.864408  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.865475  3846 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:40.851959  8613 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:40.870311  3843 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:22:40.871048  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.873457  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 354607us
I20260709 12:22:40.876194  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.875666  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.895114  3846 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:40.876271  8519 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:40.875170  8704 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:22:40.920303  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.922437  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.923345  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.931653  8713 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.932247  8583 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:40.955188  3844 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:40.933105  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.939512  8606 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:40.940071  8551 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.940562  8494 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:40.941771  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2412) took 2507 ms (client timeout 2556 ms). Trace:
I20260709 12:22:40.944000  3920 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:40.948396  8500 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:40.954569  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:40.969308  3924 rpcz_store.cc:269] 0709 12:22:38.434113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.089421 (+655308us) service_pool.cc:224] Handling call
0709 12:22:40.941512 (+1852091us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b540024f754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:40.941696 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94343552}
I20260709 12:22:40.958552  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:40.832204  8701 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:40.971635  3845 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:40.972834  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:40.955157  8703 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 12:22:40.972224  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96150.7us
I20260709 12:22:40.950176  8519 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:22:40.974115  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.977924  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:40.990746  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.990975  3846 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:40.996456  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.966714  8613 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:41.002979  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:41.002101  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:40.972494  8588 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.971458  8500 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:41.032850  3843 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
W20260709 12:22:41.033254  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 273225us
I20260709 12:22:41.036310  3846 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:41.050361  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.051687  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.050853  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:40.987138  8494 consensus_queue.cc:1243] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:22:41.008565  8711 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:22:41.052487  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:40.989991  8548 raft_consensus.cc:2764] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:22:41.003763  8600 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:40.972184  8583 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.072975  8697 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.073659  8697 consensus_queue.cc:1059] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:22:41.073060  8708 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:22:41.055904  8536 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:41.077427  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 88669.1us
I20260709 12:22:41.055734  8398 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:41.078464  8600 raft_consensus.cc:3055] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:41.083622  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 135667us
I20260709 12:22:41.083056  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:41.079174  8608 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.001s
I20260709 12:22:41.076843  8715 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:41.089232  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:41.089397  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 86511us
I20260709 12:22:41.090340  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:41.095250  3993 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:40.977413  8713 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:41.107404  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.085829  8600 raft_consensus.cc:740] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:41.111470  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:41.111064  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2947) took 2543 ms. Trace:
W20260709 12:22:41.113004  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 124628us
I20260709 12:22:41.113584  3923 rpcz_store.cc:276] 0709 12:22:38.567303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.145185 (+577882us) service_pool.cc:224] Handling call
0709 12:22:39.162973 (+ 17788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.281331 (+118358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.110757 (+1829426us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54002d0854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:41.110978 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168299776}
I20260709 12:22:41.092808  8715 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.118602  8715 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.069666  8519 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.087395  8536 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:22:41.141521  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 88650.4us
W20260709 12:22:41.140688  3964 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.930s (SENT)
I20260709 12:22:41.095129  8608 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.142951  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:41.116436  8588 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:41.116549  8613 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:41.109730  8719 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:41.083863  8500 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.158033  8500 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:41.116828  8416 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:41.151726  8519 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:41.117033  8548 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:22:41.141741  8716 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 12:22:41.240552  8701 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.241263  8548 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:41.150954  8592 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:41.173811  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 123052us
I20260709 12:22:41.152719  8576 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:41.192891  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.180899  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65279.8us
W20260709 12:22:41.262020  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.271768  8548 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:41.242321  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 115213us
I20260709 12:22:41.302251  3888 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:41.162469  8613 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.241801  8701 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:22:41.153349  8710 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.308027  8613 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:41.309499  8536 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:41.310878  8536 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:41.275712  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.312018  8608 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:41.183599  8530 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.002s
I20260709 12:22:41.149076  8551 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:22:41.183312  8719 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.272099  8716 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:41.304409  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:41.314184  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 173790us
I20260709 12:22:41.315325  3846 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:41.273577  8592 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:41.274060  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 129677us
I20260709 12:22:41.319736  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:41.243367  8712 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.268s	user 0.001s	sys 0.001s
I20260709 12:22:41.175510  8726 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:22:41.324120  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:41.327292  8737 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.328223  8737 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.330890  8737 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:41.319528  8614 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.002s
I20260709 12:22:41.332132  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.332773  8732 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:41.333315  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.340366  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.311625  8688 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:22:41.175683  8600 consensus_queue.cc:260] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.174856  8730 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.178s
W20260709 12:22:41.327404  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 186742us
I20260709 12:22:41.388616  3916 raft_consensus.cc:2410] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:22:41.377712  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58048.5us
I20260709 12:22:41.352612  3844 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:41.411361  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:41.413167  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73561us
I20260709 12:22:41.411760  3844 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:41.242362  8718 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 12:22:41.422758  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81716.1us
I20260709 12:22:41.322065  8592 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:41.426815  3993 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:41.337904  8548 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:41.419912  3844 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.433892  3844 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.397313  8608 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:41.379197  8713 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.341054  8583 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.435822  8588 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:41.449080  8736 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:41.331408  8737 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:41.453159  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.316745  8530 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.321151  8719 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:41.436918  8491 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.005s
I20260709 12:22:41.435111  8548 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.475396  8588 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.479187  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2960) took 2891 ms. Trace:
I20260709 12:22:41.480866  8728 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 12:22:41.484120  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72838.4us
I20260709 12:22:41.484067  3917 rpcz_store.cc:276] 0709 12:22:38.587894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.280756 (+692862us) service_pool.cc:224] Handling call
0709 12:22:39.942754 (+661998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.975009 (+ 32255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.478925 (+1503916us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003728d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:41.479095 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521435008}
I20260709 12:22:41.486073  8491 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.490624  8719 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.490818  8491 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.483233  8548 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:41.436252  8732 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:41.405344  8536 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:41.497407  8724 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:22:41.473182  8737 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:41.538189  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 211044us
I20260709 12:22:41.498072  8751 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:41.544128  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.546912  8609 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.560259  8651 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:41.560932  8651 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:41.562749  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.564637  3844 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:22:41.565164  3844 pending_rounds.cc:85] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 8
I20260709 12:22:41.520509  8718 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.567374  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:41.569180  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:41.561784  8494 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:41.565568  3844 pending_rounds.cc:107] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:22:41.600260  3844 raft_consensus.cc:2889] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:41.592413  3923 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:41.595494  8742 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:41.567325  8555 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.004s
I20260709 12:22:41.605672  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:41.607376  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:41.612731  3919 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:41.608047  8533 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.608791  8737 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.610585  8530 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.612803  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:41.627517  3917 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:41.627589  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.599639  8494 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:41.568207  8715 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.636520  8715 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:41.613921  8599 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.040s	user 0.016s	sys 0.000s
I20260709 12:22:41.613986  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:41.614774  8595 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:41.570555  8605 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.593950  8751 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:41.616187  8520 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.000s
I20260709 12:22:41.618000  8613 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.619001  8555 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.621464  8651 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.622149  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3073) took 1065 ms. Trace:
I20260709 12:22:41.588533  8718 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.628295  3846 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:41.626019  8742 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.634147  8746 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:41.651261  3921 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:22:41.669088  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.681223  3924 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:41.685899  3924 pending_rounds.cc:85] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 6
I20260709 12:22:41.613447  8732 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.686262  3924 pending_rounds.cc:107] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:41.689872  3924 raft_consensus.cc:2889] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:41.680656  3997 rpcz_store.cc:276] 0709 12:22:40.556461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.590635 (+ 34174us) service_pool.cc:224] Handling call
0709 12:22:40.591035 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.799956 (+208921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.799989 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.848588 (+ 48599us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.035797 (+187209us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:41.035836 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.477634 (+441798us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400413cd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:41.477690 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:41.612223 (+134533us) raft_consensus.cc:1685] finished
0709 12:22:41.612244 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.622043 (+  9799us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28876,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7833,"spinlock_wait_cycles":479486720,"thread_start_us":160664,"threads_started":1,"wal-append.queue_time_us":225463}
I20260709 12:22:41.690796  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:41.683924  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:41.650475  8715 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.653013  8595 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.698623  3844 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:41.626935  8533 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.685956  8730 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.655686  8605 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.713080  3848 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:41.714944  3848 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:41.656690  8599 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.700424  8595 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:41.691982  8746 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.723860  8605 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.728753  3848 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:41.731110  8533 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.736824  8613 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:41.750254  3842 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:41.751700  3919 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:41.700196  8715 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.695190  8494 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.720233  8733 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.773715  3998 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:41.757266  8751 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.726632  8730 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.776747  8718 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.772163  8733 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:41.819139  8672 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.777096  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3071) took 1218 ms. Trace:
I20260709 12:22:41.790552  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2977) took 1603 ms. Trace:
I20260709 12:22:41.821233  8746 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:41.825425  8733 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:41.819902  8672 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.821931  8494 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:41.840241  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2967) took 2517 ms. Trace:
I20260709 12:22:41.841486  3921 rpcz_store.cc:276] 0709 12:22:39.323056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.420514 (+1097458us) service_pool.cc:224] Handling call
0709 12:22:40.420960 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.685613 (+1264653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.839252 (+153639us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400215054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:41.840096 (+   844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2808988032}
I20260709 12:22:41.765897  3848 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:41.823107  8555 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.846617  3844 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:41.836035  3922 rpcz_store.cc:276] 0709 12:22:40.187436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.772150 (+584714us) service_pool.cc:224] Handling call
0709 12:22:40.830465 (+ 58315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.830728 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:41.002788 (+172060us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.787279 (+784491us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b18003920e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287
0709 12:22:41.787411 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.790090 (+  2679us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:41.790169 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.790269 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.790459 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255046,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":56158,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7512,"spinlock_wait_cycles":41992832,"thread_start_us":291096,"threads_started":3,"wal-append.queue_time_us":152892}
I20260709 12:22:41.833642  3998 rpcz_store.cc:276] 0709 12:22:40.555764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.559570 (+  3806us) service_pool.cc:224] Handling call
0709 12:22:41.773295 (+1213725us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:22:41.773525 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.774204 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.774438 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3964672}
I20260709 12:22:41.805485  8742 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:41.821182  8548 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.868618  8719 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.869683  8390 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:41.871220  8733 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:41.872622  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.872390  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:41.908136  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.908099  4581 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
W20260709 12:22:41.874922  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.908277  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:41.875598  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 306608us
I20260709 12:22:41.883915  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:41.912634  3919 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:41.886284  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:41.919036  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:41.913303  8613 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:22:41.902454  8763 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.928123  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:41.929024  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:41.932724  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:41.909085  8390 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:41.938951  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:41.939852  3922 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:41.943532  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:41.905689  8719 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.947841  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:41.958840  3844 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:41.948535  8732 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.950759  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:41.919049  8747 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.938078  8555 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:41.948578  8390 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:41.964797  8543 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:41.926575  8592 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:41.998636  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:41.970408  8555 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:41.937937  8616 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:22:41.967587  8747 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.001999  3922 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:42.001989  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:41.965065  8732 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.011651  8389 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.996284  8390 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:42.019719  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 635) took 1703 ms. Trace:
I20260709 12:22:42.019903  4548 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:42.007257  8555 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.023995  3995 rpcz_store.cc:276] 0709 12:22:40.316345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.322998 (+  6653us) service_pool.cc:224] Handling call
0709 12:22:42.018951 (+1695953us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:22:42.019151 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.019338 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.019365 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:42.019421 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:42.019479 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.019537 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.019655 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24670464}
I20260709 12:22:41.995558  8543 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:22:42.028879  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.028884  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.028178  8605 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:41.941217  8763 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.037596  8761 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:22:42.030761  8605 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:42.033232  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.000454  8672 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.042237  8742 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:42.045258  8729 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.045684  8742 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.020244  8548 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:42.024168  8417 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:42.045766  8729 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.025347  8616 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:42.034811  8512 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:42.035847  8519 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:42.032968  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:42.034807  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65868.3us
I20260709 12:22:42.059270  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:42.059993  3844 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:42.031050  8767 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.025882  8389 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.069482  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.071089  3923 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:42.070993  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.032558  8390 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.084365  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2317) took 1245 ms. Trace:
I20260709 12:22:42.085016  3842 rpcz_store.cc:276] 0709 12:22:40.838825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.839001 (+   176us) service_pool.cc:224] Handling call
0709 12:22:40.840190 (+  1189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.751072 (+910882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.083997 (+332925us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400408b54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:42.084274 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092307840}
I20260709 12:22:42.086871  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.087555  8733 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.060808  8616 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:42.064615  8759 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:22:42.097752  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.041970  8758 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.155s
I20260709 12:22:42.115614  8719 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:42.114042  3964 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.062s (SENT)
I20260709 12:22:42.117740  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:42.139164  8592 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.139427  8616 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.140822  8616 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.138474  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.142206  3922 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:42.143528  8733 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:42.147162  8389 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.161777  8705 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:42.142271  8747 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.179749  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.179924  3998 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:22:42.182891  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.074342  8767 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.187505  8763 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.187719  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:42.188304  3995 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:22:42.190299  8765 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:22:42.193188  8632 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:42.193677  8632 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:42.196509  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.184633  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.203202  3998 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:42.194640  8632 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.213421  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:42.205348  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.206357  3995 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:42.211755  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.225553  3922 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:42.225848  3997 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:42.229882  3997 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:42.230707  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:42.248692  8729 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.237975  8719 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.250435  8719 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.252836  8719 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:42.255831  8769 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:22:42.259356  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:42.268574  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.092816  8605 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.280316  3993 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:42.284008  8599 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.277668  8672 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:42.285564  8615 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.286374  3845 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:42.228694  8556 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.290004  8556 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.291150  8758 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:42.229321  8716 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:42.292183  8759 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:42.288002  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 192548us
I20260709 12:22:42.291704  8758 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:42.295064  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:42.292339  8716 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:42.299985  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.273320  8592 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:42.301736  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.282011  8632 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:42.304198  8742 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.304965  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.308476  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:42.309219  3997 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.321384  3844 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:42.322721  3962 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:42.323524  8548 raft_consensus.cc:2804] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:42.323714  3923 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:42.324052  8548 raft_consensus.cc:697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:42.324726  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.325347  3923 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:42.324944  8548 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:42.327319  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53181.4us
W20260709 12:22:42.327795  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 293528us
I20260709 12:22:42.331710  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.336719  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:42.307286  8494 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.361515  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:42.361756  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.311391  8592 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:42.371333  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:42.341557  8595 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.004s
I20260709 12:22:42.408476  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.408911  3990 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:42.357651  8543 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:42.334460  8609 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:42.318382  8678 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:22:42.388235  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.441501  3922 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:42.398252  3997 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
W20260709 12:22:42.443773  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.365263  8389 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.368919  8597 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.366328  8519 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:42.290119  8774 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 12:22:42.368695  8606 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.364864  8615 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:42.447928  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.364820  8512 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:42.354523  8742 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:22:42.403873  3923 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:42.494403  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.407898  8716 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.479043  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.500245  3990 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:42.298811  8759 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.501437  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:42.498685  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.362226  8608 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:22:42.482312  8606 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.485255  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:42.364780  8719 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 12:22:42.489555  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.372077  8592 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.502040  3990 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:42.368495  8601 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:22:42.481139  8615 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:42.508328  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.339000  8605 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:42.419843  8595 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.515925  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.480901  8599 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:42.477391  8389 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.505149  3922 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:42.449353  8609 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:42.535768  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.370337  8494 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.538877  8716 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:42.535279  8774 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.543363  8779 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:42.545800  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.546834  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.554042  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.608155  4581 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:42.609047  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.609124  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.610146  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.610569  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.554203  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.559029  8512 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.611586  3845 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:22:42.612509  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.611599  4576 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:42.613214  3845 raft_consensus.cc:2393] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:42.565291  8519 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.566478  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.574050  3990 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:42.480422  8597 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.622745  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.623987  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.529647  3923 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:42.436151  8758 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.535012  8615 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:42.591743  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.592059  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.593021  3848 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:42.602231  8494 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.603104  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.630486  3992 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:42.604874  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:42.564317  4575 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:42.632241  3844 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:42.607372  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.616607  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.633973  3922 raft_consensus.cc:2368] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
W20260709 12:22:42.593681  8685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:22:42.624606  3990 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:42.616241  8746 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.595642  8716 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:42.637178  3990 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:42.583724  8599 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.633761  4583 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:42.640136  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.619678  8543 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:42.650988  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:42.651002  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:42.642676  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 157553us
I20260709 12:22:42.625205  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.623073  8767 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:42.624310  8417 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:42.627951  8729 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.655936  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.626047  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.615020  8774 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.669984  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:42.671046  4575 raft_consensus.cc:2410] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:42.673271  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.676508  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.680254  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.684542  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:42.691018  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.710758  4577 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:42.691895  8716 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.652606  8494 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:42.714026  8494 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.714740  8595 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.716490  8494 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.667740  8543 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.719337  8543 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.697757  8606 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.698277  8408 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.720605  8408 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:42.720882  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.698519  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.668463  8672 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.700431  8589 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:42.703168  8588 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:22:42.704414  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.740263  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.706681  8536 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:42.707820  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:42.709489  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.744680  4583 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:42.699662  8609 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.723320  8716 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:42.722445  3917 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
W20260709 12:22:42.724076  8555 consensus_meta.cc:287] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 12:22:42.651865  8746 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:42.682706  8733 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.001s
I20260709 12:22:42.726532  8599 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.788714  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.727437  8389 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.727978  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.729211  8597 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.741250  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.669246  8417 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:42.769987  3844 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:42.753082  4580 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:22:42.847563  4580 pending_rounds.cc:85] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 7
I20260709 12:22:42.848099  4580 pending_rounds.cc:107] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:22:42.848742  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.849565  3917 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:22:42.850988  4580 raft_consensus.cc:2889] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.848742  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:42.852387  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.853199  3844 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
W20260709 12:22:42.855892  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.790488  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.822314  3890 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:42.938155  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 115987us
I20260709 12:22:42.940085  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.736280  8615 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:42.946283  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:42.947773  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.949057  3890 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:42.970413  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 292571us
I20260709 12:22:42.740118  8588 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:42.977736  3890 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:42.974973  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2456) took 1094 ms. Trace:
I20260709 12:22:42.976028  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:42.800655  8733 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:42.980757  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:42.791529  8753 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:42.979492  3922 rpcz_store.cc:276] 0709 12:22:41.880600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.945996 (+1065396us) service_pool.cc:224] Handling call
0709 12:22:42.974900 (+ 28904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.850131  8774 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:42.945648  8742 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:42.988444  3847 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:42.988940  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:42.975593  8608 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.949414  8791 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:42.744344  8672 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.994320  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:42.789064  8555 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:42.982452  8740 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:42.983649  8719 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:42.985688  8688 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.002385  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:42.995639  8678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.028s	sys 0.040s
I20260709 12:22:43.008708  3849 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:43.014407  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.997498  8774 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.997644  8609 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.015801  3917 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:43.021544  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2461) took 1139 ms. Trace:
I20260709 12:22:43.021869  3917 rpcz_store.cc:276] 0709 12:22:41.882170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.998954 (+1116784us) service_pool.cc:224] Handling call
0709 12:22:43.012984 (+ 14030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.021293 (+  8309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.021494 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:43.017449  8696 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 2.598s	user 0.006s	sys 0.019s
W20260709 12:22:43.024288  8632 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.708s	user 0.013s	sys 0.000s
I20260709 12:22:43.025755  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:43.002403  8791 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.029405  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 637) took 2698 ms. Trace:
I20260709 12:22:43.029856  3991 rpcz_store.cc:276] 0709 12:22:40.330723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.352527 (+ 21804us) service_pool.cc:224] Handling call
0709 12:22:43.028584 (+2676057us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:22:43.028804 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.029006 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.029033 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.029080 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.029119 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.029175 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.029299 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163439872}
W20260709 12:22:43.034283  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.998541  8417 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.037307  8417 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.038606  8788 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:43.039240  8788 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:43.040275  8788 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.041690  8791 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:42.998728  8608 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.051285  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.052294  4580 raft_consensus.cc:2410] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:43.053280  8608 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.054198  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 638) took 2647 ms. Trace:
W20260709 12:22:43.055152  8592 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.003s
I20260709 12:22:43.055662  8592 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:43.056243  3916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2453) took 2538 ms (client timeout 2779 ms). Trace:
W20260709 12:22:43.056661  3916 rpcz_store.cc:269] 0709 12:22:40.518204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.736550 (+218346us) service_pool.cc:224] Handling call
0709 12:22:43.056012 (+2319462us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000f9954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:43.056156 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414197632}
I20260709 12:22:43.057945  8592 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.058111  3916 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:22:43.058802  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2980) took 1079 ms. Trace:
I20260709 12:22:43.059257  3916 rpcz_store.cc:276] 0709 12:22:41.979058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.057487 (+1078429us) service_pool.cc:224] Handling call
0709 12:22:43.057854 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.058527 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.058749 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.060211  3917 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.031868  8792 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:43.060674  3916 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:43.062033  8615 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.063009  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2981) took 1083 ms. Trace:
I20260709 12:22:43.054593  3994 rpcz_store.cc:276] 0709 12:22:40.406843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.407550 (+   707us) service_pool.cc:224] Handling call
0709 12:22:43.053288 (+2645738us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579ccfc0 00007fdc579b7929 00007fdc579b73d2 00007fdc50f2ebd4
0709 12:22:43.053513 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.053833 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.053907 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.053950 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.053990 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.054046 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.054144 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401152}
I20260709 12:22:43.063879  3916 rpcz_store.cc:276] 0709 12:22:41.979324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.060138 (+1080814us) service_pool.cc:224] Handling call
0709 12:22:43.060418 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.062436 (+  2018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.062935 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.065250  3916 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:43.060861  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1233) took 1083 ms. Trace:
I20260709 12:22:43.065943  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2983) took 1086 ms. Trace:
I20260709 12:22:43.066183  3917 rpcz_store.cc:276] 0709 12:22:41.977006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.022581 (+1045575us) service_pool.cc:224] Handling call
0709 12:22:43.060042 (+ 37461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.060638 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.060810 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.066392  3916 rpcz_store.cc:276] 0709 12:22:41.979861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.064687 (+1084826us) service_pool.cc:224] Handling call
0709 12:22:43.065031 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.065680 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.065889 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.070205  8672 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.071046  8792 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:43.072089  8792 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:43.078984  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 99384.4us
I20260709 12:22:43.082243  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.079494  3922 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:43.088200  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2449) took 2582 ms. Trace:
I20260709 12:22:43.088280  8705 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:43.088914  8705 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:43.088676  3924 rpcz_store.cc:276] 0709 12:22:40.505689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.970259 (+464570us) service_pool.cc:224] Handling call
0709 12:22:40.994101 (+ 23842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.690461 (+696360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.087944 (+1397483us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540024fc54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:43.088135 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579296640}
I20260709 12:22:43.090058  8705 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.090955  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 267) took 7163 ms. Trace:
I20260709 12:22:43.091152  8705 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.093101  3746 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 6, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.104640  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1218) took 3213 ms. Trace:
I20260709 12:22:43.105209  3925 rpcz_store.cc:276] 0709 12:22:39.891502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.438750 (+547248us) service_pool.cc:224] Handling call
0709 12:22:40.438997 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.708072 (+1269075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.708117 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.708176 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:41.708220 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.104250 (+1396030us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400244ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:43.104336 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.104559 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917957888}
I20260709 12:22:43.105590  3746 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 7 to 8, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.093084  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.092011  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.110222  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.109571  3990 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:43.111017  3994 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:43.092732  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.111406  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3133) took 1200 ms. Trace:
I20260709 12:22:43.102500  3745 rpcz_store.cc:276] 0709 12:22:35.927262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.927929 (+   667us) service_pool.cc:224] Handling call
0709 12:22:43.090866 (+7162937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:38.817509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:38.836028 (+ 18519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:38.836069 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:22:38.836091 (+    22us) tablet.cc:662] Decoding operations
0709 12:22:38.836512 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:38.836576 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:38.836610 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:38.836841 (+   231us) tablet.cc:701] Row locks acquired
0709 12:22:38.836857 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:38.837060 (+   203us) write_op.cc:270] Start()
0709 12:22:38.837190 (+   130us) write_op.cc:276] Timestamp: P: 1783599758836993 usec, L: 0
0709 12:22:38.837211 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:22:38.838017 (+   806us) log.cc:844] Serialized 533 byte log entry
0709 12:22:39.232765 (+394748us) op_driver.cc:464] REPLICATION: finished
0709 12:22:39.329134 (+ 96369us) write_op.cc:301] APPLY: starting
0709 12:22:39.329243 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:39.330353 (+  1110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:39.330534 (+   181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:39.366786 (+ 36252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:39.376001 (+  9215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:22:39.409614 (+ 33613us) write_op.cc:312] APPLY: finished
0709 12:22:39.428492 (+ 18878us) log.cc:844] Serialized 25 byte log entry
0709 12:22:39.464165 (+ 35673us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:39.477045 (+ 12880us) write_op.cc:454] Released schema lock
0709 12:22:39.500157 (+ 23112us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:39.610893 (+110736us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:39.612597 (+  1704us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1131032,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":93665,"apply.run_cpu_time_us":4256,"apply.run_wall_time_us":212890,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":3048,"prepare.run_wall_time_us":26456,"replication_time_us":374287,"thread_start_us":100524,"threads_started":1}]]}
I20260709 12:22:43.110944  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.111814  3848 rpcz_store.cc:276] 0709 12:22:41.913601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.116396 (+202795us) service_pool.cc:224] Handling call
0709 12:22:42.116758 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.627008 (+510250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.111184 (+484176us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400407754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:43.111350 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094742912}
I20260709 12:22:43.116142  3746 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 2 to 3, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.117157  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:43.118376  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.118072  3746 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 6 to 7, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 7 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.119176  3848 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:43.120409  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.122030  3848 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:43.122687  8600 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.123219  3848 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:43.091094  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:43.109266  3843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 3118) took 2192 ms (client timeout 1916 ms). Trace:
W20260709 12:22:43.124112  3843 rpcz_store.cc:269] 0709 12:22:40.917251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.920021 (+  2770us) service_pool.cc:224] Handling call
0709 12:22:43.108950 (+2188929us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b5400409a54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:43.109111 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37180800}
I20260709 12:22:43.124637  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.119733  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 9 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 10 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.125654  3843 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:43.126291  8791 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:43.095167  8730 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.127221  8745 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.128479  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.129339  8791 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:43.127647  3746 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 10 to 11, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 11 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.130018  8390 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.130506  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:43.131309  8791 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:43.133883  8705 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:43.135638  8791 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:43.136049  8791 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:43.130740  3746 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.137037  8791 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.138850  8791 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.141258  8556 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.144412  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:43.147856  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 65700.9us
I20260709 12:22:43.148640  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.149333  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.150310  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.146809  3994 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:43.092301  3991 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:43.151714  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.153119  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.154156  3994 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:43.156755  3992 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:43.179522  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:43.147312  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.176339  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.156013  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:43.185650  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.188073  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.190388  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:43.196192  8707 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 2.361s	user 0.004s	sys 0.000s
I20260709 12:22:43.196487  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.176314  8592 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.198757  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.185684  3992 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:43.031715  8774 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.203577  8774 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:43.207948  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 59391.1us
I20260709 12:22:43.208874  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.209762  8720 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:43.209961  8555 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.210549  8720 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:43.210986  8720 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:43.211330  8720 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:43.214027  8616 consensus_meta.cc:287] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.073s	user 0.009s	sys 0.004s
I20260709 12:22:43.216349  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3138) took 1148 ms. Trace:
I20260709 12:22:43.216840  3845 rpcz_store.cc:276] 0709 12:22:42.069473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.972234 (+902761us) service_pool.cc:224] Handling call
0709 12:22:42.987062 (+ 14828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.987278 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.987303 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:42.987789 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.043689 (+ 55900us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.043724 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.043793 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.216072 (+172279us) raft_consensus.cc:1685] finished
0709 12:22:43.216099 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.216278 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":34909,"threads_started":1,"wal-append.queue_time_us":80331}
I20260709 12:22:43.219017  3845 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:22:43.219561  8786 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.220152  8786 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.221315  8544 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:22:43.187180  8729 consensus_meta.cc:287] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 12:22:43.216415  8746 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.223752  8729 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.224644  8773 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:43.225158  8773 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:43.225962  3845 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:43.226212  8773 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.229627  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.234596  8784 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:43.235226  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:43.127732  8745 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:43.235992  8745 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.083328  8609 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:43.239177  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.237090  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.262499  4547 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:43.266748  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:43.267375  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.271621  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.155890  8742 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:22:43.235255  8784 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.236403  8701 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.278091  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.278977  3848 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:43.272780  8529 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.279811  8595 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.282088  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.282976  8784 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.282887  8595 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.285334  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.286185  4578 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:43.286239  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.286536  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:43.284792  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.288018  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.292057  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.275418  8697 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:43.276410  8773 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:43.271142  8799 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:22:43.297780  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.299100  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.298177  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.299520  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.299959  3992 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:43.289592  8589 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.270634  8609 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.307070  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.296103  8697 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.308032  3992 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
W20260709 12:22:43.307058  8716 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 12:22:43.305384  8786 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:43.315958  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.318593  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.319284  3991 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:43.323405  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.324764  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.328913  8595 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.329758  3998 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:43.330437  8609 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:43.330703  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.331532  3992 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:43.332397  8715 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.328874  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.334403  8595 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.343214  8595 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:43.289297  8701 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.347532  8553 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.348275  8553 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.351863  4582 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:43.355695  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:43.357510  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 143816us
I20260709 12:22:43.358040  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1235) took 1018 ms. Trace:
I20260709 12:22:43.358457  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.359388  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.360071  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:43.357324  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:43.362692  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:43.314278  8697 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:43.366143  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.371145  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.371794  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.373884  3999 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:43.369786  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.376677  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.377918  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.361123  8595 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:43.390950  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.392611  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.362859  8596 raft_consensus.cc:2764] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:22:43.408694  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.366199  8720 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.397912  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.366715  8609 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.367100  8616 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:22:43.460621  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.378396  8615 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:43.477216  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.362974  8600 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:22:43.376672  8759 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.394758  8632 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:43.386914  8595 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:43.469237  8616 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:43.480610  8786 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.399153  8760 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 12:22:43.503494  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.468693  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer bd47d64594f743eba2922d79251c1c5c from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:22:43.514586  3732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 130155us
W20260709 12:22:43.515295  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 124464us
I20260709 12:22:43.492331  8632 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.496238  8615 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:43.498741  8595 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:43.502442  8685 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.507027  8616 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:43.525883  8632 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.549098  3850 raft_consensus.cc:2410] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:22:43.556362  8816 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:22:43.561828  8812 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:22:43.590269  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3101) took 3859 ms. Trace:
I20260709 12:22:43.590730  3849 rpcz_store.cc:276] 0709 12:22:39.731228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.996017 (+2264789us) service_pool.cc:224] Handling call
0709 12:22:42.006848 (+ 10831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.009352 (+1002504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.590005 (+580653us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400118fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:43.590198 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303379712}
W20260709 12:22:43.576143  8807 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:22:43.592839  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2163) took 1379 ms. Trace:
I20260709 12:22:43.593461  8604 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.593266  3996 rpcz_store.cc:276] 0709 12:22:42.213761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.213920 (+   159us) service_pool.cc:224] Handling call
0709 12:22:42.214356 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.237431 (+ 23075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.237472 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:42.238112 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.102487 (+864375us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b1800479080. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:43.299354 (+196867us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.299396 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.300348 (+   952us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.592526 (+292178us) raft_consensus.cc:1685] finished
0709 12:22:43.592549 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.592771 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":16876,"spinlock_wait_cycles":2300160,"thread_start_us":196163,"threads_started":1,"wal-append.queue_time_us":1126134}
I20260709 12:22:43.577771  8720 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.578929  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:43.579272  8814 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:22:43.585184  3964 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 2.064s (SENT)
I20260709 12:22:43.597810  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.600540  8536 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:43.600679  8615 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:43.601750  8710 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:43.600327  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.602398  8710 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.603087  8753 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.570837  8686 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.605161  8686 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.596760  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:43.601445  8615 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.604509  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.597041  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.609326  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.610178  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.570108  8685 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.618723  3849 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:43.620657  8748 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.620563  8716 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:43.621533  8748 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.621688  8716 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.615496  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.623546  8792 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:43.624138  3918 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:43.625376  8792 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:43.627807  8596 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:43.628080  8792 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:43.628326  8596 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:43.629083  8596 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:43.606739  8732 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.635668  8604 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:43.638034  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.641121  3998 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:43.641335  3848 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:43.642184  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.643353  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.638739  8577 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.638900  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.614173  8788 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:43.644186  3998 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:22:43.645654  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.639070  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2439) took 4316 ms. Trace:
I20260709 12:22:43.649765  3991 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:43.649626  3920 rpcz_store.cc:276] 0709 12:22:39.322385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.351438 (+1029053us) service_pool.cc:224] Handling call
0709 12:22:40.943556 (+592118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.969431 (+ 25875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.638820 (+2669389us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540024f750. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:43.639000 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206299008}
I20260709 12:22:43.657232  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:43.659849  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.633231  8720 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:43.613852  8745 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.685561  8786 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:43.696395  3994 raft_consensus.cc:2410] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:43.697151  8685 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.697500  8745 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.661849  8799 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.685688  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.686906  8720 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.659329  8710 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.655805  8577 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.680800  8686 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.658780  8773 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.694626  8595 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.695070  8758 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.638567  8632 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.698601  8799 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:43.687472  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.700632  3991 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:43.698443  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.689082  8716 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.692956  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.726322  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.658178  8732 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:43.718082  8773 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.731751  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.725787  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.733824  3991 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:43.722656  8799 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.703727  8556 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:22:43.743690  8773 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.744119  8615 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.744385  8686 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.744961  8632 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.744172  8732 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:22:43.746068  8748 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.747326  8577 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.750280  8616 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.751677  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.711536  8697 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.727305  8720 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.735350  8716 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:43.756982  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:43.757263  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.758100  8595 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.769061  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.873085  3999 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:43.874197  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:43.874821  3999 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:43.770627  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:43.771171  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.875680  3991 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:43.772928  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.769114  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.789000  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.794091  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.877420  4578 raft_consensus.cc:2410] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:22:43.794261  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:43.877552  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.878049  3998 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 4.
W20260709 12:22:43.776950  3962 connection.cc:256] RPC call timeout handler was delayed by -1.1267481199997746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 12:22:43.770951  8553 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.801985  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.881271  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:43.882053  3849 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:43.882876  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.788158  8685 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:43.838517  8804 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.753s	user 0.004s	sys 0.000s
I20260709 12:22:43.883775  8685 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.795392  8686 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.884327  8691 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.884851  8691 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.885236  8691 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:43.886198  8686 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.853829  4576 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:22:43.855409  8733 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:43.855659  8697 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.856271  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 712) took 1311 ms. Trace:
I20260709 12:22:43.778317  8672 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:43.805480  8739 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:43.864023  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.857107  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 721) took 1274 ms. Trace:
I20260709 12:22:43.870193  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:43.878954  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 121801us
I20260709 12:22:43.892423  4574 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:22:43.891086  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:22:43.888219  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 99325.6us
I20260709 12:22:43.896225  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:43.892871  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.889245  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.888180  4579 rpcz_store.cc:276] 0709 12:22:42.544981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.545478 (+   497us) service_pool.cc:224] Handling call
0709 12:22:43.856072 (+1310594us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54005a0354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:43.856200 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446417152}
W20260709 12:22:43.889803  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.867018  8596 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.887135  8733 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.899891  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:43.900571  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.929802  8733 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:43.932806  8763 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:43.933322  8763 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:43.933648  8784 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:43.934502  8595 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.934252  8763 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.936302  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3099) took 4210 ms. Trace:
I20260709 12:22:43.936426  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:43.936722  3847 rpcz_store.cc:276] 0709 12:22:39.725683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.436100 (+2710417us) service_pool.cc:224] Handling call
0709 12:22:42.436465 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.992185 (+555720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.936059 (+943874us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400408654. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:43.936236 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268838784}
I20260709 12:22:43.940239  3962 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.886246  8685 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.893903  4582 rpcz_store.cc:276] 0709 12:22:42.583251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.587669 (+  4418us) service_pool.cc:224] Handling call
0709 12:22:43.856938 (+1269269us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54004b5fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:43.857044 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560832896}
I20260709 12:22:43.926368  8632 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:43.926891  8615 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:43.927366  3845 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:43.925765  8553 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.927561  8616 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:43.940985  3999 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:43.955797  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.937695  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.942457  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:43.860932  8716 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.891248  8686 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:43.941424  8745 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:22:43.957592  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:43.959064  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 274172us
I20260709 12:22:43.978184  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:43.891601  8739 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:43.983639  8688 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:43.895005  8672 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:43.986114  8672 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:43.940706  8763 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:43.943235  8784 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:43.898494  8742 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:22:43.946055  8632 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.992039  8596 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:43.992152  8632 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:43.992383  8739 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:43.993564  8739 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:43.948498  8615 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.995718  8615 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:43.951858  8553 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.998972  8553 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.976078  3847 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:44.001021  3847 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:43.949371  4575 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:43.960911  8788 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:43.976507  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:43.959401  8536 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:22:44.004760  3847 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:43.956302  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:43.981447  8416 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:43.972440  8556 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.981741  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.982559  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.006132  3847 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:22:44.008172  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51952.9us
I20260709 12:22:44.048146  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:44.049010  3999 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.051268  3994 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:44.052295  3991 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:44.052793  3843 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:22:44.056569  3814 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:44.057528  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75038.5us
I20260709 12:22:44.058565  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:44.060043  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:44.061714  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:43.976739  8686 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:44.065073  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:44.069144  3991 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:44.071201  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.042976  8784 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:44.075999  8672 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.076251  8784 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.076754  8784 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.076622  8672 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.078917  8672 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.080417  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.081669  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:44.082885  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:44.083423  8748 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:44.083638  8440 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:44.083729  8672 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:44.084259  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:44.089236  3999 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:44.084286  8672 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:44.090451  3994 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:44.008833  8416 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.084450  8440 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:44.090675  8672 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:44.063113  8720 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:44.068632  8686 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.066416  8688 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:44.071959  8758 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:44.189560  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:44.191226  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:44.196122  4575 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:44.084805  8435 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:44.086494  8788 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:44.129287  8791 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:44.086102  8830 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:44.119236  8416 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:44.227825  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 454562us
W20260709 12:22:44.228945  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.231499  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:44.065780  8556 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.144287  8756 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:44.144729  8440 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.240429  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:44.247009  3998 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:44.193367  8773 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.221608  8688 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:44.222636  8435 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:44.226176  8791 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:44.232348  8830 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.250581  8440 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.243674  8756 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:44.225618  8720 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:22:44.298730  8828 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 12:22:44.308756  3850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 3102) took 4570 ms (client timeout 2031 ms). Trace:
I20260709 12:22:44.277168  8435 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.274786  8685 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.281924  8791 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.313448  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2458) took 2432 ms. Trace:
I20260709 12:22:44.322062  3922 rpcz_store.cc:276] 0709 12:22:41.881236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.984941 (+1103705us) service_pool.cc:224] Handling call
0709 12:22:42.985723 (+   782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.143843 (+158120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.313183 (+1169340us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b540017ded4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:44.313386 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215165184}
W20260709 12:22:44.309266  3850 rpcz_store.cc:269] 0709 12:22:39.731756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.987380 (+255624us) service_pool.cc:224] Handling call
0709 12:22:44.301496 (+4314116us) spinlock_profiling.cc:243] Waited 3.47 s on lock 0x7b540008ded4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:44.301677 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7970849024}
I20260709 12:22:44.288548  8830 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:44.327955  3998 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:22:44.251981  8773 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.332841  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:44.335626  3850 raft_consensus.cc:2376] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12. Re-sending same reply.
I20260709 12:22:44.343066  8440 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.358103  8440 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.329783  8685 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.363637  8756 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.368528  8556 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:44.379485  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 423693us
I20260709 12:22:44.274057  8588 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.376551  8500 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:44.432165  8691 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.003s
I20260709 12:22:44.415037  8758 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:44.447995  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.434922  8588 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.460778  3850 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:22:44.500684  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 412210us
I20260709 12:22:44.451572  8500 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.502974  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.427207  8688 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.461283  8691 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.516443  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:44.505908  8716 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.502338  8748 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:44.519642  8685 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.535329  3849 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:44.531070  8728 raft_consensus.cc:2764] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:44.540329  4582 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:22:44.550652  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1230) took 2676 ms. Trace:
I20260709 12:22:44.551276  3921 rpcz_store.cc:276] 0709 12:22:41.874298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.876097 (+  1799us) service_pool.cc:224] Handling call
0709 12:22:41.876480 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.944927 (+ 68447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.944965 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.945007 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:41.945043 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.550303 (+2605260us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b540036fbd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:44.550371 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.550571 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156913536}
W20260709 12:22:44.559723  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 56861.7us
I20260709 12:22:44.560441  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.561138  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:22:44.568465  8763 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.581s	user 0.020s	sys 0.009s
I20260709 12:22:44.569885  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:44.570233  8632 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.003s
I20260709 12:22:44.570746  8632 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.571853  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.571318  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.573190  8632 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.573364  3850 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:44.574831  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.536628  8758 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.580017  3845 raft_consensus.cc:2410] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:44.581234  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:44.581719  8500 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.562065  8432 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:44.582624  8432 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.584424  8728 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:44.584872  8728 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.585224  8728 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.585713  8432 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.587625  8688 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:44.588397  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.589244  3922 raft_consensus.cc:2368] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:44.589804  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.592861  8691 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.595899  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.596243  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.597100  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.597236  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.597786  3925 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:44.595899  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.598699  3916 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:22:44.599845  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.600517  3919 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:44.600741  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.602447  8773 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.609077  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.588325  8688 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:44.611383  3916 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:22:44.612304  3815 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.966s (SENT) [suppressed 32 similar messages]
I20260709 12:22:44.613279  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:44.607776  8784 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.007s
I20260709 12:22:44.619268  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.623584  3921 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:44.627393  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:44.621114  8739 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.007s
I20260709 12:22:44.636869  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:44.632089  8553 consensus_meta.cc:287] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.631s	user 0.023s	sys 0.000s
I20260709 12:22:44.620249  8845 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:44.628546  8773 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:44.617934  8830 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.625747  8784 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.650084  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:44.660254  8799 consensus_meta.cc:287] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.881s	user 0.002s	sys 0.010s
I20260709 12:22:44.666376  8799 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.616691  8748 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.670034  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:44.660863  8830 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.649490  8845 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.661509  3923 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:44.662767  3921 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:44.650883  8773 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.665665  8784 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.674914  3916 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:44.676652  8845 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.676898  8686 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.677104  8416 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.705464  8416 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.678352  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:43.358898  3924 rpcz_store.cc:276] 0709 12:22:42.339531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.089871 (+750340us) service_pool.cc:224] Handling call
0709 12:22:43.090206 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.090402 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:43.239800 (+149398us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.357541 (+117741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.357620 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:43.357686 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.357772 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.357958 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":210621,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":1714,"thread_start_us":265988,"threads_started":2}
I20260709 12:22:44.707630  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.708954  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.710152  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:44.650753  8615 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.654s	user 0.020s	sys 0.009s
I20260709 12:22:44.711890  8615 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.713559  8773 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.714308  8615 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:44.684646  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.686242  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.716393  8701 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.717348  8435 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.718667  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:44.686615  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 306311us
I20260709 12:22:44.687108  8743 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:44.671169  8799 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.690282  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.720160  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:44.720827  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.700497  8688 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.683727  8672 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.648131  8553 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.723415  3917 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:44.725917  3917 pending_rounds.cc:85] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 6
I20260709 12:22:44.726166  3917 pending_rounds.cc:107] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:44.726387  3917 raft_consensus.cc:2889] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:44.722970  3916 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:22:44.711310  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.699127  3921 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:22:44.724048  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:44.727643  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.728258  3916 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:44.728681  3918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 2970) took 5291 ms (client timeout 2089 ms). Trace:
I20260709 12:22:44.729063  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.729522  3916 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:22:44.729328  3918 rpcz_store.cc:269] 0709 12:22:39.432311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.138871 (+706560us) service_pool.cc:224] Handling call
0709 12:22:44.722918 (+4584047us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b5400216454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:44.723072 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7910029568}
I20260709 12:22:44.730145  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.730540  3916 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:44.725093  3920 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:44.731003  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.731098  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.720861  8435 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.733758  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.735329  3918 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:44.736338  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.737918  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.742686  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.739727  8408 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:22:44.744547  3924 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:44.721542  8688 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.747588  8791 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.749647  8688 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.740053  8834 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:44.753682  8826 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.685s	user 0.000s	sys 0.004s
I20260709 12:22:44.756242  8834 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.756659  8834 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:44.757133  8672 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.758064  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 655) took 1186 ms. Trace:
I20260709 12:22:44.741075  8728 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.758783  3995 rpcz_store.cc:276] 0709 12:22:43.571958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.572196 (+   238us) service_pool.cc:224] Handling call
0709 12:22:43.573660 (+  1464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.574159 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.574202 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.574849 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.793331 (+218482us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:43.818556 (+ 25225us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.828701 (+ 10145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.828787 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.687250 (+858463us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:44.757604 (+ 70354us) raft_consensus.cc:1685] finished
0709 12:22:44.757748 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.757966 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24950,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":2357,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":13460,"spinlock_wait_cycles":35089792,"thread_start_us":217926,"threads_started":1,"wal-append.queue_time_us":398775}
W20260709 12:22:44.758241  8808 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 12:22:44.766204  8848 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:22:44.770790  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:44.749686  8791 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.778774  3992 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.780616  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.774494  8728 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:44.779851  8701 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:44.787627  8577 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:44.793064  8577 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:44.793470  8577 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:44.794008  8786 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:44.794333  8786 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:44.795033  8786 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.787011  8529 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:22:44.796025  8786 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:44.796600  8529 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.797027  8529 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:44.797902  8529 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.798606  8834 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.800933  8834 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:44.802057  8548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.694s	user 0.004s	sys 0.002s
W20260709 12:22:44.802434  8548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.694s	user 0.004s	sys 0.002s
I20260709 12:22:44.802479  8588 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:44.802933  8588 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:44.799216  8529 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.803788  8588 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.804759  8588 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:44.792331  8553 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:44.801687  8710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.009s	sys 0.017s
I20260709 12:22:44.859838  3841 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 16. Current term is 18. Ops: []
I20260709 12:22:44.862033  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:44.862789  3842 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:44.863790  3845 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:44.870057  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:44.882638  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.883607  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.884532  3919 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:44.883770  3924 raft_consensus.cc:2376] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
W20260709 12:22:44.807633  8710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.010s	sys 0.017s
I20260709 12:22:44.892535  8686 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:44.894215  3922 raft_consensus.cc:2368] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
W20260709 12:22:44.896391  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.896481  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.898097  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:44.898484  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.899271  3924 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:44.743728  3918 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 3.
I20260709 12:22:44.899811  8615 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:44.900487  3997 raft_consensus.cc:1240] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:44.900605  3925 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:44.900789  8615 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.908797  3850 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:44.913820  3921 raft_consensus.cc:2376] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12. Re-sending same reply.
I20260709 12:22:44.917377  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 3147) took 1126 ms. Trace:
I20260709 12:22:44.917912  3849 rpcz_store.cc:276] 0709 12:22:43.790432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.882621 (+ 92189us) service_pool.cc:224] Handling call
0709 12:22:44.916919 (+1034298us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000a4bd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:44.917193 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494784256}
I20260709 12:22:44.921080  8672 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:44.922194  8672 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:44.922732  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:44.922914  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.918990  3888 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.924091  3924 raft_consensus.cc:2376] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14. Re-sending same reply.
I20260709 12:22:44.940356  3919 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:44.941792  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.943434  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.951308  3919 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
W20260709 12:22:44.956642  8802 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.872s	user 0.003s	sys 0.010s
I20260709 12:22:44.959575  3845 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:44.967618  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49072.3us
I20260709 12:22:44.967885  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2331) took 2666 ms. Trace:
I20260709 12:22:44.969007  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:44.969106  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.970031  8757 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:44.970451  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2172) took 2522 ms. Trace:
I20260709 12:22:44.970104  4580 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:22:44.972718  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.964771  8774 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:22:44.976456  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:44.975060  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.978664  8859 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:44.972014  3844 rpcz_store.cc:276] 0709 12:22:42.301178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.983824 (+682646us) service_pool.cc:224] Handling call
0709 12:22:42.984218 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.009183 (+ 24965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.009215 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.017276 (+  8061us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.080644 (+ 63368us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:43.080689 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.080754 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.955418 (+1874664us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:44.967183 (+ 11765us) raft_consensus.cc:1685] finished
0709 12:22:44.967209 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.967655 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24532,"raft.queue_time_us":24653,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":8002,"spinlock_wait_cycles":210009984,"thread_start_us":62827,"threads_started":1,"wal-append.queue_time_us":67042}
W20260709 12:22:44.979573  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 177412us
I20260709 12:22:44.981748  8729 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.981921  8792 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:44.982650  8729 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.982980  8792 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.986114  8792 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:44.987803  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.988756  3924 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:44.986171  8753 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.990140  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:44.990093  8753 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:44.991248  3924 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:44.974066  3997 rpcz_store.cc:276] 0709 12:22:42.448164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.449602 (+  1438us) service_pool.cc:224] Handling call
0709 12:22:42.450051 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.901023 (+2450972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.970060 (+ 69037us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54003e3854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:44.970297 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5602315136}
I20260709 12:22:45.002357  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.003410  3922 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:44.622195  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.013912  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.014860  3925 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:45.019873  8672 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:45.020236  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44241.1us
I20260709 12:22:45.022245  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.023167  3844 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.028997  8753 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:45.029358  8756 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.021670  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:45.037611  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 69060.9us
W20260709 12:22:45.038748  3846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34156 (request call id 3139) took 2868 ms (client timeout 2244 ms). Trace:
W20260709 12:22:45.039287  3846 rpcz_store.cc:269] 0709 12:22:42.169877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.196184 (+ 26307us) service_pool.cc:224] Handling call
0709 12:22:45.038254 (+2842070us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540011b7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:45.038482 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807529216}
I20260709 12:22:45.039999  8842 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:45.040328  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.040772  8842 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:45.030375  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.041026  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.044523  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.045884  8686 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:45.046710  8686 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:45.048136  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2357) took 1439 ms. Trace:
I20260709 12:22:45.048197  8686 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.048777  3848 rpcz_store.cc:276] 0709 12:22:43.608828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.609014 (+   186us) service_pool.cc:224] Handling call
0709 12:22:45.047696 (+1438682us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54001199d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:45.047904 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71762176}
I20260709 12:22:45.050319  8672 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.050513  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.051370  3919 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.051162  8672 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.054189  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1106) took 1740 ms. Trace:
I20260709 12:22:45.054570  8672 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:45.056660  8615 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.061481  8840 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:45.062621  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1076) took 5030 ms. Trace:
I20260709 12:22:45.043591  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.063648  3845 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:45.064606  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 2986) took 3083 ms. Trace:
I20260709 12:22:45.065176  3917 rpcz_store.cc:276] 0709 12:22:41.980603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.067115 (+1086512us) service_pool.cc:224] Handling call
0709 12:22:44.723052 (+1655937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.726844 (+  3792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.064195 (+337351us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400216450. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:45.064391 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3807081728}
I20260709 12:22:45.066687  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.072376  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 648) took 1707 ms. Trace:
I20260709 12:22:45.072947  3992 rpcz_store.cc:276] 0709 12:22:43.364465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.364602 (+   137us) service_pool.cc:224] Handling call
0709 12:22:43.364921 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.781895 (+1416974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.071870 (+289975us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001996d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:45.072175 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3251087744}
I20260709 12:22:45.076491  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.077725  3916 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.077997  4548 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.081099  8744 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:45.081277  3842 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.081609  8744 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.081991  8744 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.046734  8842 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.063127  3841 rpcz_store.cc:276] 0709 12:22:40.032456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.287010 (+254554us) service_pool.cc:224] Handling call
0709 12:22:44.303023 (+4016013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.860962 (+557939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.061561 (+200599us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540008ded4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:45.062350 (+   789us) spinlock_profiling.cc:243] Waited 4.02 s on lock 0x7b540008ded0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:45.062524 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10513884288}
I20260709 12:22:45.042604  8729 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:45.095801  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.097541  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.098729  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.054797  3843 rpcz_store.cc:276] 0709 12:22:43.313764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.333102 (+ 19338us) service_pool.cc:224] Handling call
0709 12:22:43.333425 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.056315 (+722890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.053585 (+997270us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54001185d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:45.053953 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552633600}
I20260709 12:22:45.100832  3920 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:45.102821  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.106755  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.108196  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.108485  8615 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.108964  3922 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:45.109165  8615 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.109984  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.110262  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.111980  3923 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:45.112705  3920 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
I20260709 12:22:45.115067  3918 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:45.115576  8615 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.117417  3923 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:45.128697  8581 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:45.131145  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 109814us
I20260709 12:22:45.131227  3745 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.132640  8581 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:45.134311  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.099403  3921 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.121171  8592 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:45.072404  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:45.123011  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.122058  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 166) took 6188 ms. Trace:
I20260709 12:22:45.127527  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.133469  3745 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.127838  3920 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:22:45.111920  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:45.147080  3918 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:45.145632  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.150389  3916 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:22:45.145933  8774 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:45.141378  3919 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:22:45.151460  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.151553  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.151283  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.161299  3844 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.146821  3745 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 12 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.162945  3924 raft_consensus.cc:2376] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5. Re-sending same reply.
I20260709 12:22:45.161146  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.156026  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.166441  3922 raft_consensus.cc:3055] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:45.169661  3917 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:45.168723  3922 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:45.170949  3843 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:45.176827  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.159811  8729 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:45.164319  8686 raft_consensus.cc:2764] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:22:45.185559  8553 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.141444  3746 rpcz_store.cc:276] 0709 12:22:38.933891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.934063 (+   172us) service_pool.cc:224] Handling call
0709 12:22:39.285124 (+351061us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:45.121803 (+5836679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:43.348614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:43.349237 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:43.349280 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:22:43.349300 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:43.350216 (+   916us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:43.350289 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:43.350322 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:43.350975 (+   653us) tablet.cc:701] Row locks acquired
0709 12:22:43.350991 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:43.351170 (+   179us) write_op.cc:270] Start()
0709 12:22:43.351291 (+   121us) write_op.cc:276] Timestamp: P: 1783599763351112 usec, L: 0
0709 12:22:43.351314 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:22:43.396527 (+ 45213us) log.cc:844] Serialized 2814 byte log entry
0709 12:22:43.931628 (+535101us) op_driver.cc:464] REPLICATION: finished
0709 12:22:44.338992 (+407364us) write_op.cc:301] APPLY: starting
0709 12:22:44.339134 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:44.343758 (+  4624us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:44.343870 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:44.599878 (+256008us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:44.600134 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:22:44.600180 (+    46us) write_op.cc:312] APPLY: finished
0709 12:22:44.600608 (+   428us) log.cc:844] Serialized 73 byte log entry
0709 12:22:44.600805 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.600926 (+   121us) write_op.cc:454] Released schema lock
0709 12:22:44.600975 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:44.601396 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:44.601425 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2184847,"reported_tablets":11,"spinlock_wait_cycles":12939136,"child_traces":[["op",{"apply.queue_time_us":398087,"apply.run_cpu_time_us":12717,"apply.run_wall_time_us":269779,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":163769,"prepare.run_cpu_time_us":8274,"prepare.run_wall_time_us":127708,"raft.queue_time_us":428735,"raft.run_cpu_time_us":94540,"raft.run_wall_time_us":346085,"replication_time_us":580148,"thread_start_us":742860,"threads_started":4,"wal-append.queue_time_us":79526}]]}
I20260709 12:22:45.186158  3845 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:45.187737  8577 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.189635  3922 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.192699  3842 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.173921  8592 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:45.211573  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.195720  8615 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:45.217500  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.217478  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.227682  3745 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 10 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.230093  3841 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:22:45.249490  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45600.6us
I20260709 12:22:45.252097  3922 raft_consensus.cc:3060] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.223918  8592 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.231372  8729 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:45.267097  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 154090us
I20260709 12:22:45.256335  8756 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:45.262795  3745 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 9, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 9 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:45.232558  8553 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:45.277153  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 126007us
I20260709 12:22:45.278258  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:45.291333  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:45.292330  3995 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:45.293107  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.293989  3843 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:45.292217  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:45.297238  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:45.307871  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:45.310285  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.294970  8788 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.328238  3990 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.331111  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.328121  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.328816  8756 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.341138  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.343794  3924 raft_consensus.cc:2393] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:45.344513  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.346004  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:45.350234  3919 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:45.355623  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102324us
I20260709 12:22:45.346886  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:45.364530  3920 raft_consensus.cc:2410] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:22:45.366513  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 82336.6us
I20260709 12:22:45.367650  3917 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:22:45.345352  8740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.035s	sys 0.053s
I20260709 12:22:45.378290  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.382828  3842 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:45.388636  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.391113  3921 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:45.368598  8672 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:45.394517  3841 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:22:45.374912  8740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.036s	sys 0.054s
I20260709 12:22:45.402330  3844 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:22:45.407186  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:45.411106  3918 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:45.412663  3999 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.405290  8672 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:45.412225  8788 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:45.425760  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63346.8us
W20260709 12:22:45.428176  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 166479us
I20260709 12:22:45.380859  8577 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:45.431165  8774 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:45.435678  8774 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.436122  8774 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.425767  8672 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.447860  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.417559  8792 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.407058  8728 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:22:45.450788  4548 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:45.423339  8744 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.462044  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:45.463035  3994 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:45.464336  8744 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:45.465292  4575 raft_consensus.cc:2368] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:22:45.467546  8588 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.468230  8588 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.470497  8588 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.432441  8613 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.476034  3990 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:22:45.476701  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.479055  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 105113us
I20260709 12:22:45.485663  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:45.489739  3991 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:45.490604  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:45.491109  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.459743  8729 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.475418  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:45.498477  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63827.9us
I20260709 12:22:45.432440  8595 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:45.493255  8867 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:22:45.491405  3997 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:45.436619  8743 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:22:45.509342  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.497098  8842 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:45.462117  8697 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:22:45.515508  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:45.498340  8553 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:45.512830  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:45.520326  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:45.526238  8740 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:45.526799  8740 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:45.527910  8740 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.529609  8740 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:45.539579  8615 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:45.540314  8615 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:45.541297  8615 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.515019  8756 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:45.547827  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 311962us
I20260709 12:22:45.552556  8588 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:45.553050  8588 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:45.554085  8588 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.507221  8792 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.561695  8792 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.578833  3999 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:45.580600  3995 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:22:45.581162  3845 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:45.513751  8577 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.582816  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:45.583932  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 155638us
W20260709 12:22:45.581634  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64436.4us
I20260709 12:22:45.518443  8744 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:45.590004  3992 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:45.594205  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:45.572319  8588 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:45.598492  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45739.3us
I20260709 12:22:45.522742  8592 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.506801  8613 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.602167  4575 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:45.600188  3991 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:22:45.603535  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97416.5us
I20260709 12:22:45.600805  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.604189  3994 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:22:45.595263  8581 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:45.611121  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 107727us
I20260709 12:22:45.613621  3919 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.596350  8744 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.608393  3997 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:45.513885  8595 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.594633  8788 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:45.617909  8744 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.624079  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2490) took 1008 ms. Trace:
I20260709 12:22:45.609139  8577 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:45.624634  3922 rpcz_store.cc:276] 0709 12:22:44.615257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.110957 (+495700us) service_pool.cc:224] Handling call
0709 12:22:45.111349 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.623584 (+512235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:45.623635 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:45.623696 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:45.623748 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.623836 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.623991 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35342,"raft.queue_time_us":38910}
I20260709 12:22:45.634342  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:45.631867  4546 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:45.630589  4582 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:22:45.602147  8842 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.643147  3995 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:45.635807  8740 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:45.647603  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.650707  8435 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:22:45.656968  8749 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:45.644799  8432 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:22:45.660396  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.661224  3918 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.666224  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.666599  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.670001  8595 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.670495  8613 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.670859  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.673728  3919 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.682828  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:45.688058  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.662194  8529 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:22:45.693545  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.694726  3920 raft_consensus.cc:2393] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:45.693545  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.697686  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:45.699589  8868 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:22:45.699667  8720 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:45.701826  3964 leader_election.cc:336] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.690s (SENT)
W20260709 12:22:45.703783  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77313us
I20260709 12:22:45.706254  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.707186  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.708491  8432 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:45.709149  8842 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:45.709714  8613 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:45.710192  8432 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:45.715306  3964 leader_election.cc:400] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:45.716261  3964 leader_election.cc:403] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.718000  8613 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:45.720583  8577 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.724185  8869 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:45.724752  8869 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.725181  8869 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.726781  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:45.692447  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60328us
I20260709 12:22:45.693630  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.648777  8792 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:22:45.744931  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.731253  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.727255  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.731278  8788 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:45.734649  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.751482  8743 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:45.753284  8743 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.753664  8743 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.754199  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:45.754626  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:45.755039  4576 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:45.756420  3917 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:45.756596  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:45.757573  4576 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.739557  8529 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:45.740249  4575 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:45.748176  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.751403  8686 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:45.751863  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:45.766414  4580 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:45.752185  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.751430  8788 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:45.735384  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:45.756865  8672 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.776458  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.778782  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:45.780126  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.792260  3917 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:45.792567  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:45.793327  3921 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:45.797814  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63275.1us
I20260709 12:22:45.776532  8788 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:45.771145  8686 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:45.808569  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 160320us
I20260709 12:22:45.778535  8842 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:45.808414  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.792088  8553 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:45.821827  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.819629  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:45.825685  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 75582.1us
I20260709 12:22:45.817657  8686 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:45.809067  8729 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:45.834209  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.823751  8756 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:45.821339  8553 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:45.874595  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:45.849851  8874 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:45.860811  3844 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:22:45.861688  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.862221  8870 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 12:22:45.872061  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 60617.5us
I20260709 12:22:45.872228  8615 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:45.847059  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:45.876397  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115524us
I20260709 12:22:45.807662  8774 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.888013  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:45.888259  8842 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:45.888814  8842 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.876113  8553 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.889374  8842 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.890110  8553 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:45.891625  3850 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:45.871078  8744 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.839629  8613 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:45.840826  8753 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:45.922921  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:45.929713  3921 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
W20260709 12:22:45.930795  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 111062us
I20260709 12:22:45.937196  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.938539  3844 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.945850  8872 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:45.947669  8875 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 12:22:45.948292  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:45.949368  3846 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:45.960762  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:45.905503  8744 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:45.966125  8842 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:45.968178  8759 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:45.968729  8759 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:45.969182  8759 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:45.972442  8672 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:45.903560  8874 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.975649  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.977438  4548 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:22:45.980530  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.930250  8615 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:45.994778  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:45.979398  8577 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:45.996472  3847 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:45.997243  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.001461  3844 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:45.910308  8756 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:45.984990  8432 raft_consensus.cc:2804] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.980291  8595 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.990239  8672 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:46.008597  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 124933us
I20260709 12:22:46.010715  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.018491  3844 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:22:46.021597  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97677.2us
I20260709 12:22:46.024636  8874 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.025468  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.026938  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.031213  4580 raft_consensus.cc:2410] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:22:46.032323  3841 raft_consensus.cc:1240] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:46.026947  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.038925  8864 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:46.040647  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.042135  8864 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:46.020463  8432 raft_consensus.cc:697] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.045316  8432 consensus_queue.cc:237] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.000746  8577 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.053228  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.048732  8613 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:46.058035  8756 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.060218  8615 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.060647  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.062444  8864 raft_consensus.cc:2764] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:46.007973  8792 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:46.064152  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.065821  4546 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.063215  8864 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:46.035061  8774 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:46.082759  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.048491  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47554.1us
I20260709 12:22:46.085470  8864 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:46.098490  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 216216us
W20260709 12:22:46.111426  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84559.2us
I20260709 12:22:46.112510  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.063666  8842 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:46.118660  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52956.1us
I20260709 12:22:46.084295  8672 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:46.047780  8869 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.120121  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.125440  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.126443  8891 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.094568  8753 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:46.114401  8864 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.132848  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:46.144170  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80153.7us
I20260709 12:22:46.123745  8592 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:46.147150  4582 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:46.127988  8792 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.153746  3846 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:46.154495  8792 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:46.128389  8774 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:46.128618  8744 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:46.156364  8744 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.156816  8744 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:46.159622  8871 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:46.160235  8871 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.161456  8871 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.163340  8886 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:46.168707  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51588us
I20260709 12:22:46.086086  8595 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.172072  8842 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:46.166564  8686 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.172946  8774 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:46.178390  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.128645  8672 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:46.201217  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.135427  8613 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:46.180054  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:46.206139  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.180160  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.129603  8581 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:46.203106  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.163173  8871 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:46.213864  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 101458us
I20260709 12:22:46.214752  3842 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:22:46.211035  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.197392  8774 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.183320  8842 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:46.223794  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.203986  8672 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:46.225392  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80325us
I20260709 12:22:46.227507  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.205008  8874 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:46.232697  3962 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.230850  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.215484  8872 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:46.148121  8577 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.213304  8740 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.238508  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.216463  8792 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:46.273734  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70946.6us
I20260709 12:22:46.206107  8729 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:46.238667  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.135600  8891 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.231757  8840 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:46.232450  8842 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:46.186465  8749 consensus_queue.cc:1059] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:22:46.310488  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73525.9us
I20260709 12:22:46.239313  8890 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:46.314618  8890 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.315227  8890 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.283160  8577 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.284642  8869 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.326067  8869 raft_consensus.cc:3055] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.326499  8869 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.327589  8869 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.328804  8595 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.329046  8869 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.285147  8613 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:46.272694  8792 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.332448  8792 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:46.333004  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 102865us
I20260709 12:22:46.334586  3964 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:46.292053  8788 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.292255  8864 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.277892  8889 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:22:46.293130  8884 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.237s	user 0.006s	sys 0.000s
I20260709 12:22:46.292925  8740 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.294381  8756 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:46.294910  8885 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 12:22:46.350296  8864 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.351671  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.351992  8686 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.352735  8686 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:46.296705  8887 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.237s	user 0.000s	sys 0.004s
W20260709 12:22:46.285190  8888 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.223s	user 0.004s	sys 0.009s
I20260709 12:22:46.234114  8743 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.354554  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.354936  8891 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.279279  8895 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:46.356096  8895 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.356297  8889 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:46.356684  8743 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:46.300514  8753 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:46.312704  8893 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:46.323205  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:46.357760  3848 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:46.300026  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.235932  8581 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.342204  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.339969  8840 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:46.346776  8899 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:46.348151  8729 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:46.348521  8740 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.353255  8686 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.356490  8895 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:46.313485  3993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:46.301811  8615 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:46.363657  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.371282  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 136479us
W20260709 12:22:46.376708  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 139132us
W20260709 12:22:46.407485  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 132748us
I20260709 12:22:46.408339  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:46.409438  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74950.1us
I20260709 12:22:46.418088  3814 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.427263  8899 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:46.379567  8729 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:46.428942  8899 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.410507  8864 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:46.440685  3843 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:46.442022  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:46.443514  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89198.7us
I20260709 12:22:46.378604  8842 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.429868  8889 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:46.454494  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:46.447340  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.454006  8744 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.456494  8729 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.457319  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.458846  8842 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.439352  8872 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.458920  8740 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:46.512197  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 73535.9us
I20260709 12:22:46.459860  8686 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.463649  8864 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:46.447549  8592 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:46.475198  3844 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:46.435014  8595 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:46.483755  3848 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:46.488775  3843 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:46.437430  8759 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.518229  8581 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.520664  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.537696  3842 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:46.538451  3848 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:46.541886  8435 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.542636  8435 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.546291  8435 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:46.549800  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63806.9us
I20260709 12:22:46.550957  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:46.551801  3849 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.524255  8729 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:46.561139  3847 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:46.562963  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.473109  8840 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.535983  8743 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:46.565709  3848 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:46.570421  8743 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:46.553846  8595 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.557242  8842 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:22:46.590907  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.576373  8743 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:46.564008  8592 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.573709  8615 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.583089  8842 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:46.613487  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 195498us
I20260709 12:22:46.614497  3964 leader_election.cc:400] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:22:46.614646  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.615043  3964 leader_election.cc:403] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:46.617198  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59184.3us
I20260709 12:22:46.604408  8788 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:46.626567  8792 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.627009  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:46.627971  8615 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:46.635039  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.633107  8792 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:46.635586  3993 raft_consensus.cc:606] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:46.636090  3993 raft_consensus.cc:614] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.637017  8792 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:22:46.638895  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44745us
I20260709 12:22:46.639667  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.617336  8842 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:46.659683  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45160.7us
I20260709 12:22:46.668948  8592 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.670051  8759 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.587630  8872 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:46.676257  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.682296  8908 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:46.683964  8904 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:46.684742  8904 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.607235  8864 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.687264  8886 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:46.687598  8874 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:46.687920  8886 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:46.690248  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.688287  8874 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:46.706971  3849 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
W20260709 12:22:46.707280  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55384.2us
I20260709 12:22:46.618471  8890 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.641224  8895 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:46.720353  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109943us
I20260709 12:22:46.723299  3845 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:22:46.710223  8874 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.711431  8908 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.724107  8592 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.738576  3918 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:46.675565  8595 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.747027  3917 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:46.746932  8529 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Committing config change with OpId 13.11: config changed from index 9 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:46.756373  8908 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.760329  3922 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 9 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:46.733742  8740 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.764345  8740 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.765404  8890 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:46.767242  8740 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:46.768805  8774 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
I20260709 12:22:46.769315  8774 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.770395  3846 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:46.771634  8592 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.772429  8774 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.766929  8553 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:46.774443  8592 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.774509  8904 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.760360  8886 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:46.779732  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45713.1us
I20260709 12:22:46.780184  8886 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:46.780766  3964 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:46.781090  3964 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:46.783816  8759 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:46.784221  3815 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:46.785365  8759 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:46.785501  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:46.806803  8595 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:46.807312  8595 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:46.786038  8884 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:46.819871  8729 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:46.822607  8744 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.800668  8774 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:46.823695  8895 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:46.823792  8774 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.825130  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.826262  3995 raft_consensus.cc:2368] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13.
I20260709 12:22:46.829471  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.831682  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.832808  3999 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:46.834764  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.743633  8840 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:46.840443  3993 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:46.809190  8759 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:46.859977  3994 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:22:46.865927  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.799340  8686 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:22:46.871186  3991 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:22:46.877942  3995 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:46.859143  8615 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:46.881060  3994 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:22:46.890848  3997 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:22:46.895294  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.857918  8595 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.825066  8774 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.920127  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.883811  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 742) took 1147 ms. Trace:
I20260709 12:22:46.884785  8615 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:46.857267  8840 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.928855  8774 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:46.934302  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:46.938721  8759 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:46.956063  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:46.938496  8743 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:46.923305  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 137889us
W20260709 12:22:46.942114  8916 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.294s	user 0.000s	sys 0.002s
I20260709 12:22:46.955391  8592 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.943526  8909 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
I20260709 12:22:46.971764  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.971787  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.972162  8592 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.972638  3997 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:46.940157  4582 rpcz_store.cc:276] 0709 12:22:45.724794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.726943 (+  2149us) service_pool.cc:224] Handling call
0709 12:22:46.862965 (+1136022us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54005a0354. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:46.871956 (+  8991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914231168}
I20260709 12:22:46.955713  8870 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:46.974066  8870 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:46.974419  8592 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:46.945461  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.954864  8615 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:46.974788  8729 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:46.975644  8749 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:46.976166  8749 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:46.977134  8749 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.989542  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.990185  3992 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:22:46.917191  8672 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.677s	user 0.017s	sys 0.003s
I20260709 12:22:46.990975  8672 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:46.991652  8842 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.993639  3996 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:46.994760  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.995057  3993 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:46.996109  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.996714  3993 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:46.996820  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.997649  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.998070  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.998782  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:46.974445  8870 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:47.000185  3997 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:47.000955  8672 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.001341  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.000874  8870 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.001832  3843 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:47.001958  3997 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
W20260709 12:22:46.921075  8924 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:22:46.967187  8840 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.004315  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.000221  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.005187  3847 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:47.005779  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.006052  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.006546  3845 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:47.006742  3847 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:46.954864  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.007684  8792 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:22:46.958961  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:46.959589  8740 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:47.008476  8740 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.008847  8740 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.010541  8903 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:46.959079  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.011905  3844 raft_consensus.cc:2368] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 14. Current term is 15.
I20260709 12:22:46.951993  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.926997  8874 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.012565  8729 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.012658  3999 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.013142  8729 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.014153  8874 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.014252  8912 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.015067  3842 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:47.014901  8912 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:46.990435  3991 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:46.956959  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:46.998122  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:47.018343  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61478.2us
I20260709 12:22:47.005182  3997 raft_consensus.cc:2410] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:46.963881  3846 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:46.969331  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:46.960158  8759 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:46.989378  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:46.920467  8889 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:47.004770  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:47.045822  4546 leader_election.cc:400] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 14. Current term is 15.
I20260709 12:22:47.046283  4546 leader_election.cc:403] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:47.048672  3999 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:47.025027  3992 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:47.029173  3994 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:47.034221  3995 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.011178  8903 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.015434  8729 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.035928  8898 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:47.053900  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:47.037128  8720 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:47.038408  8842 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.063635  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.064628  3990 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:47.023088  8870 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:47.036450  4579 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
W20260709 12:22:47.069145  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.058382  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.062459  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:47.073241  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.017055  8912 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.076596  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.079595  3990 raft_consensus.cc:2376] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12. Re-sending same reply.
I20260709 12:22:47.060732  8871 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:47.083353  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.061214  8898 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.085860  3844 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:47.086258  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.087031  3849 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:47.073575  8756 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:47.088635  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.091284  3990 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:22:47.093572  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.098567  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 93857.7us
I20260709 12:22:47.063732  8874 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.046629  8840 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:22:47.050287  8592 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:47.060379  8581 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:22:47.111652  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.111881  3995 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:47.124409  8720 consensus_queue.cc:1243] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:47.088187  8898 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:47.141502  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.090400  8756 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.090590  8912 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:47.146739  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.147387  3990 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:47.164433  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:47.172147  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:47.174456  3849 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:47.151551  8756 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.109856  8899 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:22:47.132057  8729 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:22:47.222867  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.223593  3990 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:47.184284  8912 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:47.224316  8939 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.224674  8912 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.224936  8939 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.166121  8874 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.217338  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.143594  8890 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:22:47.133158  8842 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:22:47.253871  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.254809  3922 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:47.220372  8581 consensus_queue.cc:1243] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:47.221673  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:47.217778  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.258874  8701 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:47.259335  3924 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:47.259790  3924 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:47.259516  8701 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.260340  8720 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:47.260752  3924 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.260993  8720 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.262012  3924 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.262547  8701 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:47.262760  8934 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:47.260000  8939 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.266490  8908 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.267222  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.267664  8759 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.268407  3844 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:47.269066  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.319100  3848 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:47.270319  8615 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.273463  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.274040  8931 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.275578  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:47.277074  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:47.251227  8918 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.333s	user 0.000s	sys 0.006s
I20260709 12:22:47.252421  8792 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.278630  8740 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.332607  8931 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.334204  8740 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.334970  8931 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.305403  8720 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.336429  3745 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 286) took 3503 ms. Trace:
I20260709 12:22:47.336871  8615 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:47.281118  8937 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:22:47.282343  8743 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:47.253389  8874 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.277323  3924 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:47.259580  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:47.340554  8935 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:22:47.341081  4582 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:47.341749  8874 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.342674  3847 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
W20260709 12:22:47.343757  8864 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:22:47.327273  8908 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.345147  3845 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:47.291720  8897 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:22:47.293891  8595 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:47.294473  8903 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.300647  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.305452  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.146422  8889 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:47.326762  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46838.9us
I20260709 12:22:47.331980  8435 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:47.331705  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:47.331677  8792 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.336818  3745 rpcz_store.cc:276] 0709 12:22:43.833538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.839684 (+  6146us) service_pool.cc:224] Handling call
0709 12:22:47.336330 (+3496646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:45.875988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:45.892637 (+ 16649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:45.892690 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:22:45.892709 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:45.893508 (+   799us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:45.893634 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:45.893660 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:22:45.894421 (+   761us) tablet.cc:701] Row locks acquired
0709 12:22:45.894481 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:22:45.894704 (+   223us) write_op.cc:270] Start()
0709 12:22:45.894866 (+   162us) write_op.cc:276] Timestamp: P: 1783599765894599 usec, L: 0
0709 12:22:45.894902 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:22:45.947796 (+ 52894us) log.cc:844] Serialized 2074 byte log entry
0709 12:22:46.295262 (+347466us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:46.516624 (+221362us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.548233 (+ 31609us) write_op.cc:301] APPLY: starting
0709 12:22:46.580900 (+ 32667us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.594104 (+ 13204us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.594146 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.598225 (+  4079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.598658 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:22:46.598746 (+    88us) write_op.cc:312] APPLY: finished
0709 12:22:46.599171 (+   425us) log.cc:844] Serialized 57 byte log entry
0709 12:22:46.600783 (+  1612us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.600920 (+   137us) write_op.cc:454] Released schema lock
0709 12:22:46.600993 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:46.601612 (+   619us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.601653 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1108,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":31231,"apply.run_cpu_time_us":11669,"apply.run_wall_time_us":53331,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24997,"num_ops":5,"prepare.queue_time_us":242397,"prepare.run_cpu_time_us":23426,"prepare.run_wall_time_us":137852,"raft.queue_time_us":157103,"raft.run_cpu_time_us":17103,"raft.run_wall_time_us":31838,"replication_time_us":621472,"spinlock_wait_cycles":14455040,"thread_start_us":430859,"threads_started":4,"wal-append.queue_time_us":103522}]]}
W20260709 12:22:47.250703  3815 connection.cc:256] RPC call timeout handler was delayed by -1.0885360699999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 12:22:47.354983  3918 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:47.358973  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.364460  3994 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.365630  3920 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:47.366796  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.367429  3918 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.343079  8756 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.353196  8743 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:47.354036  8872 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.374794  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.375372  3990 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:47.359340  8435 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:47.381951  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.382871  3994 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:47.363936  8840 consensus_queue.cc:1243] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:22:47.385402  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.376379  8759 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.395730  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.369670  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:47.399137  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:22:47.400014  3846 raft_consensus.cc:606] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:47.405726  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.406880  3992 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:22:47.421501  8907 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.797s	user 0.008s	sys 0.000s
I20260709 12:22:47.423185  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.423911  3990 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:47.426851  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:47.422849  3747 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 7 to 8, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.429083  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.376710  8743 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.427559  4574 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:47.433645  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.436640  3924 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:47.436887  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.437786  3992 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.439092  3995 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:47.440914  4578 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 4.
I20260709 12:22:47.442286  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.444136  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.446623  3999 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.429219  3747 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 12 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 13 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.378554  8872 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.450197  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:47.452445  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.372131  8749 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:22:47.463763  8756 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.464707  8943 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.464620  8435 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:47.472087  8936 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:22:47.501354  4576 raft_consensus.cc:2410] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:22:47.460330  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.484614  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:47.502102  3845 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:47.485392  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.502599  3916 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:47.502776  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 69915.6us
W20260709 12:22:47.502130  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.487210  3992 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:22:47.503973  3994 raft_consensus.cc:3060] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.486989  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.496248  3850 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:47.499969  3844 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:47.504712  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:47.506772  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.507387  3923 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:47.510429  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.512764  3993 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:47.513233  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:47.514038  3993 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:47.514153  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.514848  3990 raft_consensus.cc:2368] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:22:47.515412  3992 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:47.516180  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.516700  8792 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.480988  8899 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:47.517068  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.517338  8899 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.517699  8899 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:47.517871  3996 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:47.518577  8729 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.520740  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.520920  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:47.521315  3846 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.521508  3999 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:47.524449  3916 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:47.481288  8874 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.516738  3991 raft_consensus.cc:2376] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5. Re-sending same reply.
I20260709 12:22:47.541769  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.542754  3995 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:47.544972  8931 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:47.546681  8615 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:47.547075  8615 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:47.547181  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:47.548239  8842 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:47.508932  8871 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 14. Current term is 15.
I20260709 12:22:47.556559  8792 raft_consensus.cc:2764] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:22:47.558845  8581 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:47.559427  8581 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:47.569407  8588 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:47.569904  8588 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:47.571899  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 58777.1us
W20260709 12:22:47.577617  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.592070  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45015.8us
I20260709 12:22:47.519104  8729 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:47.594843  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:47.597314  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.653740  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.648469  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.636162  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:47.655556  3925 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:47.570847  8588 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.499150  8943 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:47.607658  8936 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:22:47.664451  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:47.669332  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 77951.8us
I20260709 12:22:47.664695  3998 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:47.603235  8939 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:47.600705  8840 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.676254  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.566454  8872 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.658561  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:47.603091  8908 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.537436  8874 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.656584  8701 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.713110  3845 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.680230  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:47.680485  3994 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:47.666010  8949 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.738945  3997 raft_consensus.cc:1275] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:22:47.721553  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 352775us
I20260709 12:22:47.746842  3964 leader_election.cc:400] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:22:47.747268  3964 leader_election.cc:403] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:22:47.729425  3999 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:47.748281  3846 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:47.677563  8939 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.613211  8948 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 12:22:47.735960  8588 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.680485  8923 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.657339  8898 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.762238  8753 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:22:47.762354  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 155827us
W20260709 12:22:47.743217  8938 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:22:47.610296  8581 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.758083  8939 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:47.786659  3917 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:47.797724  8948 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.787238  3917 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:47.799363  8435 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.806354  8943 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.802986  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:47.803104  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.811223  3846 raft_consensus.cc:2368] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:47.804925  3917 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.812798  8729 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:47.813652  8729 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:47.813791  3917 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:47.814376  8729 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:47.818770  8743 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:47.819792  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1269) took 1032 ms. Trace:
W20260709 12:22:47.821329  8947 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.403s	user 0.004s	sys 0.000s
I20260709 12:22:47.820250  3921 rpcz_store.cc:276] 0709 12:22:46.787899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.788271 (+   372us) service_pool.cc:224] Handling call
0709 12:22:46.835482 (+ 47211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:46.851936 (+ 16454us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:46.876764 (+ 24828us) log.cc:844] Serialized 14 byte log entry
0709 12:22:47.108835 (+232071us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.132501 (+ 23666us) log.cc:844] Serialized 26 byte log entry
0709 12:22:47.132692 (+   191us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:47.132726 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.132791 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.819485 (+686694us) raft_consensus.cc:1685] finished
0709 12:22:47.819516 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.819693 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57925,"prepare.queue_time_us":7714,"prepare.run_cpu_time_us":7374,"prepare.run_wall_time_us":25714,"raft.queue_time_us":121658,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":37971,"thread_start_us":208041,"threads_started":1,"wal-append.queue_time_us":258608}
I20260709 12:22:47.821852  8923 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.823179  3962 leader_election.cc:400] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:47.823552  3962 leader_election.cc:403] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:47.663043  8615 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.798602  8948 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.824290  8756 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.826653  8898 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.819185  8581 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:47.828704  8895 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.829262  8895 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.829128  8729 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.677114  8890 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:22:47.770115  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:47.764091  8908 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:47.833977  8908 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:47.835302  8908 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.767807  8753 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:47.839234  8753 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.840984  8753 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:47.843387  8950 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:47.764019  8912 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 7. Current term is 8.
I20260709 12:22:47.744419  8701 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:47.709894  8840 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.859505  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.860234  3919 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:47.861133  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:47.862227  8912 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.862394  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.862829  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:47.862802  8912 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.865718  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.867009  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.867767  3919 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:47.876628  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.877969  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.879294  8948 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:47.879844  8701 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:47.881910  4582 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:47.884222  8923 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:47.884725  8615 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:47.885325  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.891892  3846 raft_consensus.cc:2410] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:22:47.888401  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.893108  3848 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:22:47.895082  8895 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:47.897648  3920 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.526s	user 0.002s	sys 0.009s
I20260709 12:22:47.898123  3920 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:47.664341  8792 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 12:22:47.905318  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 135291us
I20260709 12:22:47.907362  3962 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:47.907651  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:47.906315  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.888712  8874 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:47.913787  3918 consensus_meta.cc:287] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.003s
I20260709 12:22:47.927006  3918 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:47.927522  3917 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:47.932893  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:47.936661  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:47.942595  3923 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:47.942138  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:47.915513  8529 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.017s
I20260709 12:22:47.880203  8840 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:47.946349  3845 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
W20260709 12:22:47.941604  8720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.009s
W20260709 12:22:47.955607  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 364330us
I20260709 12:22:47.955725  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:47.950863  8529 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.017s
W20260709 12:22:47.945096  8941 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:22:47.970407  3920 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:22:47.971138  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.971809  3841 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:47.935665  8895 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:47.945576  8923 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:47.955013  8720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.006s	sys 0.009s
I20260709 12:22:47.974818  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.988272  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.738956  8949 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:47.945760  8950 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:47.974295  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:47.998818  3925 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:47.999528  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.004644  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:48.001436  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2377) took 1588 ms. Trace:
I20260709 12:22:48.005342  3841 rpcz_store.cc:276] 0709 12:22:46.412987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.413124 (+   137us) service_pool.cc:224] Handling call
0709 12:22:46.433743 (+ 20619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.985309 (+1551566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.000943 (+ 15634us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000a5ad4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:48.001345 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3498471168}
W20260709 12:22:47.973358  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.021s
I20260709 12:22:48.003100  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:48.005955  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:48.013758  3924 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:48.009101  3917 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 12:22:48.010581  3918 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:47.951426  8872 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:22:48.023694  4548 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:48.024952  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:47.987432  8895 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.984149  8840 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:48.039330  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:48.042133  8953 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:22:48.041736  8895 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:48.051028  3925 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:48.057250  3814 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.033s
W20260709 12:22:48.058984  3814 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.033s
W20260709 12:22:48.059903  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.016072  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.010s	sys 0.021s
W20260709 12:22:48.062103  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 566809us
W20260709 12:22:48.065744  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.097337  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72471.5us
W20260709 12:22:48.098389  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.098870  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.072428  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:48.021045  8595 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:22:48.096681  8759 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.689s	user 0.017s	sys 0.001s
W20260709 12:22:48.112041  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 381451us
I20260709 12:22:48.125319  3844 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:48.127737  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:48.128072  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:48.056154  8840 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.132045  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.167956  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:48.174152  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:48.112936  8842 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:48.176275  3994 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:48.176326  3841 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:48.176656  8923 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.186946  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.187011  3846 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:48.161509  8955 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.114790  8929 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:22:48.164842  8792 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.188970  3997 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:48.177681  8951 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:48.192476  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:48.187781  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 444539us
I20260709 12:22:48.195782  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.203284  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.187393  8756 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:48.206530  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.208287  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:48.209164  3849 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:48.210402  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.210541  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.206739  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.211264  3998 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:48.212709  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:48.190564  8749 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.214042  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.214967  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.216972  3993 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:48.215591  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.220698  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.221905  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.184767  8946 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:22:48.222524  3995 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.223986  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:48.224568  4576 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:48.212376  8899 consensus_meta.cc:287] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.694s	user 0.017s	sys 0.000s
W20260709 12:22:48.233170  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 284568us
I20260709 12:22:48.186714  8923 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.235942  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.236883  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:48.237782  3996 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:48.211023  8951 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:48.245043  3998 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:22:48.254354  3992 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:48.221204  8743 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:48.202728  8592 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:22:48.256573  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.264926  4576 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:48.203048  8792 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.229866  8864 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:48.207221  8943 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:22:48.197711  8945 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:22:48.275969  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.271613  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.276844  3996 raft_consensus.cc:2410] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:22:48.272610  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 262907us
I20260709 12:22:48.272828  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:48.278604  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46092.2us
I20260709 12:22:48.279040  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.194964  8955 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.275673  3991 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:48.281509  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.279978  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.287334  3846 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:48.291489  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:48.292412  4576 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:48.285292  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.289541  3995 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:48.301538  3999 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:48.273136  8946 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:48.273984  8759 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:48.269667  8743 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.308797  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.303884  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.277225  8864 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:48.225481  8749 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.277495  8961 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:48.317008  3998 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:48.321596  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.324296  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.315093  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.313504  3995 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:48.238343  8899 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.291282  8949 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:48.290491  8929 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:48.290793  8842 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.325145  3997 raft_consensus.cc:2376] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10. Re-sending same reply.
I20260709 12:22:48.290869  8615 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:48.275208  8874 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:22:48.340426  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.283459  8939 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.317391  8759 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:48.319607  8743 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:48.326960  8864 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:48.355756  3995 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:48.356207  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.329048  8961 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.367703  8961 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:48.294613  8944 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:22:48.329422  8948 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:48.363911  3998 raft_consensus.cc:2376] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7. Re-sending same reply.
I20260709 12:22:48.318907  8720 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:22:48.373931  3997 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:22:48.374109  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 94193.5us
I20260709 12:22:48.377841  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.340087  8842 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.340329  8615 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.382059  3998 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:48.384574  3916 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:48.334792  8973 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:48.388048  3925 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:48.392186  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:48.385571  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:48.368472  8759 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:48.369628  8889 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:48.397325  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:48.399474  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121831us
I20260709 12:22:48.400930  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:48.401186  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.405355  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.407922  3997 raft_consensus.cc:2376] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15. Re-sending same reply.
I20260709 12:22:48.409508  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:48.410362  3923 raft_consensus.cc:2393] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 5: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:48.410713  3918 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:48.412441  3998 raft_consensus.cc:2368] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13.
I20260709 12:22:48.414337  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:48.397920  8958 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:22:48.395643  8615 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:48.424521  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.425356  3918 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:22:48.406278  8908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.014s
I20260709 12:22:48.429428  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:48.399371  8729 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.431402  3998 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:48.395854  8973 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:48.436753  3923 pending_rounds.cc:85] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 6
I20260709 12:22:48.401117  8945 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:48.435679  8871 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:48.409729  8898 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:48.479811  8871 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:48.480881  8871 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.482197  8871 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:48.482636  8588 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.006s
I20260709 12:22:48.441339  8973 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:48.441533  8974 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:48.485438  8974 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:48.486363  8974 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.490712  3990 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
W20260709 12:22:48.441401  8957 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:22:48.441290  8729 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.442426  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.443250  8969 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.444228  8987 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.445197  8975 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:48.438360  8944 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:48.451013  8840 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:48.455950  8946 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:48.457923  8899 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:48.359153  8951 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.464653  8749 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:48.432817  8889 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:48.468765  8955 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:48.424582  8435 consensus_meta.cc:287] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.001s
I20260709 12:22:48.441275  8923 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:48.502241  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:48.504963  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 183464us
W20260709 12:22:48.437429  8908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.015s
W20260709 12:22:48.514096  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71764.8us
I20260709 12:22:48.668568  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.670078  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.662129  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.580844  8588 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:48.650035  8945 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:48.674082  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:48.674818  8980 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.255s	user 0.003s	sys 0.001s
I20260709 12:22:48.675762  8908 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:48.440151  3923 pending_rounds.cc:107] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:22:48.675318  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:48.433550  8941 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:48.581580  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.465713  8939 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:48.595434  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:48.645216  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.505509  8970 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:48.580133  8944 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.662874  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.663853  8874 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:48.664582  8946 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:48.554404  3993 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:22:48.677356  3923 raft_consensus.cc:2889] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:48.688799  3991 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:48.690245  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 251251us
I20260709 12:22:48.698331  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.699235  3993 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
W20260709 12:22:48.714367  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 398955us
I20260709 12:22:48.692126  8944 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:48.692705  8945 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:48.671844  8588 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.736511  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:48.738106  3993 raft_consensus.cc:2376] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8. Re-sending same reply.
W20260709 12:22:48.739629  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 360751us
I20260709 12:22:48.580866  8969 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.719530  8931 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:48.741255  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.755976  4576 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:48.722687  8976 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.720754  8988 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.761349  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 86092.4us
I20260709 12:22:48.580974  8987 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.751924  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:48.753379  4578 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:22:48.754958  8588 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:48.756438  3991 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:48.769738  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:48.770609  3993 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
W20260709 12:22:48.773759  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.762454  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:48.738857  8581 consensus_meta.cc:287] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.007s
I20260709 12:22:48.736521  8929 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:48.755991  8931 raft_consensus.cc:2764] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:48.785697  4547 leader_election.cc:400] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:22:48.789889  4547 leader_election.cc:403] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:48.791111  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:48.793731  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:48.779349  8895 consensus_meta.cc:287] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.720s	user 0.013s	sys 0.000s
I20260709 12:22:48.722517  8864 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:48.802444  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:48.791716  8874 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:48.803249  8740 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:48.788069  8955 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:22:48.757659  8889 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.769100  8976 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:48.828163  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 158162us
I20260709 12:22:48.771746  8988 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.802100  8895 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.837204  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.831562  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.825678  8749 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:22:48.887895  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 73480.3us
I20260709 12:22:48.923928  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:48.817476  8759 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.817729  8950 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:48.992830  8864 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:48.993571  8759 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:48.997365  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 165950us
I20260709 12:22:48.814607  8931 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:48.999603  3841 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:48.813920  8874 raft_consensus.cc:697] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:48.812809  9000 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:49.000151  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:48.832166  8929 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:48.995164  8759 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 12:22:49.008479  8743 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
W20260709 12:22:49.045342  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 208214us
I20260709 12:22:48.806222  8946 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.033061  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.005065  8948 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:49.056653  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:49.056797  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 270914us
I20260709 12:22:49.058310  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:49.044291  8998 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:22:49.000330  8729 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.012516  8939 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:49.072031  8986 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:22:49.076572  8895 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.063681  8581 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:49.078037  8581 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:49.072708  9006 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.079284  8973 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.005s
I20260709 12:22:49.012208  8996 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:49.079190  9006 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.079913  8973 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.080098  8996 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.081821  9006 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:49.082235  8973 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.082386  8996 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:49.069916  8976 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.087970  8749 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:22:49.090086  8987 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.052625  9000 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:49.091789  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.092157  3993 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:22:49.092545  8964 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.813s	user 0.002s	sys 0.052s
I20260709 12:22:49.065375  8969 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.067335  8995 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:49.060124  8999 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.072780  9007 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:49.093958  9007 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:49.093757  8999 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.094811  9007 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.095845  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3053) took 1718 ms. Trace:
I20260709 12:22:49.096148  9007 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:49.049288  8988 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.097209  8999 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:49.060292  8950 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:49.045053  8874 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.111901  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.112866  3997 raft_consensus.cc:2410] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:49.113336  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.113787  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.114569  3997 raft_consensus.cc:2410] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:49.092649  3991 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:49.116173  3992 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:49.116667  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.096236  3922 rpcz_store.cc:276] 0709 12:22:47.377057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.377169 (+   112us) service_pool.cc:224] Handling call
0709 12:22:47.377487 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.458093 (+ 80606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.458141 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:47.489120 (+ 30979us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.059595 (+570475us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:48.302397 (+242802us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.691286 (+388889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.691405 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.091870 (+400465us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:49.095524 (+  3654us) raft_consensus.cc:1685] finished
0709 12:22:49.095637 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.095773 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63633,"prepare.queue_time_us":315504,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":87768,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":961,"spinlock_wait_cycles":107204480,"thread_start_us":1021420,"threads_started":3,"wal-append.queue_time_us":678854}
I20260709 12:22:49.115319  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:49.056627  8743 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.079003  8581 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.061995  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.103546  3993 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:49.105082  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:49.118422  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61859.2us
W20260709 12:22:49.124718  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.130357  3920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.001s	sys 0.040s
W20260709 12:22:49.136114  3920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.001s	sys 0.040s
I20260709 12:22:49.016901  8931 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:49.140419  8908 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:49.141834  8908 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.015477  8990 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:49.148164  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86258.7us
I20260709 12:22:49.056491  8948 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:49.149415  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2513) took 1162 ms. Trace:
I20260709 12:22:49.152902  3920 rpcz_store.cc:276] 0709 12:22:47.986547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.401812 (+415265us) service_pool.cc:224] Handling call
0709 12:22:48.424299 (+ 22487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.487706 (+ 63407us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:48.488004 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:22:49.148914 (+660910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.148997 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:49.149069 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.149173 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.149334 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12240,"prepare.queue_time_us":861,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":14219,"thread_start_us":648197,"threads_started":1}
I20260709 12:22:49.000428  8967 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:22:49.157205  3994 raft_consensus.cc:2368] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
W20260709 12:22:49.157409  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.157920  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:49.118727  8895 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:49.162791  3889 leader_election.cc:400] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13.
I20260709 12:22:49.132835  8759 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:49.158957  4547 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.159322  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:49.168792  8895 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:49.162195  8961 consensus_meta.cc:287] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.000s
I20260709 12:22:49.155064  8999 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:49.170774  9009 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:49.175225  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:49.201474  3842 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.175884  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.177032  8968 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:49.177235  3845 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:49.156414  8948 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:49.165823  8864 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:22:49.179857  8743 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:49.181762  8842 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.003s
I20260709 12:22:49.149565  8435 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:49.203552  8931 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:49.231509  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.200459  9009 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.233603  9009 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.235110  8588 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.235894  8588 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.238133  8588 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.238724  8996 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.195672  8961 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.006394  8993 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.149s
I20260709 12:22:49.240151  8993 consensus_queue.cc:1243] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:22:49.151522  8987 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:49.241429  8961 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.241614  8987 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:49.242520  8939 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:49.242697  8943 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:49.243058  8864 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:49.192167  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.243320  8943 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:49.243917  3850 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:49.243713  8864 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.244367  8943 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.244918  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.245150  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3154) took 1042 ms. Trace:
I20260709 12:22:49.245407  8943 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:49.245549  3990 rpcz_store.cc:276] 0709 12:22:48.202406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.203020 (+   614us) service_pool.cc:224] Handling call
0709 12:22:49.244959 (+1041939us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400350054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:49.245065 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642739072}
I20260709 12:22:49.245971  8864 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:49.247471  8870 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:49.247910  8870 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:49.247840  8740 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:49.248811  8740 consensus_queue.cc:1243] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:49.249107  8870 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.250236  8870 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.251135  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.251906  3845 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:49.252835  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.253778  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3157) took 1041 ms. Trace:
I20260709 12:22:49.253957  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:49.184095  8871 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.001s
W20260709 12:22:49.203487  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44597.8us
I20260709 12:22:49.195113  3844 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:49.194006  8995 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:49.165235  8749 consensus_queue.cc:1048] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:22:49.200661  8990 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:49.204744  8968 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:49.194603  8592 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.230342  8912 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.239275  8996 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.169772  8976 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:49.242645  8987 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.249909  8842 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.260154  8792 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.245563  3850 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:49.247838  8895 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:49.257387  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.254729  3845 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
W20260709 12:22:49.212015  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 113545us
I20260709 12:22:49.257735  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.185935  8529 raft_consensus.cc:3055] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:49.259260  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:49.335789  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.259050  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.258234  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.336800  4576 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:49.190668  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.339195  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.254196  3999 rpcz_store.cc:276] 0709 12:22:48.212241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.213785 (+  1544us) service_pool.cc:224] Handling call
0709 12:22:49.253597 (+1039812us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b5400391f54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:49.253712 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137027968}
I20260709 12:22:49.340046  3993 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:49.273402  3843 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:49.273872  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.279930  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.259066  9007 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:49.283214  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.347661  3990 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:22:49.347841  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68044.1us
I20260709 12:22:49.291205  8966 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:49.292434  4577 pending_rounds.cc:85] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 13
I20260709 12:22:49.292308  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.352936  4577 pending_rounds.cc:107] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:22:49.195129  8759 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.196102  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.354210  3846 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 9: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:49.256392  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3149) took 1064 ms. Trace:
I20260709 12:22:49.354876  4546 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:49.307308  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.315361  3922 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:49.315497  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.319000  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.320955  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.358546  3917 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:49.278635  8995 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:49.295933  8592 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.372443  8592 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.373687  4575 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:49.374917  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.375047  8996 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.359252  8961 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:49.352767  8966 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:49.362716  8740 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:49.377102  8740 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:49.377637  8944 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
I20260709 12:22:49.378180  8944 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.363027  8595 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:22:49.381312  8967 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:49.381755  8967 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.382081  8967 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:49.382659  8759 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.276193  8435 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.383327  8435 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.331132  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.296411  8976 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:49.332144  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:49.329594  8968 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:49.342124  3844 raft_consensus.cc:2410] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:22:49.348917  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 158389us
I20260709 12:22:49.398141  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.336553  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.343356  3993 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 9 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:49.321288  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:49.399561  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 63128.8us
I20260709 12:22:49.361588  3918 raft_consensus.cc:2410] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:22:49.355254  3994 rpcz_store.cc:276] 0709 12:22:48.192460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.200443 (+  7983us) service_pool.cc:224] Handling call
0709 12:22:49.256180 (+1055737us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54003e1554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:49.256302 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156722048}
I20260709 12:22:49.360272  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:49.362625  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:49.363502  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:49.401999  3992 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:49.401996  3997 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:49.363754  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:49.329372  9012 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.104s	user 0.004s	sys 0.000s
I20260709 12:22:49.366103  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:49.346482  8993 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:49.368148  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:49.368922  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.369637  9007 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.370132  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.388459  3842 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:49.376353  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:49.401871  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:49.414307  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:49.353386  4577 raft_consensus.cc:2889] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:49.408326  3996 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:49.335868  8529 raft_consensus.cc:740] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:49.385442  8435 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:49.350809  8840 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:49.448648  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:49.450589  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.451177  4579 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:49.456291  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.383111  8948 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.434635  8864 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:49.417419  9009 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:49.397087  8976 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:49.408448  8759 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:49.458513  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:49.468864  3992 raft_consensus.cc:2468] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:49.472681  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:49.471303  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:49.400460  8740 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:49.417668  8961 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:49.364444  8969 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:22:49.478055  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.447813  8929 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:49.450037  8996 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:49.547616  3916 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:49.547840  3924 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:49.548275  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.522998  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:49.551869  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3211) took 1062 ms. Trace:
I20260709 12:22:49.471673  8912 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:49.552173  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:49.549065  3849 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
W20260709 12:22:49.560192  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.596156  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.596940  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.475013  8864 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.475914  8973 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:49.597779  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.649937  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.650095  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:49.459924  8792 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:49.493533  9006 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:22:49.656328  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.654137  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:49.648744  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.546928  8743 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.493996  8961 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.679085  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.441788  8993 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:49.546463  8889 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 12:22:49.553989  3841 rpcz_store.cc:276] 0709 12:22:48.489140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.489306 (+   166us) service_pool.cc:224] Handling call
0709 12:22:48.580188 (+ 90882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.000143 (+419955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.499720 (+499577us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003449d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:49.551808 (+ 52088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963963136}
I20260709 12:22:49.760102  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:49.491416  8968 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:49.553002  8996 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:49.788025  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 299744us
I20260709 12:22:49.681419  3844 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:49.783751  3916 raft_consensus.cc:2368] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:49.552672  8588 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.204s
I20260709 12:22:49.650354  8950 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:49.787818  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:49.790500  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.905522  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.793823  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:49.832994  3849 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:49.387214  8953 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:22:49.917191  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:49.918054  3916 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:49.906840  3922 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:22:49.762372  9006 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:49.684458  8864 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.845914  3848 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:49.458861  8988 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:22:49.780350  8987 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.797314  8996 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:49.852991  8615 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.414s	user 0.019s	sys 0.008s
W20260709 12:22:49.913398  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.916006  3843 raft_consensus.cc:1240] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:49.920413  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 131258us
W20260709 12:22:49.831192  9016 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:22:49.923058  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:49.784591  8961 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:49.787510  8944 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:49.837736  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.053172  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 399109us
I20260709 12:22:49.941118  8595 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 12:22:50.028240  8969 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.043690  3849 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:49.785053  8792 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.018741  8743 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.174768  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:50.175520  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:50.118810  8749 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:50.025449  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:49.679328  8995 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.019399  8592 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:49.648638  8529 consensus_queue.cc:260] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.061786  8945 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.119484  3916 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:50.149435  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:50.149893  3990 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:22:50.020049  8615 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.077234  9007 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.071560  8973 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.153139  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.224973  8588 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.069969  8950 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:50.156903  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:50.283720  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:50.093468  9018 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.116528  9001 log.cc:927] Time spent T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.434s	user 0.001s	sys 0.001s
I20260709 12:22:50.026434  9004 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.674s
I20260709 12:22:50.177541  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:50.175361  3994 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:50.178385  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:49.934710  9006 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:50.017369  8987 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.221148  3922 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:50.265894  4581 consensus_meta.cc:287] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.879s	user 0.016s	sys 0.008s
I20260709 12:22:50.308303  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:50.308559  4581 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:50.309026  3995 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:22:50.182307  8749 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.273411  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.275230  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:50.275314  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:50.277653  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 489861us
I20260709 12:22:50.279593  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:50.173452  8923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.018s	sys 0.051s
W20260709 12:22:50.274542  9022 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.591s	user 0.001s	sys 0.000s
I20260709 12:22:50.255677  8978 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:50.174691  8969 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.175594  9029 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 12:22:50.188760  8743 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.219758  8974 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 12:22:50.303556  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 126075us
W20260709 12:22:50.320158  8923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.018s	sys 0.052s
I20260709 12:22:50.309074  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 750) took 1013 ms. Trace:
I20260709 12:22:50.180786  8908 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:50.314181  3991 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:50.314249  3990 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:50.315384  3916 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:50.320957  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:50.331488  9023 log.cc:927] Time spent T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
W20260709 12:22:50.306001  8870 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.050s	user 0.014s	sys 0.000s
I20260709 12:22:50.349319  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.283474  9007 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.327930  3994 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:50.356594  3922 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:50.299401  9033 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:50.304768  3997 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:50.313995  8950 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.318106  8749 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:50.329172  9024 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.544s	user 0.000s	sys 0.001s
W20260709 12:22:50.322778  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 169729us
I20260709 12:22:50.321848  8988 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:50.286058  8973 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.339543  4581 rpcz_store.cc:276] 0709 12:22:49.296096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.331754 (+ 35658us) service_pool.cc:224] Handling call
0709 12:22:50.309010 (+977256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:50.345182  3995 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:50.292622  8588 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:50.338415  3962 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.65:37307 timed out after 1.510s (SENT) [suppressed 30 similar messages]
I20260709 12:22:50.349337  3990 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:50.350967  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.371119  3916 raft_consensus.cc:2376] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11. Re-sending same reply.
I20260709 12:22:50.357080  4575 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:50.358158  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.364960  3994 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:50.366273  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.267622  8592 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.359023  8940 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:50.361400  8889 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.379901  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59297.3us
I20260709 12:22:50.343891  8595 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:22:50.376159  3991 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:50.382040  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.360384  8993 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.365510  8948 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.364768  8908 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.394423  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.404031  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.362860  9007 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.407202  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:50.400640  3963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.002s
W20260709 12:22:50.415266  3963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.002s
I20260709 12:22:50.417318  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.400563  8993 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.446139  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.370355  8870 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:22:50.450987  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.453418  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:50.453488  4578 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:50.454072  3917 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:50.464359  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2517) took 2457 ms. Trace:
I20260709 12:22:50.469187  8895 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:50.469980  8895 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:50.472522  9017 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.822s	user 0.000s	sys 0.001s
W20260709 12:22:50.475234  8965 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 2.218s	user 0.010s	sys 0.006s
I20260709 12:22:50.464898  3923 rpcz_store.cc:276] 0709 12:22:48.006913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.410957 (+404044us) service_pool.cc:224] Handling call
0709 12:22:48.436566 (+ 25609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.702161 (+265595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.702208 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.714204 (+ 11996us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.802158 (+ 87954us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:48.810966 (+  8808us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.811225 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.811302 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.476027 (+664725us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b18003be480. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:50.419633 (+943606us) raft_consensus.cc:1685] finished
0709 12:22:50.464095 (+ 44462us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.464275 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8662,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2113,"raft.queue_time_us":1163,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4339,"spinlock_wait_cycles":389839744,"thread_start_us":59225,"threads_started":1,"wal-append.queue_time_us":94507}
I20260709 12:22:50.476918  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3192) took 3034 ms. Trace:
I20260709 12:22:50.478291  8592 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.477280  3847 rpcz_store.cc:276] 0709 12:22:47.442661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.443409 (+   748us) service_pool.cc:224] Handling call
0709 12:22:47.461231 (+ 17822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.461607 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:47.527880 (+ 66273us) log.cc:844] Serialized 14 byte log entry
0709 12:22:47.995954 (+468074us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.037535 (+ 41581us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.037687 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:48.037724 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.037792 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.064052 (+1026260us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:50.474801 (+1410749us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b2400126278. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f94509d 00007fdc5257710e 00007fdc5258e88c 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221
0709 12:22:50.476650 (+  1849us) raft_consensus.cc:1685] finished
0709 12:22:50.476678 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.476829 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65531,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":52126,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":15111,"spinlock_wait_cycles":195932288,"thread_start_us":338877,"threads_started":1,"wal-append.queue_time_us":595896}
I20260709 12:22:50.480798  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 779) took 1113 ms. Trace:
I20260709 12:22:50.481210  4575 rpcz_store.cc:276] 0709 12:22:49.367193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.374648 (+  7455us) service_pool.cc:224] Handling call
0709 12:22:50.480615 (+1105967us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540046c3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:50.480732 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232024448}
I20260709 12:22:50.482309  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.483428  3923 raft_consensus.cc:2410] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:22:50.484120  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2526) took 1001 ms. Trace:
I20260709 12:22:50.484377  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.484592  3923 rpcz_store.cc:276] 0709 12:22:49.483170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.476510 (+993340us) service_pool.cc:224] Handling call
0709 12:22:50.484061 (+  7551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:50.485278  3916 raft_consensus.cc:2410] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:22:50.485678  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.487788  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:50.488168  3923 raft_consensus.cc:2410] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:22:50.488569  4576 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:50.491753  3917 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:22:50.493288  8588 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.412175  8908 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.441388  8993 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.485682  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2523) took 1003 ms. Trace:
I20260709 12:22:50.501837  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2414) took 1230 ms. Trace:
I20260709 12:22:50.420115  9031 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:50.401198  8889 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.523742  3916 rpcz_store.cc:276] 0709 12:22:49.482307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.484095 (+1001788us) service_pool.cc:224] Handling call
0709 12:22:50.485627 (+  1532us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:50.528374  3965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.008s	sys 0.016s
I20260709 12:22:50.523801  3844 rpcz_store.cc:276] 0709 12:22:49.271236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.838398 (+567162us) service_pool.cc:224] Handling call
0709 12:22:49.838960 (+   562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:49.922151 (+ 83191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.922201 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:49.940429 (+ 18228us) log.cc:844] Serialized 52 byte log entry
0709 12:22:50.318227 (+377798us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:50.318269 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.318350 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.501523 (+183173us) raft_consensus.cc:1685] finished
0709 12:22:50.501555 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.501737 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82664,"raft.queue_time_us":83421,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":77838,"thread_start_us":246257,"threads_started":1,"wal-append.queue_time_us":372519}
W20260709 12:22:50.533203  3965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.008s	sys 0.016s
W20260709 12:22:50.532840  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 173097us
W20260709 12:22:50.487800  8943 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.242s	user 0.010s	sys 0.004s
I20260709 12:22:50.440630  8923 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:50.556058  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 217653us
I20260709 12:22:50.465688  8615 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.457072  8792 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.502884  8908 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.565596  4576 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:22:50.532284  8759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.000s	sys 0.012s
I20260709 12:22:50.499660  9043 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:50.566745  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:50.549583  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.499426  8973 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:50.575160  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 129094us
I20260709 12:22:50.576920  3844 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.568451  3924 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:50.500456  8743 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:50.568754  4548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.013s	sys 0.009s
I20260709 12:22:50.575183  3890 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.566316  9036 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:50.573472  8759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.000s	sys 0.013s
W20260709 12:22:50.582095  3993 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.010s	sys 0.008s
I20260709 12:22:50.584573  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:50.572688  8943 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:50.585496  3993 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.008s
W20260709 12:22:50.584847  4548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.014s	sys 0.010s
W20260709 12:22:50.588306  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.578645  8948 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.578919  8592 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:50.591852  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.586127  8974 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.566463  9005 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.242s
W20260709 12:22:50.586509  9026 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:22:50.583031  9036 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:50.596153  9007 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.587477  8923 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.599030  9044 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:50.599622  8753 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.599768  9028 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.282s	user 0.000s	sys 0.002s
W20260709 12:22:50.600137  9034 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:22:50.584009  8969 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.625826  9045 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.594873  9025 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:22:50.276474  8945 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.628077  9005 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:50.628710  9005 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:50.629321  3922 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:50.629892  9005 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.602955  8961 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.635629  9036 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.600584  9039 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:50.600601  8889 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.643805  4577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 767) took 1376 ms. Trace:
I20260709 12:22:50.589704  8943 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.645618  3848 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:22:50.364023  9033 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.646311  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2418) took 1312 ms. Trace:
I20260709 12:22:50.646742  3848 rpcz_store.cc:276] 0709 12:22:49.333608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.946930 (+613322us) service_pool.cc:224] Handling call
0709 12:22:50.029675 (+ 82745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.645371 (+615696us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54004d1fa0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296adc0 00007fdc529f51c0 00007fdc529f6231 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c
0709 12:22:50.646047 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.646249 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300415872}
I20260709 12:22:50.617530  8753 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.619669  9051 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:50.620438  9009 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.621098  9031 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:50.622150  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.401378  8940 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.325309  8978 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.622732  3964 leader_election.cc:400] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:22:50.299799  9018 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.624275  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.366891  8950 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.598575  8592 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.644526  4577 rpcz_store.cc:276] 0709 12:22:49.267842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.291635 (+ 23793us) service_pool.cc:224] Handling call
0709 12:22:49.292099 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:49.445228 (+153129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.445260 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:49.468146 (+ 22886us) log.cc:844] Serialized 52 byte log entry
0709 12:22:50.037474 (+569328us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:50.037524 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.037595 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.643397 (+605802us) raft_consensus.cc:1685] finished
0709 12:22:50.643432 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.643667 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2678,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6280,"thread_start_us":358622,"threads_started":1,"wal-append.queue_time_us":730852}
I20260709 12:22:50.648241  9033 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.648664  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 690) took 1310 ms. Trace:
I20260709 12:22:50.593474  8948 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.657600  4581 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12.
I20260709 12:22:50.614007  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.611037  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 694) took 1270 ms. Trace:
I20260709 12:22:50.626711  9045 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.586833  9043 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:22:50.674032  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:50.676970  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54448.4us
I20260709 12:22:50.706858  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:50.681424  3847 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.709239  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.710584  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:50.711002  8976 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.162s	user 0.012s	sys 0.000s
I20260709 12:22:50.646360  8943 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.664683  8961 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:50.702193  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.701066  3993 rpcz_store.cc:276] 0709 12:22:49.340958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.342588 (+  1630us) service_pool.cc:224] Handling call
0709 12:22:49.342948 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.343200 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:49.480508 (+137308us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.587596 (+1107088us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.609944 (+ 22348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:50.610099 (+   155us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:50.610194 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.610652 (+   458us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.610913 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15769,"prepare.queue_time_us":528785,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2040,"raft.queue_time_us":504539,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":18959,"thread_start_us":849643,"threads_started":2,"wal-append.queue_time_us":534372}
W20260709 12:22:50.608534  8967 consensus_meta.cc:287] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.225s	user 0.009s	sys 0.005s
I20260709 12:22:50.651243  8987 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:50.711375  3849 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.669612  9046 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:22:50.679728  9005 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:50.720708  3921 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:22:50.694862  3998 rpcz_store.cc:276] 0709 12:22:49.338571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.351315 (+ 12744us) service_pool.cc:224] Handling call
0709 12:22:49.351769 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.352192 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.352218 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.365502 (+ 13284us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.494050 (+128548us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:49.494097 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.494166 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.468745 (+974579us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4800060cd8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:22:50.648184 (+179439us) raft_consensus.cc:1685] finished
0709 12:22:50.648220 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.648554 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":18270,"raft.run_wall_time_us":1109482,"spinlock_wait_cycles":27252096,"thread_start_us":44301,"threads_started":1,"wal-append.queue_time_us":656099}
I20260709 12:22:50.604868  8974 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.725250  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:50.742412  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:50.707387  8996 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
W20260709 12:22:50.730063  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56116.4us
I20260709 12:22:50.699888  8941 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.740772  3921 pending_rounds.cc:85] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 6
I20260709 12:22:50.712036  9054 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:50.755596  9054 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.756047  9054 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:50.732708  8973 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:50.678714  9009 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.744535  3847 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.711632  9047 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.742117  8993 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.740345  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.746219  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.781913  9031 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:50.782419  8940 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.783967  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.784229  9059 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:50.784678  9059 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:50.785737  3847 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:22:50.785925  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.787770  8615 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.788335  8615 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.790774  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.749378  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:50.752099  3921 pending_rounds.cc:107] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:22:50.733249  9044 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:50.793071  4582 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:50.793215  9044 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:50.793597  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44272us
I20260709 12:22:50.794032  9009 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.794428  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:50.754413  8753 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:50.794682  9021 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.242s	user 0.002s	sys 0.002s
I20260709 12:22:50.765205  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.796164  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.791126  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.797526  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.798182  3848 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
W20260709 12:22:50.748849  8931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.515s	user 0.007s	sys 0.004s
I20260709 12:22:50.711783  9042 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:22:50.803982  8931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.008s	sys 0.004s
I20260709 12:22:50.799064  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3073) took 1319 ms. Trace:
I20260709 12:22:50.801216  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.805390  9036 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:50.806159  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:50.752643  8923 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:50.808220  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.808404  8923 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:50.808815  3920 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 6.
I20260709 12:22:50.809713  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.809948  9018 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.809520  8923 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.810832  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.812052  8974 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.761488  8996 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:50.812999  8864 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.001s
I20260709 12:22:50.813630  3917 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:50.813529  8864 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.814713  8996 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.804512  3916 rpcz_store.cc:276] 0709 12:22:49.479963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.556886 (+1076923us) service_pool.cc:224] Handling call
0709 12:22:50.557257 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.557637 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.557663 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.558280 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.594581 (+ 36301us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:50.594628 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.594699 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.798860 (+204161us) raft_consensus.cc:1685] finished
0709 12:22:50.798879 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.799006 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1397,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8960,"thread_start_us":35953,"threads_started":1,"wal-append.queue_time_us":184498}
I20260709 12:22:50.739310  8967 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.816325  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3072) took 1336 ms. Trace:
I20260709 12:22:50.816181  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.816686  3917 rpcz_store.cc:276] 0709 12:22:49.479666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.492525 (+1012859us) service_pool.cc:224] Handling call
0709 12:22:50.492963 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.814033 (+321070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.816092 (+  2059us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400077e54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:50.816268 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736811392}
I20260709 12:22:50.817445  8967 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:50.817845  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.779762  9047 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.680032  8749 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.772411  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.819350  4574 raft_consensus.cc:2393] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.792232  3843 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:50.817929  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.793691  9044 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:50.794566  3846 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:50.748294  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.831626  4546 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.768803  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:50.832360  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.832713  3919 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:50.833549  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:50.833745  4574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 776) took 1487 ms (client timeout 1837 ms). Trace:
I20260709 12:22:50.799008  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.821106  3916 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 3.
I20260709 12:22:50.785507  9059 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.779093  8978 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.824846  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.834090  3919 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 18: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:50.792186  3921 raft_consensus.cc:2889] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:50.843109  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.843801  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.844043  4576 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:22:50.837292  3848 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:50.811146  8948 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:50.834407  4574 rpcz_store.cc:269] 0709 12:22:49.345959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.346653 (+   694us) service_pool.cc:224] Handling call
0709 12:22:50.772159 (+1425506us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:22:50.833661 (+ 61502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40959232}
I20260709 12:22:50.839356  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:50.840794  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 92635.8us
I20260709 12:22:50.847833  3917 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:50.844365  3847 raft_consensus.cc:2376] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14. Re-sending same reply.
I20260709 12:22:50.851390  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.852360  3919 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:50.748461  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.714902  9006 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.844607  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.800958  9045 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.842979  8949 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:50.840131  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84784.7us
I20260709 12:22:50.854439  4579 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:50.794706  9009 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:50.732740  8976 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.838212  8974 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:50.854753  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.856868  8912 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:22:50.860071  9042 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:22:50.860615  8592 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.862052  9029 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:50.853108  8903 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:50.862910  8749 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.841699  8967 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:50.858114  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.853106  8759 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.864203  8961 consensus_queue.cc:1059] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:50.870849  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.870172  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:50.775628  8941 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.880748  9059 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:50.901201  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.892232  8903 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.881932  3917 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:50.842332  8864 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.884243  3841 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:50.885169  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:50.886736  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.883870  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.932330  3916 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:50.853273  8984 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:22:50.882130  9045 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:50.871534  8949 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:50.880178  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:50.890363  3919 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:50.889976  4576 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:50.896328  3920 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:22:50.889837  8968 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.004s
I20260709 12:22:50.886385  9029 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:50.893801  9033 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:50.927397  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:50.883482  8995 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.912359  8966 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.901928  8948 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:50.873978  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:50.968195  4574 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 8.
W20260709 12:22:50.976712  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 102852us
I20260709 12:22:50.932380  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:22:50.980268  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47966.1us
I20260709 12:22:50.980671  8949 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.981838  8961 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:50.982671  8961 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:50.933296  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:50.935163  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51340.1us
I20260709 12:22:50.900148  8974 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:50.894011  8941 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.896672  8615 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.889540  8971 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:50.895313  8759 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:50.893179  9006 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.960140  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:50.960790  3925 raft_consensus.cc:2410] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:50.935714  9045 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:50.961802  9065 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.003s
W20260709 12:22:50.956972  8988 consensus_meta.cc:287] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.004s
I20260709 12:22:50.959527  9029 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:50.970360  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:50.880872  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:50.958083  8753 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:50.990527  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:50.971974  8995 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.993079  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:50.993687  3843 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:22:50.983194  8949 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:51.006407  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.046036  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53055.6us
I20260709 12:22:51.000524  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.027676  3849 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:22:50.998186  8950 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:50.959128  9033 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:51.031838  8966 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.034765  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.035532  8971 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:50.996662  9047 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.980369  9037 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:51.075124  8945 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.038461  3916 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:51.039088  9045 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:50.968778  8842 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:50.991305  9043 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:51.110456  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:22:51.042343  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 72037.4us
I20260709 12:22:51.008095  8874 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.044134  3847 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.115696  9043 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:51.089249  8976 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.090476  8971 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.116770  9043 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.117590  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.118209  3844 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:50.991649  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.119976  3917 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:50.995039  9039 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:51.079435  9062 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 12:22:50.931228  9050 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:51.038376  8759 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:51.048094  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47691.1us
I20260709 12:22:50.996614  8974 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.050097  9006 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:51.043596  8988 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:51.048367  8912 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:50.990005  8948 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.055676  8941 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:51.059262  9054 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.061987  8903 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.063520  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:51.063691  3850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2415) took 1792 ms (client timeout 1798 ms). Trace:
W20260709 12:22:51.065541  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.076645  9004 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:51.078022  3920 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:51.145241  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2529) took 1521 ms. Trace:
I20260709 12:22:51.145628  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.091419  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2416) took 1819 ms. Trace:
I20260709 12:22:51.146380  3841 rpcz_store.cc:276] 0709 12:22:49.271927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.931076 (+659149us) service_pool.cc:224] Handling call
0709 12:22:50.015472 (+ 84396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.935832 (+920360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.091136 (+155304us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540011b2d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:51.091349 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997531520}
I20260709 12:22:51.105229  3922 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:22:50.997604  9008 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.747s	user 0.003s	sys 0.000s
I20260709 12:22:51.124974  3847 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:51.125109  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:51.144622  3850 rpcz_store.cc:269] 0709 12:22:49.271653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.330827 (+ 59174us) service_pool.cc:224] Handling call
0709 12:22:51.063507 (+1732680us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400409054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:51.063629 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232432896}
I20260709 12:22:51.148566  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:51.125684  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:51.140971  9071 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:22:51.151955  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 88532.1us
I20260709 12:22:50.995604  8961 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.119573  8870 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:51.158706  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.159279  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:22:51.085045  8929 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:51.112028  9018 raft_consensus.cc:2764] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:51.139918  4581 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:51.115078  9044 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:50.721657  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.155768  8968 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:51.156028  9005 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:51.169783  8995 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.202534  4547 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:51.200870  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.206485  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.164937  8929 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:51.144344  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1677611869999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:22:51.145591  3920 rpcz_store.cc:276] 0709 12:22:49.623952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.077311 (+1453359us) service_pool.cc:224] Handling call
0709 12:22:51.077684 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.144970 (+ 67286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.145172 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.088615  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.208892  3848 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:51.209807  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:51.149577  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.044382  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:51.212016  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:51.150182  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.212941  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.213610  8984 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.213976  8529 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.214232  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.214191  8984 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.215035  4583 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 8.
I20260709 12:22:51.216758  8984 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.217442  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.218453  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.219077  4579 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:51.219116  8987 raft_consensus.cc:2804] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:51.219848  8987 raft_consensus.cc:697] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:51.220075  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.220366  8988 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:51.220904  4579 raft_consensus.cc:2393] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 4: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:51.220820  8987 consensus_queue.cc:237] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.221782  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.223037  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.226568  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3068) took 1749 ms. Trace:
I20260709 12:22:51.226951  3921 rpcz_store.cc:276] 0709 12:22:49.477218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.477337 (+   119us) service_pool.cc:224] Handling call
0709 12:22:49.551750 (+ 74413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.853592 (+1301842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.226355 (+372763us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000212d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:51.226511 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687201664}
I20260709 12:22:51.150836  3844 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:51.140972  9006 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.153834  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:51.231630  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 77880.5us
I20260709 12:22:51.128005  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:51.232491  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.160709  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.160959  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.149957  8950 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.162596  9013 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.942s	user 0.004s	sys 0.000s
I20260709 12:22:51.143153  8941 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.098978  9033 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.262867  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.148808  9050 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:51.169804  8864 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.170240  8939 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.170614  8940 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:51.275207  8940 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:51.274912  8939 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.275640  8940 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:51.171000  9007 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:51.275218  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:51.171216  9069 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:51.279642  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2240) took 1132 ms. Trace:
I20260709 12:22:51.171689  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.172426  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:51.173421  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 3078) took 1692 ms (client timeout 1701 ms). Trace:
I20260709 12:22:51.283363  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.284034  3849 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:51.179355  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2527) took 1695 ms (client timeout 1745 ms). Trace:
I20260709 12:22:51.180122  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.180512  3890 leader_election.cc:400] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12.
I20260709 12:22:51.285661  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.169778  8948 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.186228  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:51.288972  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102822us
I20260709 12:22:51.143802  8945 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:22:51.175117  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.211715  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.261708  9000 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:51.213773  3919 raft_consensus.cc:2410] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:51.230594  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.235283  3850 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:51.235651  3917 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:51.129688  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:51.220731  8988 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:51.179198  9029 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.243615  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:51.361749  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 118313us
I20260709 12:22:51.242328  9006 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:51.252456  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:51.253933  9004 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:51.255077  8743 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:51.256071  9072 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:51.207791  8968 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:51.258641  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130738us
I20260709 12:22:51.258692  8759 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.259980  9054 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:51.260803  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0849611869998625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23199999999999998s for a response
I20260709 12:22:51.267560  3848 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:51.278465  3923 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:22:51.276497  8940 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:51.285580  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 105200us
I20260709 12:22:51.182543  8870 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:22:51.282756  3924 rpcz_store.cc:269] 0709 12:22:49.481430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.595721 (+114291us) service_pool.cc:224] Handling call
0709 12:22:51.173226 (+1577505us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400077954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:51.173332 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804097920}
I20260709 12:22:51.286947  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:51.284891  3925 rpcz_store.cc:269] 0709 12:22:49.483507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.595824 (+112317us) service_pool.cc:224] Handling call
0709 12:22:51.179127 (+1583303us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400312ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:51.179293 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942435072}
I20260709 12:22:51.262079  8941 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.290522  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.289462  8939 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.354439  8912 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:51.265517  8923 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.355801  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.356971  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.404021  3850 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:51.266497  8950 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.282855  8864 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.358661  3846 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:51.279106  9007 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:51.277267  8949 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.359196  8903 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:51.359416  8974 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.280130  3996 rpcz_store.cc:276] 0709 12:22:50.147621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.147763 (+   142us) service_pool.cc:224] Handling call
0709 12:22:50.177767 (+ 30004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.361967 (+184200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:50.376877 (+ 14910us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.666366 (+289489us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.672725 (+  6359us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.672870 (+   145us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:50.696902 (+ 24032us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.729821 (+ 32919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.079057 (+349236us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b24002c44b8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f94509d 00007fdc5257710e 00007fdc5258e88c 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221
0709 12:22:51.279236 (+200179us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540002f154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:51.279293 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.279343 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:51.279360 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.279567 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45136,"prepare.queue_time_us":44673,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":76195,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":21312,"spinlock_wait_cycles":430453248,"thread_start_us":254008,"threads_started":1,"wal-append.queue_time_us":363992}
I20260709 12:22:51.397799  8842 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.369575  3849 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:51.421862  3849 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:22:51.422214  3849 pending_rounds.cc:85] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 11
I20260709 12:22:51.422444  3849 pending_rounds.cc:107] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:22:51.422796  3849 raft_consensus.cc:2889] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:51.370587  9076 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:22:51.288233  8951 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.424834  9044 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.386767  3842 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:51.427119  3924 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:51.427822  8968 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.429790  3924 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:51.389312  4580 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:51.290431  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:51.432170  4575 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:51.432574  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.433892  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3077) took 1952 ms. Trace:
W20260709 12:22:51.438309  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.287858  9050 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.439972  8974 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.441978  9047 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.442485  9047 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.415910  8949 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.398176  8948 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:22:51.445180  8948 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:51.445703  8948 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:51.266274  8889 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:51.399971  3919 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:51.357492  3916 raft_consensus.cc:2368] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9.
I20260709 12:22:51.371279  8995 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:51.490576  8874 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:51.491391  8874 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.354449  8929 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.493351  8929 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.494581  8874 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.357762  3844 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:51.496933  8950 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.410380  3845 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:51.389020  9056 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.498003  9056 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.498446  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.499873  9018 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:51.500255  9018 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.500825  9018 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:51.365918  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.359879  9045 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.503983  9000 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:51.504693  3841 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:51.505125  9045 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.422329  9037 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.505827  9037 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.505995  4576 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:51.506253  3841 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:51.386036  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.424551  8951 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:51.448206  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.508646  3921 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:51.385313  3923 pending_rounds.cc:85] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 9
I20260709 12:22:51.409827  9005 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.509392  3923 pending_rounds.cc:107] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:22:51.509892  3923 raft_consensus.cc:2889] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:51.375972  8943 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:22:51.387962  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.520943  3925 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:51.460604  3924 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:51.434255  3918 rpcz_store.cc:276] 0709 12:22:49.481133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.066115 (+1584982us) service_pool.cc:224] Handling call
0709 12:22:51.066474 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.066820 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.066849 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.067331 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.130886 (+ 63555us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:51.130928 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.130991 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.433680 (+302689us) raft_consensus.cc:1685] finished
0709 12:22:51.433698 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.433822 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1078,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3961,"thread_start_us":63198,"threads_started":1,"wal-append.queue_time_us":84831}
I20260709 12:22:51.414517  8912 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.476214  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:51.527915  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51791.2us
I20260709 12:22:51.528784  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.488775  3916 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:22:51.500218  9056 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.504678  9000 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:51.396211  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:51.531965  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 135878us
I20260709 12:22:51.533552  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.413892  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.379683  8743 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.427264  3842 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:51.515350  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 129370us
I20260709 12:22:51.544852  3890 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.468072  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3079) took 1986 ms. Trace:
I20260709 12:22:51.545351  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:51.545532  3922 rpcz_store.cc:276] 0709 12:22:49.481715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.067329 (+1585614us) service_pool.cc:224] Handling call
0709 12:22:51.067672 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.147542 (+ 79870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.467714 (+320172us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400303ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:51.467985 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85564672}
I20260709 12:22:51.542150  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.550644  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.554005  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:51.554314  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.554646  4581 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.557404  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.558195  3843 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:51.565274  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.464818  8889 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:51.407289  8923 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:51.594534  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.576463  4580 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:51.527257  8912 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.568780  8840 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:51.556716  8944 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:51.543920  8939 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:51.556921  9045 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:51.624145  4581 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:51.572046  8581 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.544504  8792 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:22:51.614248  8889 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.668682  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:51.669517  3843 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.568470  9039 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:22:51.452874  8988 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.649672  9045 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.569258  9056 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:22:51.544198  9005 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.571494  8870 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.662850  8581 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:51.691756  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:51.665210  8944 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:51.694265  4581 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:51.696377  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.697538  3993 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:51.701743  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.704972  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.705679  3993 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:51.706833  3919 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:51.708426  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:51.709296  3993 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.710582  3843 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:51.710994  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.711877  3998 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:51.711998  4575 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:51.681210  9050 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:51.750391  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.686375  8974 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.691661  9043 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.732879  9037 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.744077  8944 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:51.746116  9080 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:51.686971  9045 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:51.604864  8948 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:51.758364  3992 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:51.703353  8581 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.718568  9056 consensus_queue.cc:1243] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:51.715334  9054 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:51.714265  8971 raft_consensus.cc:2764] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:22:51.784992  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:51.795488  3991 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:51.667229  9007 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.791839  4583 raft_consensus.cc:1240] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:51.761448  9047 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:51.757108  8949 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.782254  8951 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:51.823300  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.807874  9074 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:51.785833  8966 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:51.796965  8974 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:51.828218  3890 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.766382  9043 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:51.851663  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 304327us
I20260709 12:22:51.849925  3888 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.857442  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:51.866760  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.867856  3990 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:51.868321  3995 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:51.832043  8951 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.833608  8912 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.871022  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:51.892953  3997 raft_consensus.cc:2376] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:22:51.896903  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:51.903424  3993 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
W20260709 12:22:51.993530  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.994855  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:51.995954  3992 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 10: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:22:52.025406  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.870199  3991 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
W20260709 12:22:51.875329  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.862673  8743 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.881071  8923 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.882285  8941 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:51.832171  8720 consensus_queue.cc:1059] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:22:51.890317  9043 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:51.865538  9004 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:22:51.865312  8939 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:51.831414  9007 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:52.043295  3991 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 12:22:52.137418  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.888307  8951 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:51.864521  9082 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:22:51.919545  9060 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:22:52.161158  4548 leader_election.cc:400] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9.
I20260709 12:22:51.998292  9064 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:51.920415  9047 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.033056  8987 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:51.864013  8974 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.189839  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.190580  8720 consensus_queue.cc:1243] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:22:52.191169  9038 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:52.191473  8941 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.195693  8951 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:52.133590  9029 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.202804  8581 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.203614  9037 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:52.204066  9089 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:52.210347  8889 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 12:22:52.210884  8912 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.220132  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59203.4us
I20260709 12:22:51.921417  9059 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.266s
W20260709 12:22:52.257231  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.267005  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:52.221823  8968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.062s	sys 0.172s
W20260709 12:22:52.221745  8529 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.990s	user 0.007s	sys 0.009s
I20260709 12:22:52.233691  9064 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:52.291646  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 426190us
W20260709 12:22:52.265563  3998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.021s	sys 0.043s
I20260709 12:22:52.311841  3991 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:52.288725  3847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.001s	sys 0.037s
W20260709 12:22:52.331287  3847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.001s	sys 0.037s
I20260709 12:22:52.318620  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3071) took 2839 ms. Trace:
I20260709 12:22:52.331900  3923 rpcz_store.cc:276] 0709 12:22:49.479311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.488890 (+1009579us) service_pool.cc:224] Handling call
0709 12:22:51.179754 (+690864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.526798 (+347044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.898705 (+371907us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b5400312ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:52.318399 (+419694us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400312ed0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:52.318547 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813967488}
I20260709 12:22:52.317871  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:52.328811  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3092) took 1507 ms. Trace:
I20260709 12:22:52.335083  3925 rpcz_store.cc:276] 0709 12:22:50.821885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.390189 (+568304us) service_pool.cc:224] Handling call
0709 12:22:51.390616 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.521490 (+130874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.320273 (+798783us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540024f754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:52.328736 (+  8463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271306112}
I20260709 12:22:52.267568  9004 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.329219  4577 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
W20260709 12:22:52.344635  3848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.008s
W20260709 12:22:52.311115  8968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.062s	sys 0.173s
W20260709 12:22:52.345103  3848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.008s
W20260709 12:22:52.300329  9006 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.006s
I20260709 12:22:52.292388  8987 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:52.314275  9090 raft_consensus.cc:3055] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:52.221962  9082 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.318710  9064 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.375876  3925 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:22:52.272110  9047 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.351964  9029 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:52.397882  3888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.022s
W20260709 12:22:52.398535  3888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.023s
W20260709 12:22:52.399041  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 549247us
I20260709 12:22:52.381577  3991 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:52.351722  8990 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.290565  9038 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.413486  3925 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:22:52.414839  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:52.375056  8929 consensus_meta.cc:287] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.000s
I20260709 12:22:52.315667  8889 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.363000  8974 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.441877  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:52.362254  9006 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.474120  9006 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:52.377075  8840 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.004s
I20260709 12:22:52.475790  8840 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:52.476785  8840 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:52.477453  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3233) took 1548 ms. Trace:
I20260709 12:22:52.477926  3847 rpcz_store.cc:276] 0709 12:22:50.929326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.471891 (+542565us) service_pool.cc:224] Handling call
0709 12:22:51.545115 (+ 73224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.545449 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.545478 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.617805 (+ 72327us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.333715 (+715910us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:52.333782 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.333895 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.477221 (+143326us) raft_consensus.cc:1685] finished
0709 12:22:52.477244 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.477386 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9940,"raft.queue_time_us":4940,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":13990,"thread_start_us":656001,"threads_started":1,"wal-append.queue_time_us":779935}
I20260709 12:22:52.479594  3843 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:22:52.363569  9090 raft_consensus.cc:740] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:52.481674  9082 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:52.481429  9090 consensus_queue.cc:260] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.482991  9090 raft_consensus.cc:3060] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:52.434266  3918 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:22:52.463878  3844 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:52.310642  9089 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.435173  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.490626  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:52.491411  3991 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.392313  9029 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.460896  8968 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:52.461268  9047 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.461485  9056 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.463156  9038 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:52.463634  9018 consensus_meta.cc:287] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.962s	user 0.013s	sys 0.004s
W20260709 12:22:52.464062  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.464408  8889 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.465054  8581 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:52.444154  8951 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.355332  9004 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:52.569129  3889 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.529s (SENT)
I20260709 12:22:52.569828  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:52.471365  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:52.571492  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 100225us
W20260709 12:22:52.572347  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.573176  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:52.317780  8912 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.478731  8840 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:52.482666  8987 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.391366  9033 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:52.439183  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:52.509620  9029 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:52.460775  9088 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:22:52.526028  3841 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.017s	sys 0.022s
W20260709 12:22:52.607713  3841 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.017s	sys 0.022s
I20260709 12:22:52.506572  8939 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:52.548333  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:52.575470  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:52.437052  9007 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:22:52.487394  3920 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.595954  8842 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.598331  8912 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:52.590065  9043 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:52.588218  8840 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:52.604664  9082 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:52.606370  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3240) took 1081 ms. Trace:
I20260709 12:22:52.616930  3843 rpcz_store.cc:276] 0709 12:22:51.525088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.740922 (+215834us) service_pool.cc:224] Handling call
0709 12:22:51.742836 (+  1914us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:52.480146 (+737310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.606088 (+125942us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54001194d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:52.606295 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693495168}
I20260709 12:22:52.606635  9004 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.610556  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:22:52.612797  3842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.015s	sys 0.024s
I20260709 12:22:52.614264  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:52.563702  9038 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.619956  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3082) took 1965 ms. Trace:
W20260709 12:22:52.629874  3842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.016s	sys 0.024s
I20260709 12:22:52.630136  3917 rpcz_store.cc:276] 0709 12:22:50.654525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.360256 (+705731us) service_pool.cc:224] Handling call
0709 12:22:51.360590 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.360791 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:51.620534 (+259743us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.619377 (+998843us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18001acd40. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a
0709 12:22:52.619599 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.619654 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:52.619704 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.619770 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.619895 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58037,"prepare.queue_time_us":314529,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":3172096,"thread_start_us":332055,"threads_started":2,"wal-append.queue_time_us":253218}
W20260709 12:22:52.631660  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.620604  9045 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 12:22:52.624886  3747 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 264) took 7550 ms. Trace:
W20260709 12:22:52.632442  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.638213  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:52.639277  3843 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:52.622920  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.634083  3847 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 7: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:52.645226  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:52.526533  8968 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.647006  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:52.655118  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:52.656148  3925 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:52.527549  9056 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.611081  8923 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:52.568640  9018 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.440717  8990 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.617703  8842 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.653860  3991 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:52.673806  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.696738  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.697891  3991 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:52.628901  9082 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:52.704936  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:52.705930  3991 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:52.711349  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 372031us
I20260709 12:22:52.704061  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.648176  8912 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:52.665025  8889 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:52.718511  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:52.721057  3920 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:52.727854  3923 raft_consensus.cc:2368] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:52.690207  9098 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:52.743033  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.703289  9082 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:52.660043  9038 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:52.745030  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.717242  8912 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:52.729753  9074 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:52.757793  9107 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.745003  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.727866  8889 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:52.783576  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.768030  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:52.731253  9089 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:52.636154  3747 rpcz_store.cc:276] 0709 12:22:45.075079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.082543 (+  7464us) service_pool.cc:224] Handling call
0709 12:22:52.624772 (+7542229us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:48.186906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:48.312781 (+125875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:48.316363 (+  3582us) write_op.cc:435] Acquired schema lock
0709 12:22:48.316382 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:48.392277 (+ 75895us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:48.398577 (+  6300us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:48.402186 (+  3609us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:48.469289 (+ 67103us) tablet.cc:701] Row locks acquired
0709 12:22:48.469318 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:22:48.469543 (+   225us) write_op.cc:270] Start()
0709 12:22:48.469698 (+   155us) write_op.cc:276] Timestamp: P: 1783599768469471 usec, L: 0
0709 12:22:48.469727 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:22:48.470598 (+   871us) log.cc:844] Serialized 923 byte log entry
0709 12:22:49.191231 (+720633us) op_driver.cc:464] REPLICATION: finished
0709 12:22:49.917906 (+726675us) write_op.cc:301] APPLY: starting
0709 12:22:49.932894 (+ 14988us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:50.439224 (+506330us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:50.494405 (+ 55181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:50.496264 (+  1859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:50.496564 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:22:50.496639 (+    75us) write_op.cc:312] APPLY: finished
0709 12:22:50.496917 (+   278us) log.cc:844] Serialized 33 byte log entry
0709 12:22:50.497191 (+   274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:50.497306 (+   115us) write_op.cc:454] Released schema lock
0709 12:22:50.497523 (+   217us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:50.531166 (+ 33643us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:50.533020 (+  1854us) write_op.cc:454] Released schema lock
0709 12:22:50.780734 (+247714us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f032a 00007fdc52975f14 00007fdc52975ec3 00007fdc52975e38 00007fdc52975df3 00007fdc529750dc 00007fdc5299ee16 00007fdc52986cbb 00007fdc5297139d 00007fdc52974d75
0709 12:22:51.162615 (+381881us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800395aa0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f906522 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
Metrics: {"mutex_wait_us":696936,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":589784,"apply.run_cpu_time_us":8264,"apply.run_wall_time_us":655373,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":637880,"prepare.run_cpu_time_us":25447,"prepare.run_wall_time_us":549457,"raft.queue_time_us":33041,"raft.run_cpu_time_us":93860,"raft.run_wall_time_us":1636555,"replication_time_us":697563,"spinlock_wait_cycles":49132160,"thread_start_us":1009359,"threads_started":4,"wal-append.queue_time_us":1001282,"wal-append.run_cpu_time_us":15084,"wal-append.run_wall_time_us":2343431}]]}
I20260709 12:22:52.657858  9045 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:52.765913  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 708) took 1052 ms. Trace:
I20260709 12:22:52.772724  8912 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.740665  9004 consensus_queue.cc:1059] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:22:52.789515  3998 rpcz_store.cc:276] 0709 12:22:51.713251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.713382 (+   131us) service_pool.cc:224] Handling call
0709 12:22:51.713727 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.714002 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:52.331308 (+617306us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.762656 (+431348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.762716 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:52.762762 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.765730 (+  2968us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.765849 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":717531,"prepare.run_cpu_time_us":998,"prepare.run_wall_time_us":23344,"thread_start_us":998900,"threads_started":2}
I20260709 12:22:52.775524  9074 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:52.782881  9000 consensus_meta.cc:287] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.220s	user 0.014s	sys 0.001s
I20260709 12:22:52.784631  3925 raft_consensus.cc:2468] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 5.
I20260709 12:22:52.798063  3843 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:52.799567  3996 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:22:52.797282  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1154) took 2008 ms. Trace:
I20260709 12:22:52.798233  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2440) took 1523 ms. Trace:
I20260709 12:22:52.771667  9059 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:52.826924  4548 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:52.805006  3991 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:52.727607  8840 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:52.822707  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.831164  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 184285us
I20260709 12:22:52.792546  9089 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.832535  3991 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:22:52.832801  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.827536  3846 rpcz_store.cc:276] 0709 12:22:50.788999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.408431 (+619432us) service_pool.cc:224] Handling call
0709 12:22:51.418958 (+ 10527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.419546 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.419590 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.420411 (+   821us) log.cc:844] Serialized 52 byte log entry
0709 12:22:51.775739 (+355328us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:51.826277 (+ 50538us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.826618 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.826709 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.797048 (+970339us) raft_consensus.cc:1685] finished
0709 12:22:52.797072 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.797214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51447,"raft.queue_time_us":11781,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":3007,"spinlock_wait_cycles":6683392,"thread_start_us":226058,"threads_started":1,"wal-append.queue_time_us":645152}
I20260709 12:22:52.833567  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:52.834065  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:52.827906  3848 rpcz_store.cc:276] 0709 12:22:51.275143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.545699 (+270556us) service_pool.cc:224] Handling call
0709 12:22:51.545985 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.546169 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:51.571020 (+ 24851us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.355694 (+784674us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.797511 (+441817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.797568 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:52.797625 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.797696 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.798173 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":786552,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":87,"raft.queue_time_us":119624,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":261,"spinlock_wait_cycles":284616064,"thread_start_us":1218456,"threads_started":3,"wal-append.queue_time_us":715191}
I20260709 12:22:52.783999  9107 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.771885  9047 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:22:52.786864  8974 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:52.742810  8939 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:52.837556  9100 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:22:52.849874  3996 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:52.835798  8529 raft_consensus.cc:2804] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:52.796773  8929 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:22:52.855427  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:52.830428  9000 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.839195  9018 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.847700  8840 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:52.869722  8968 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.880534  3849 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:52.871716  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:52.836491  8889 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.884327  3996 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:52.885156  3846 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:52.893580  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3183) took 1021 ms. Trace:
W20260709 12:22:52.894826  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.897297  3995 rpcz_store.cc:276] 0709 12:22:51.871807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.871963 (+   156us) service_pool.cc:224] Handling call
0709 12:22:51.996848 (+124885us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.997400 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.997441 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:52.166838 (+169397us) log.cc:844] Serialized 52 byte log entry
0709 12:22:52.615222 (+448384us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:52.615276 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.615382 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.893316 (+277934us) raft_consensus.cc:1685] finished
0709 12:22:52.893340 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.893508 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9472,"raft.queue_time_us":37097,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":32118,"thread_start_us":419384,"threads_started":1,"wal-append.queue_time_us":644179}
I20260709 12:22:52.905830  8999 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:52.915359  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 311219us
I20260709 12:22:52.916183  8999 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:52.926496  9038 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:52.875797  9110 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:52.870374  9056 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:52.907721  8592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.490s	user 0.019s	sys 0.034s
W20260709 12:22:52.930799  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.956884  3996 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:52.961575  3996 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:52.966918  3815 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.701s (SENT)
I20260709 12:22:52.968520  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:52.966243  8592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.545s	user 0.020s	sys 0.034s
W20260709 12:22:52.956290  9113 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:22:52.928939  8950 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:52.996793  8759 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:52.990325  3996 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.005980  3996 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.010330  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3184) took 1138 ms. Trace:
I20260709 12:22:52.987939  8889 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:53.014356  3992 rpcz_store.cc:276] 0709 12:22:52.033917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.034409 (+   492us) service_pool.cc:224] Handling call
0709 12:22:52.165644 (+131235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.181267 (+ 15623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.181316 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.188911 (+  7595us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.507336 (+318425us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:52.507394 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.507509 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.008700 (+501191us) raft_consensus.cc:1685] finished
0709 12:22:53.008720 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.010252 (+  1532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15079,"raft.queue_time_us":23132,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"thread_start_us":310620,"threads_started":1,"wal-append.queue_time_us":586511}
W20260709 12:22:52.929064  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 298492us
W20260709 12:22:53.008545  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 109223us
I20260709 12:22:53.022657  3846 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:52.986001  9114 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:53.022686  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.025133  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:53.026438  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.026453  9114 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:53.028151  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.028887  3846 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:53.028574  9114 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.030786  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.031769  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2447) took 1183 ms. Trace:
I20260709 12:22:53.033308  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.033110  3846 rpcz_store.cc:276] 0709 12:22:51.848056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.030545 (+1182489us) service_pool.cc:224] Handling call
0709 12:22:53.031692 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.034211  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:53.034705  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:53.034982  3992 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:53.036000  3814 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.769s (SENT)
I20260709 12:22:53.036017  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1166) took 1476 ms. Trace:
I20260709 12:22:53.037781  3846 rpcz_store.cc:276] 0709 12:22:51.560006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.034630 (+1474624us) service_pool.cc:224] Handling call
0709 12:22:53.035462 (+   832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.035675 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.035713 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.035759 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:53.035797 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.035856 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.035954 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.038755  8529 raft_consensus.cc:697] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:52.989352  9110 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:53.043556  3992 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:53.046114  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.048846  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2443) took 1647 ms. Trace:
I20260709 12:22:53.049094  3992 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:53.006408  8950 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.052260  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.049273  3842 rpcz_store.cc:276] 0709 12:22:51.401747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.546847 (+145100us) service_pool.cc:224] Handling call
0709 12:22:51.547221 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.554722 (+  7501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.554769 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.555619 (+   850us) log.cc:844] Serialized 52 byte log entry
0709 12:22:52.630406 (+1074787us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:52.630469 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.630565 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.048623 (+418058us) raft_consensus.cc:1685] finished
0709 12:22:53.048644 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.048779 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6013,"raft.queue_time_us":6155,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11949,"thread_start_us":973500,"threads_started":1,"wal-append.queue_time_us":1231130}
I20260709 12:22:53.053751  3991 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:53.054697  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:53.055090  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.055364  3842 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.052680  9038 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.056902  9047 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:53.057404  9038 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.057574  9047 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.060349  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3179) took 1194 ms. Trace:
I20260709 12:22:53.061362  9047 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.061566  8529 consensus_queue.cc:237] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.062959  9047 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.063513  9047 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.060746  3994 rpcz_store.cc:276] 0709 12:22:51.865770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.865903 (+   133us) service_pool.cc:224] Handling call
0709 12:22:51.873082 (+  7179us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.873492 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.873523 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.877739 (+  4216us) log.cc:844] Serialized 52 byte log entry
0709 12:22:52.344273 (+466534us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180047d160. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:52.737935 (+393662us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:52.737979 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.738057 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.060009 (+321952us) raft_consensus.cc:1685] finished
0709 12:22:53.060030 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.060260 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":32920448,"thread_start_us":393418,"threads_started":1,"wal-append.queue_time_us":987067}
I20260709 12:22:53.065343  9089 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.065752  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.066048  9059 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.066278  9047 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:53.066900  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.066569  9059 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.066956  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.066057  9107 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.068214  8759 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.068815  9059 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.068742  8759 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.069285  9038 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.070012  8950 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:53.070827  9005 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.071033  8759 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.068226  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.072328  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2446) took 1224 ms. Trace:
I20260709 12:22:53.077492  3996 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:53.081032  3991 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:53.082438  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.013653  8912 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.044056  9045 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:53.080263  3846 rpcz_store.cc:276] 0709 12:22:51.847690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.039894 (+1192204us) service_pool.cc:224] Handling call
0709 12:22:53.071800 (+ 31906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.071996 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.072022 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.072071 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:53.072107 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.072160 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.072268 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.086359  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3185) took 1051 ms. Trace:
I20260709 12:22:53.087486  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:53.079945  9047 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.090761  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:53.091192  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:53.102829  9031 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:22:53.103039  4578 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:53.103577  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1295) took 2420 ms. Trace:
I20260709 12:22:53.103753  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:53.103971  3921 rpcz_store.cc:276] 0709 12:22:50.683414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.377059 (+693645us) service_pool.cc:224] Handling call
0709 12:22:51.402091 (+ 25032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.522379 (+120288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.103307 (+1580928us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000465d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:53.103518 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244400512}
W20260709 12:22:53.105361  9112 log.cc:927] Time spent T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:22:53.106612  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.107506  9115 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:22:53.108134  4576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 756) took 1909 ms (client timeout 2102 ms). Trace:
W20260709 12:22:53.108547  4576 rpcz_store.cc:269] 0709 12:22:51.198963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.199382 (+   419us) service_pool.cc:224] Handling call
0709 12:22:53.107931 (+1908549us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540012b1d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:53.108070 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661412736}
W20260709 12:22:53.109316  9064 consensus_meta.cc:287] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.004s
I20260709 12:22:53.109732  9064 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.110049  9005 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:53.110656  9005 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.111735  9074 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:53.109316  9033 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.005s
I20260709 12:22:53.113857  9074 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.114632  9110 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.115010  9064 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.092303  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.092862  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.093988  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:53.093988  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:53.099165  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:53.100044  9119 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:22:53.101424  3814 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.901s (SENT)
I20260709 12:22:53.096218  3993 rpcz_store.cc:276] 0709 12:22:52.034859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.034978 (+   119us) service_pool.cc:224] Handling call
0709 12:22:52.035293 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.035550 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:52.488485 (+452935us) log.cc:844] Serialized 14 byte log entry
0709 12:22:53.085891 (+597406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.085979 (+    88us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:53.086055 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.086150 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.086299 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":426549,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":75474,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"spinlock_wait_cycles":16377728,"thread_start_us":912634,"threads_started":3,"wal-append.queue_time_us":411817}
W20260709 12:22:53.123181  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.121961  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:53.108170  9090 consensus_meta.cc:287] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.003s
I20260709 12:22:53.165449  3842 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:53.215514  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.223270  3993 raft_consensus.cc:2410] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:53.224304  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.225762  3993 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:22:53.216600  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 115191us
I20260709 12:22:53.214798  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:53.226815  3994 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:53.217949  3992 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.218209  3991 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 5.
W20260709 12:22:53.173396  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.160277  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.091130  8759 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:53.268666  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:53.230824  3991 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:53.275173  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60937us
I20260709 12:22:53.118453  8743 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.147032  8592 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.078974  8842 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.283877  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.286090  3842 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:53.286780  3994 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:22:53.285324  8743 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:53.295670  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.291062  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1169) took 1077 ms. Trace:
I20260709 12:22:53.306499  3842 rpcz_store.cc:276] 0709 12:22:52.213364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.285455 (+1072091us) service_pool.cc:224] Handling call
0709 12:22:53.285789 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.290719 (+  4930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.290976 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:53.292109  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:53.136889  9114 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:53.305154  3991 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.270759  8929 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.292596  9115 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:53.276798  9125 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:53.309157  3992 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:53.315901  3991 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:53.320523  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:53.318153  3995 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:53.318343  3996 raft_consensus.cc:2410] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:53.305696  9004 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.304997  3994 raft_consensus.cc:1240] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:53.318645  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:53.133997  9047 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.325448  8923 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:53.321833  8929 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.289695  9134 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:53.330963  3921 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:22:53.309134  9033 raft_consensus.cc:2764] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:53.367877  3925 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.372781  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3186) took 1337 ms. Trace:
I20260709 12:22:53.384032  9127 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:53.383919  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65357.5us
I20260709 12:22:53.384621  8950 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:53.332235  9125 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:53.386972  9092 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.031s	user 0.000s	sys 0.002s
I20260709 12:22:53.388523  9005 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.390722  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3193) took 1255 ms. Trace:
I20260709 12:22:53.392928  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1167) took 1491 ms. Trace:
I20260709 12:22:53.393970  8842 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.588080  3998 rpcz_store.cc:276] 0709 12:22:52.135084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.798456 (+663372us) service_pool.cc:224] Handling call
0709 12:22:52.799561 (+  1105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.024015 (+224454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.024048 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.031265 (+  7217us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.092097 (+ 60832us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:53.092130 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.092196 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.390501 (+298305us) raft_consensus.cc:1685] finished
0709 12:22:53.390522 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.390656 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120302,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":274971,"threads_started":2,"wal-append.queue_time_us":277987}
I20260709 12:22:53.397917  8990 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.365713  8999 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.400298  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3235) took 2386 ms. Trace:
I20260709 12:22:53.402341  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 700) took 1709 ms. Trace:
I20260709 12:22:53.604480  3844 rpcz_store.cc:276] 0709 12:22:51.014132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.496348 (+482216us) service_pool.cc:224] Handling call
0709 12:22:51.496807 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.485999 (+989192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.399948 (+913949us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400407254. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:53.400219 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223572736}
I20260709 12:22:53.604596  3999 rpcz_store.cc:276] 0709 12:22:51.693036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.693199 (+   163us) service_pool.cc:224] Handling call
0709 12:22:51.693535 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.693886 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.693913 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.694471 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.883129 (+1188658us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b18004eb980. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc525930d1 00007fdc529aea0f
0709 12:22:53.078146 (+195017us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:53.078183 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.078249 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.402023 (+323774us) raft_consensus.cc:1685] finished
0709 12:22:53.402044 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.402274 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14532,"spinlock_wait_cycles":74780416,"thread_start_us":194819,"threads_started":1,"wal-append.queue_time_us":1573810}
I20260709 12:22:53.292141  8592 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.330191  9004 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.404484  8929 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.406275  8889 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:53.407331  8912 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.285882  8759 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.411916  8743 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:53.421671  9082 consensus_meta.cc:287] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.006s
I20260709 12:22:53.425491  8864 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:53.428012  4577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 762) took 2225 ms (client timeout 1700 ms). Trace:
W20260709 12:22:53.619473  4577 rpcz_store.cc:269] 0709 12:22:51.202256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.211773 (+  9517us) service_pool.cc:224] Handling call
0709 12:22:53.427694 (+2215921us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400896054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:53.427853 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543788800}
I20260709 12:22:53.429621  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 3103) took 1060 ms. Trace:
I20260709 12:22:53.430660  4583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 780) took 1865 ms. Trace:
W20260709 12:22:53.443177  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.443691  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:53.449791  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.451743  8903 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:22:53.455575  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.621766  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.460815  9091 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.001s	user 0.005s	sys 0.005s
I20260709 12:22:53.436664  9134 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:53.437184  9029 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.821s	user 0.018s	sys 0.003s
I20260709 12:22:53.470784  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1144) took 4263 ms. Trace:
I20260709 12:22:53.473968  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:53.484056  8529 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.486349  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:53.486519  9045 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:53.487550  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:53.492074  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:53.493777  9083 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 1.061s	user 0.002s	sys 0.000s
I20260709 12:22:53.493997  4578 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:22:53.501444  8988 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:53.652410  3918 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:53.511981  8948 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:53.514062  9116 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.613s	user 0.002s	sys 0.000s
I20260709 12:22:53.520192  8940 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:53.528072  3843 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:53.635114  8903 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:53.533849  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.546409  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 225796us
I20260709 12:22:53.573639  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:53.675300  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.575484  3925 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:22:53.676097  3925 pending_rounds.cc:85] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 11
W20260709 12:22:53.676192  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 102664us
I20260709 12:22:53.554625  3997 rpcz_store.cc:276] 0709 12:22:52.035147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.035280 (+   133us) service_pool.cc:224] Handling call
0709 12:22:52.035765 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.159114 (+123349us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:52.609880 (+450766us) log.cc:844] Serialized 14 byte log entry
0709 12:22:53.029540 (+419660us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.030037 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.030204 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:53.030237 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.030299 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.372465 (+342166us) raft_consensus.cc:1685] finished
0709 12:22:53.372497 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.372688 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15850,"prepare.queue_time_us":303230,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":203799,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":13172,"thread_start_us":750691,"threads_started":3,"wal-append.queue_time_us":288379}
I20260709 12:22:53.557358  8941 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.578915  9124 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.579103  9031 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.575165  8961 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.579166  8923 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.332113  9114 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.578958  9130 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:53.589231  9131 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.617324  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.623047  3848 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:53.623497  3920 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:22:53.625061  3923 rpcz_store.cc:276] 0709 12:22:52.370910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.412055 (+ 41145us) service_pool.cc:224] Handling call
0709 12:22:53.429352 (+1017297us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400077954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:53.429541 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312664960}
I20260709 12:22:53.632611  9082 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.633492  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3188) took 1500 ms. Trace:
I20260709 12:22:53.623849  4583 rpcz_store.cc:276] 0709 12:22:51.565337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.566355 (+  1018us) service_pool.cc:224] Handling call
0709 12:22:51.606865 (+ 40510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.815537 (+208672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.430340 (+1614803us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54006108d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:53.430589 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424547072}
I20260709 12:22:53.630191  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:53.637598  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:53.588429  9039 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:22:53.612118  8996 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.639789  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.612355  8889 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.511237  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:22:53.654134  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 180260us
I20260709 12:22:53.649751  3845 rpcz_store.cc:276] 0709 12:22:49.207462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.395840 (+188378us) service_pool.cc:224] Handling call
0709 12:22:51.064048 (+1668208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.497821 (+433773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.319945 (+822124us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400409054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:53.470493 (+1150548us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400409050. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:53.470702 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4543276672}
I20260709 12:22:53.614575  8999 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:53.667776  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:53.668047  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:53.669835  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.528643  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3234) took 2557 ms. Trace:
I20260709 12:22:53.612645  8990 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:22:53.676450  3925 pending_rounds.cc:107] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:22:53.677886  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:53.588728  3846 rpcz_store.cc:276] 0709 12:22:51.901160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.095193 (+1194033us) service_pool.cc:224] Handling call
0709 12:22:53.118723 (+ 23530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.119287 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.119338 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.123181 (+  3843us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.285001 (+161820us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:53.288558 (+  3557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.288670 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.392700 (+104030us) raft_consensus.cc:1685] finished
0709 12:22:53.392720 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.392863 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"raft.queue_time_us":3910,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":82485,"thread_start_us":161190,"threads_started":1,"wal-append.queue_time_us":211700}
I20260709 12:22:53.588222  8950 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.616083  9126 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:53.679271  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:53.682016  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 778) took 2306 ms. Trace:
I20260709 12:22:53.683038  8903 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.686587  9125 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.667972  9047 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.665050  9045 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.656435  9029 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:53.690111  9005 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.868741  9134 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:53.868541  9005 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.869802  9029 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:53.870996  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.871923  3847 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10.
I20260709 12:22:53.665274  8870 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:53.873423  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1162) took 2686 ms. Trace:
W20260709 12:22:53.873457  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 243360us
I20260709 12:22:53.874645  3925 raft_consensus.cc:2889] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.722090  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:53.882252  3916 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:53.697021  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.780846  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.884859  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:53.876073  3922 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.872597  3849 rpcz_store.cc:276] 0709 12:22:50.971669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.479605 (+507936us) service_pool.cc:224] Handling call
0709 12:22:51.515644 (+ 36039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.881209 (+1365565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.454042 (+572833us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400407c54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:53.455224 (+  1182us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b5400407c50. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:53.455431 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220248192}
I20260709 12:22:53.968885  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.886801  3990 rpcz_store.cc:276] 0709 12:22:52.133448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.789168 (+655720us) service_pool.cc:224] Handling call
0709 12:22:52.791951 (+  2783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:52.929766 (+137815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.929813 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:52.959453 (+ 29640us) log.cc:844] Serialized 52 byte log entry
0709 12:22:53.092787 (+133334us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:53.092821 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.092883 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.633218 (+540335us) raft_consensus.cc:1685] finished
0709 12:22:53.633240 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.633419 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114813,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"thread_start_us":211436,"threads_started":2,"wal-append.queue_time_us":315859}
I20260709 12:22:53.878850  3841 rpcz_store.cc:276] 0709 12:22:51.187279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.507060 (+319781us) service_pool.cc:224] Handling call
0709 12:22:51.507346 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.516153 (+  8807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.516198 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.517122 (+   924us) log.cc:844] Serialized 52 byte log entry
0709 12:22:51.865791 (+348669us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:52.608148 (+742357us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.608377 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.608495 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.459942 (+851447us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:53.873126 (+413184us) raft_consensus.cc:1685] finished
0709 12:22:53.873214 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.873354 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17470,"prepare.queue_time_us":734338,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2379,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":30741,"spinlock_wait_cycles":112345984,"thread_start_us":1020412,"threads_started":2,"wal-append.queue_time_us":808154}
I20260709 12:22:53.872874  4574 rpcz_store.cc:276] 0709 12:22:51.375708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.375967 (+   259us) service_pool.cc:224] Handling call
0709 12:22:51.376370 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.376626 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.376654 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.377725 (+  1071us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.765344 (+387619us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:51.765384 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.765452 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.492961 (+1727509us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:53.681618 (+188657us) raft_consensus.cc:1685] finished
0709 12:22:53.681644 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.681910 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84349312,"thread_start_us":352197,"threads_started":1,"wal-append.queue_time_us":916218}
I20260709 12:22:53.689158  9043 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:53.946336  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 268550us
I20260709 12:22:53.974009  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:53.962111  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 90558.5us
W20260709 12:22:53.963255  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.955991  3918 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:53.877252  8903 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:53.970467  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.006026  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.006366  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:54.006978  3918 raft_consensus.cc:1240] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:54.007234  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.971628  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.972761  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:53.947206  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 66078.7us
I20260709 12:22:53.665918  8529 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.011245  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.011253  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.950191  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:53.877311  8581 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:53.982456  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:53.983485  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:53.875653  8889 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:53.946369  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.013890  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:54.012712  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:53.951771  9134 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:22:54.022717  3848 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:54.016527  3916 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:53.952210  9125 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:54.039602  9141 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:22:54.023722  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:54.041520  8950 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:54.041682  9138 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 12:22:54.042241  3923 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:54.012259  9142 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.052048  9142 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.053541  4582 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 9: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:54.054662  9142 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.055742  9004 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.055895  8966 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.056449  9004 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:54.058077  3846 raft_consensus.cc:1217] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Deduplicated request from leader. Original: 10.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:22:54.058626  3846 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:22:53.690812  8941 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.061599  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:54.015915  3843 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:22:54.064786  3843 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:54.022282  4574 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:54.013863  3849 raft_consensus.cc:2410] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:54.022913  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:54.066366  4583 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:54.026386  3841 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:54.028234  3848 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:53.877740  8999 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.007516  8743 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:53.877611  8996 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.034436  8581 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:54.085117  8987 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:54.067338  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.038494  8912 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.070711  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.062954  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.090442  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:54.015115  9006 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.511s	user 0.014s	sys 0.049s
I20260709 12:22:54.011653  8874 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:53.878899  8961 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.079896  8759 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.080718  8996 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.084465  8581 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.723205  9124 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.877866  9126 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:54.091814  8944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.612s	user 0.041s	sys 0.053s
I20260709 12:22:54.094107  3921 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:54.095420  8912 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.059703  9005 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.010718  8931 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:22:53.979234  9131 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.132443  8999 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.056476  8966 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.097786  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2257) took 1070 ms. Trace:
I20260709 12:22:54.136899  3993 rpcz_store.cc:276] 0709 12:22:53.027182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.226381 (+199199us) service_pool.cc:224] Handling call
0709 12:22:53.291373 (+ 64992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.315776 (+ 24403us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:53.315809 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.331340 (+ 15531us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.670154 (+338814us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:53.670201 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.670290 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.097525 (+427235us) raft_consensus.cc:1685] finished
0709 12:22:54.097549 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.097698 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23635,"raft.queue_time_us":26201,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10838,"thread_start_us":269972,"threads_started":1,"wal-append.queue_time_us":695804}
I20260709 12:22:54.085646  8987 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:54.099774  8941 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.005350  9047 consensus_queue.cc:1059] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:22:54.103132  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.108007  8874 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:53.879076  9130 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:53.734153  9031 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.030649  8974 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 12:22:54.094743  9006 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.015s	sys 0.049s
I20260709 12:22:54.006493  8923 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.097625  9045 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.119987  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.123987  8912 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.136428  4575 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:54.121497  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.163182  3848 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:54.108981  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:54.112766  8944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.653s	user 0.042s	sys 0.053s
I20260709 12:22:54.145140  4580 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:54.147888  8874 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:54.157501  8941 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.159123  8931 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:54.209285  3962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.015s
W20260709 12:22:54.149006  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45990.5us
W20260709 12:22:54.209795  3962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.006s	sys 0.015s
W20260709 12:22:54.210358  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 633943us
I20260709 12:22:54.151367  9082 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.212241  9047 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.213022  9047 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.216857  9047 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:54.151793  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.152659  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.223918  3916 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:54.153825  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.121505  3922 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:54.232438  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:54.233265  3922 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:54.234011  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:54.153083  4548 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.159930  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.165669  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.199298  8912 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.146979  3850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.023s
W20260709 12:22:54.147305  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.242379  9047 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.244571  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91605.6us
W20260709 12:22:54.246014  3850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.008s	sys 0.024s
I20260709 12:22:54.149314  9128 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:22:54.262439  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.151903  8889 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.261132  8990 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:54.254910  8941 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.188211  8874 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:54.272372  9037 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:54.261328  8912 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.273533  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.274573  9031 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.278781  9124 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.244728  8931 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.280334  9126 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.280643  8961 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.281085  9114 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.265035  8999 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.282837  8940 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.001s
W20260709 12:22:54.344432  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.283962  8988 consensus_meta.cc:287] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.003s
I20260709 12:22:54.284593  8923 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.286721  9142 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:54.287459  9000 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:54.295588  4547 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.008s	sys 0.016s
W20260709 12:22:54.359642  4547 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.008s	sys 0.016s
W20260709 12:22:54.360170  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 711947us
I20260709 12:22:54.348773  3846 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
W20260709 12:22:54.297461  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52247us
I20260709 12:22:54.320993  9043 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:22:54.275866  9149 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:22:54.312485  3925 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:54.277274  9131 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.343223  8931 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:54.295055  8990 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.320505  9037 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:54.380268  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 366586us
I20260709 12:22:54.296255  9047 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.395011  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:54.350145  9064 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.373029  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:54.396080  3922 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.374557  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.362432  9059 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.397356  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:54.395309  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.320619  8950 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:22:54.369628  3993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:54.401695  3993 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:54.350451  8999 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.396970  3923 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:54.406849  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.393065  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:54.402307  3815 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.422222  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:54.423139  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.370877  8940 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:22:54.383582  9031 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:54.440811  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.394764  9037 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.382965  8990 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:54.431293  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.428843  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:54.443246  3919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.028s	sys 0.057s
I20260709 12:22:54.439078  3848 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:54.449306  3850 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:54.450390  3848 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:54.403664  8988 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:54.378695  9000 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:22:54.451583  3919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.029s	sys 0.057s
W20260709 12:22:54.452111  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3343020809998052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 12:22:54.449199  3923 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:22:54.455339  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:54.382754  8923 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:22:54.458936  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.467859  3997 raft_consensus.cc:1275] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:54.468111  3994 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:54.468660  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.468916  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.469089  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.420809  8864 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:54.469199  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.459712  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.469624  3997 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:54.469882  3994 raft_consensus.cc:2376] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15. Re-sending same reply.
I20260709 12:22:54.470139  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.470587  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.470739  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.471277  3997 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:54.470782  3850 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:54.474720  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.460021  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.472550  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.476868  3848 raft_consensus.cc:2410] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:54.476723  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.477394  3995 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:22:54.477665  3992 raft_consensus.cc:2368] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:54.476339  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.402626  8996 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:22:54.478605  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.472972  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.480361  3991 raft_consensus.cc:2410] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:54.480154  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.458303  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.457813  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.487397  3999 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:54.488759  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.489223  8889 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.489888  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.490250  8912 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:54.490496  3995 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:54.490917  9047 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.491786  9134 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:54.456136  9029 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:54.424824  8948 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:22:54.495759  9152 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:54.478860  8944 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:54.496852  8944 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.474836  8864 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.500275  8864 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:54.502229  8966 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.503248  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.503631  3922 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
I20260709 12:22:54.442305  9031 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:54.504751  8999 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.505198  9031 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.506480  9031 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:54.508080  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.432018  8974 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:54.511839  3996 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:54.401212  9064 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.490936  8941 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.520232  3997 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:22:54.499176  8944 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.451750  9043 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.530704  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.526187  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:54.526961  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.452845  9124 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:54.453047  9126 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:54.535818  8974 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:54.524574  9125 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:54.589943  8720 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.032s
I20260709 12:22:54.607372  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.406549  9059 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.655073  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.678092  3992 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:54.655366  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:54.682590  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.471355  3994 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:54.678673  3991 raft_consensus.cc:2376] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16. Re-sending same reply.
I20260709 12:22:54.424942  9151 consensus_queue.cc:1059] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:22:54.653373  8923 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:22:54.690425  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.690645  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 268498us
I20260709 12:22:54.690138  3841 raft_consensus.cc:3055] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:54.691671  3841 raft_consensus.cc:740] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:54.692442  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.693734  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.697525  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1170) took 2324 ms. Trace:
I20260709 12:22:54.697966  3842 rpcz_store.cc:276] 0709 12:22:52.373053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.307264 (+934211us) service_pool.cc:224] Handling call
0709 12:22:53.307613 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.645340 (+337727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.645370 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.645430 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:53.645477 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.697265 (+1051788us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54002256d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:54.697316 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.697460 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1933,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13033,"spinlock_wait_cycles":750330112}
I20260709 12:22:54.697983  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 802) took 1207 ms. Trace:
I20260709 12:22:54.700500  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1313) took 1148 ms. Trace:
W20260709 12:22:54.610329  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 444711us
W20260709 12:22:54.607586  3814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.007s
W20260709 12:22:54.701195  3814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.008s
I20260709 12:22:54.700934  3921 rpcz_store.cc:276] 0709 12:22:53.552406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.564409 (+ 12003us) service_pool.cc:224] Handling call
0709 12:22:53.574985 (+ 10576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.111136 (+536151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.700250 (+589114us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400079254. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:54.700435 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192646912}
W20260709 12:22:54.701748  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 669080us
I20260709 12:22:54.450693  9114 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:22:54.660355  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.702939  3996 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:54.583261  8912 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:22:54.584059  9043 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.708250  3843 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:22:54.675340  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 418783us
I20260709 12:22:54.699918  4575 rpcz_store.cc:276] 0709 12:22:53.491345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.491763 (+   418us) service_pool.cc:224] Handling call
0709 12:22:54.697752 (+1205989us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400671954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:54.697908 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114059520}
I20260709 12:22:54.676975  9125 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.716645  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.715065  9125 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:54.715401  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.718833  3994 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:22:54.720052  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 274633us
I20260709 12:22:54.698946  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.706744  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:54.735646  4576 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:54.707546  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.654117  3999 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:54.653239  3962 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:54.724932  3998 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:54.676481  9124 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.708498  8889 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:54.711937  8912 consensus_queue.cc:1243] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:54.676836  9126 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.730408  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.722265  9000 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:22:54.737874  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 201145us
W20260709 12:22:54.747839  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48989.5us
I20260709 12:22:54.739622  8889 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.710271  8923 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.753369  3964 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:54.753285  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:54.764488  3964 leader_election.cc:403] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:54.765864  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:54.760416  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:54.722596  8931 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:54.744143  9000 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:54.734284  9114 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:22:54.768217  8996 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.749071  9033 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:54.749825  9161 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:54.765076  8889 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:54.732945  8874 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:54.782819  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61544.9us
I20260709 12:22:54.767328  9152 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:22:54.789258  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:54.834990  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45840.1us
I20260709 12:22:54.836149  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:54.849607  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:54.853515  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:54.855816  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:54.865470  9159 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
W20260709 12:22:54.865682  9154 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:22:54.734652  8974 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.870645  8931 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.867791  8948 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:54.911810  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 804) took 1417 ms. Trace:
I20260709 12:22:54.893993  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3116) took 1222 ms. Trace:
I20260709 12:22:54.913084  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.942780  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3109) took 1296 ms. Trace:
I20260709 12:22:54.942692  3924 rpcz_store.cc:276] 0709 12:22:53.671862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.926978 (+255116us) service_pool.cc:224] Handling call
0709 12:22:53.978163 (+ 51185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.009502 (+ 31339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.009547 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:54.010047 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.433584 (+423537us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:54.433689 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.433827 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.893686 (+459859us) raft_consensus.cc:1685] finished
0709 12:22:54.893714 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.893923 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1237,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13816,"thread_start_us":397611,"threads_started":1,"wal-append.queue_time_us":856371}
I20260709 12:22:54.871495  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3114) took 1200 ms. Trace:
I20260709 12:22:54.872304  3849 raft_consensus.cc:2393] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:54.941972  4581 rpcz_store.cc:276] 0709 12:22:53.494388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.494628 (+   240us) service_pool.cc:224] Handling call
0709 12:22:53.494929 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.951262 (+456333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.951314 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.951376 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:53.951436 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.911558 (+960122us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54005c03d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:54.911605 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.911738 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048800000}
I20260709 12:22:54.945726  3917 rpcz_store.cc:276] 0709 12:22:53.671295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.880426 (+209131us) service_pool.cc:224] Handling call
0709 12:22:53.880779 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:53.881207 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.881235 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:53.949783 (+ 68548us) log.cc:844] Serialized 78 byte log entry
0709 12:22:54.373763 (+423980us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:54.675915 (+302152us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.721479 (+ 45564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.721593 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.871207 (+149614us) raft_consensus.cc:1685] finished
0709 12:22:54.871232 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.871408 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1330,"prepare.queue_time_us":396801,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":36608,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":31087,"thread_start_us":583602,"threads_started":2,"wal-append.queue_time_us":661239}
I20260709 12:22:54.951105  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.793051  9161 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:54.983773  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 128057us
I20260709 12:22:54.998867  9161 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.000101  3889 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:55.001704  9171 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:55.002450  9171 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:55.003017  9171 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.006472  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:54.943598  3919 rpcz_store.cc:276] 0709 12:22:53.646024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.647601 (+  1577us) service_pool.cc:224] Handling call
0709 12:22:53.647998 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.648556 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.648594 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.649192 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.564483 (+915291us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:54.564549 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.564656 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.942487 (+377831us) raft_consensus.cc:1685] finished
0709 12:22:54.942511 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.942694 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5077,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8811,"thread_start_us":883653,"threads_started":1,"wal-append.queue_time_us":1185870}
I20260709 12:22:54.985077  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.008122  3846 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:22:54.852174  8941 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:54.881338  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78564.1us
I20260709 12:22:54.890302  8592 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:54.893628  9167 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:54.904711  8923 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.994729  8999 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:54.887351  9157 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:22:54.834568  9033 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.009285  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:54.858678  8929 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:54.902263  9064 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:54.888701  9175 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:54.906143  8912 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:54.859839  8966 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:54.887182  9180 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
W20260709 12:22:54.889848  9163 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:22:54.814450  8996 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:54.988310  8990 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.007s
I20260709 12:22:54.905015  9000 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.020874  8874 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:54.871286  8940 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:54.918521  8864 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:54.904325  9043 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:55.030951  8931 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.039455  9158 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:55.048409  9031 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 12:22:55.044198  8912 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:55.056318  8929 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:55.050637  9175 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.102324  8996 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.102682  8987 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.103951  8987 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.104076  9033 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:55.104182  9126 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.061625  8990 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.110298  8990 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.109759  8929 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.103322  9175 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.122826  9124 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.214219  9124 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:55.215642  9124 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:55.164460  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 387355us
I20260709 12:22:55.169796  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.039611  3846 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:55.136488  9161 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:55.248309  4580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 800) took 1761 ms (client timeout 1916 ms). Trace:
I20260709 12:22:55.248816  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:55.248890  4580 rpcz_store.cc:269] 0709 12:22:53.486315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.487234 (+   919us) service_pool.cc:224] Handling call
0709 12:22:55.247804 (+1760570us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540046c3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.248010 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105523456}
W20260709 12:22:55.174480  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 413969us
I20260709 12:22:55.180326  3920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3117) took 1508 ms. Trace:
I20260709 12:22:55.250362  9161 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:55.250633  3920 rpcz_store.cc:276] 0709 12:22:53.674055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.950652 (+276597us) service_pool.cc:224] Handling call
0709 12:22:54.010321 (+ 59669us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:54.010712 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.010742 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:54.024971 (+ 14229us) log.cc:844] Serialized 52 byte log entry
0709 12:22:54.397112 (+372141us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:54.720398 (+323286us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.750773 (+ 30375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.750895 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.179623 (+428728us) raft_consensus.cc:1685] finished
0709 12:22:55.179665 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.180026 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165575,"prepare.queue_time_us":463323,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":32490,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":39875,"thread_start_us":509697,"threads_started":2,"wal-append.queue_time_us":609843}
W20260709 12:22:55.038368  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 272559us
I20260709 12:22:55.254364  3843 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:55.196231  8864 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:55.197897  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.256556  3843 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.256702  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.257722  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.258968  3998 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:22:55.203522  3993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:55.259491  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.210028  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.261572  8903 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:55.262054  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.125927  9130 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:55.211529  3847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2449) took 2740 ms (client timeout 1916 ms). Trace:
W20260709 12:22:55.198930  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 383831us
I20260709 12:22:55.228724  9127 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.240906  9037 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.006s
I20260709 12:22:55.241362  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.242023  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.244055  3922 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.264067  3843 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:55.246234  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.246675  3924 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:55.250198  3846 raft_consensus.cc:2410] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:55.257980  3996 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:55.202788  8592 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:55.259804  3993 raft_consensus.cc:606] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:55.095882  8912 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.262358  8903 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:55.232733  8529 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:55.230993  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.263325  3994 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.266811  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.268334  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:55.263715  3847 rpcz_store.cc:269] 0709 12:22:52.470465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.644969 (+174504us) service_pool.cc:224] Handling call
0709 12:22:55.210941 (+2565972us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002ab554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.211230 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2818902400}
I20260709 12:22:55.270304  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.245160  9171 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.270268  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.277878  3993 raft_consensus.cc:614] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:55.284778  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.284968  3919 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:22:55.286123  4580 raft_consensus.cc:2393] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:55.244714  9124 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.291644  4576 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 6.
I20260709 12:22:55.292011  3916 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:55.292271  3917 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:22:55.272712  8592 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:55.293234  3992 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.288801  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.294862  8592 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.297290  8592 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.299784  9127 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.276286  8864 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.293304  3990 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:55.309603  8864 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.323769  8759 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.324877  9059 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.324834  8759 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.323815  3918 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:55.327865  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.329013  3995 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:55.330732  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.333225  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.341949  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.292029  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.278071  9037 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.356163  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.353103  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:55.368891  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 362339us
I20260709 12:22:55.370431  8529 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.371757  8529 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.372291  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.373457  4578 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:55.377033  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.377978  4576 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:55.377053  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.379522  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:55.380149  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 67786us
I20260709 12:22:55.380352  4583 raft_consensus.cc:2376] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
W20260709 12:22:55.386679  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.388749  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.390648  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.392059  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.395717  3917 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:55.400300  4548 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.401757  9142 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:55.402259  9142 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.402673  9142 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.405727  9175 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:55.408262  3888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.65:37307 timed out after 1.916s (SENT) [suppressed 37 similar messages]
I20260709 12:22:55.410086  3848 pending_rounds.cc:85] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 9
I20260709 12:22:55.410573  3848 pending_rounds.cc:107] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:22:55.410835  4580 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:55.411796  9127 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:55.410928  3848 raft_consensus.cc:2889] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.415940  3842 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:55.420068  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49794.1us
I20260709 12:22:55.420205  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.410910  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.430137  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.402254  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:55.436234  3995 raft_consensus.cc:2376] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11. Re-sending same reply.
I20260709 12:22:55.441236  3990 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:22:55.419507  9171 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.487061  8987 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.487527  9171 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:55.491660  4582 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:55.496718  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:55.446125  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 3124) took 1337 ms (client timeout 1602 ms). Trace:
I20260709 12:22:55.447636  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.450395  9203 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:55.506410  9203 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:55.506559  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.453055  8435 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:55.508229  8435 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:55.508744  8435 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:55.509920  8435 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:55.510836  8889 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.018s
I20260709 12:22:55.511734  8435 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.513201  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.514459  3995 raft_consensus.cc:2410] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:55.516732  9142 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.453233  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:55.465284  8950 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:55.467983  8529 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.469724  9037 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:55.470441  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68352.6us
I20260709 12:22:55.472137  3996 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:22:55.471647  8903 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.472769  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.483750  8759 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.505733  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.506955  9203 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.511535  8889 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.511718  9134 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.459656  3843 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:55.528790  8950 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:22:55.523756  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76434us
I20260709 12:22:55.456131  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:55.498698  3925 rpcz_store.cc:269] 0709 12:22:54.108418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.108599 (+   181us) service_pool.cc:224] Handling call
0709 12:22:55.445663 (+1337064us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54002445d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.445877 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340111616}
I20260709 12:22:55.538647  4578 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:22:55.540256  3992 raft_consensus.cc:2410] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:55.541435  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:22:55.528228  3917 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:22:55.536325  3842 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:22:55.546691  9204 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:55.547242  9204 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:55.547735  9204 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.549852  8987 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.550915  8903 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.554909  9128 consensus_queue.cc:1048] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:55.555626  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:55.556638  8950 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.558077  8950 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.558707  8889 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.559667  9171 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:55.564124  3998 raft_consensus.cc:2410] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:55.565708  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.566491  3843 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.573345  8864 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.578323  3990 raft_consensus.cc:606] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:55.583884  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 135265us
I20260709 12:22:55.593289  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.581156  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.595496  4577 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:55.593645  3991 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:22:55.601513  3842 raft_consensus.cc:2410] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:22:55.547498  9000 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:55.606707  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 153718us
I20260709 12:22:55.580631  9134 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.610622  3994 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:55.612195  9134 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:55.614409  9125 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.890s	user 0.014s	sys 0.007s
I20260709 12:22:55.598640  8529 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.627362  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1177) took 1507 ms. Trace:
I20260709 12:22:55.627744  8592 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:55.628640  8529 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.629207  8529 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.631690  8912 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:55.634497  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.634999  8912 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.635592  3844 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:55.635787  3993 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:55.637953  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3263) took 1162 ms. Trace:
I20260709 12:22:55.638315  3844 rpcz_store.cc:276] 0709 12:22:54.475365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.698871 (+223506us) service_pool.cc:224] Handling call
0709 12:22:55.635203 (+936332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.636020 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.637679 (+  1659us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400118fd0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.637860 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117058304}
I20260709 12:22:55.642709  3917 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:55.649000  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49078us
I20260709 12:22:55.650352  9131 consensus_queue.cc:1059] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:55.652225  3847 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 14. Ops: []
I20260709 12:22:55.614511  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:55.655115  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.657135  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.658560  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.661377  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.662139  4580 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.631117  3850 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:22:55.635047  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.602933  9142 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.658877  3841 consensus_queue.cc:260] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.671880  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.670480  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.670173  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 805) took 1280 ms. Trace:
I20260709 12:22:55.627913  3849 rpcz_store.cc:276] 0709 12:22:54.119480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.119642 (+   162us) service_pool.cc:224] Handling call
0709 12:22:55.626858 (+1507216us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b5400118fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.627113 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636933504}
I20260709 12:22:55.675638  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.676376  4578 raft_consensus.cc:1240] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:55.676407  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.676819  8581 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:55.677912  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.679308  3919 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
W20260709 12:22:55.670302  9211 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:55.670184  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.691695  3924 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.679335  4582 rpcz_store.cc:276] 0709 12:22:54.389631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.389827 (+   196us) service_pool.cc:224] Handling call
0709 12:22:54.404598 (+ 14771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.492406 (+1087808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.669855 (+177449us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004b6c54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:55.670075 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335183744}
I20260709 12:22:55.690078  4574 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:55.628597  8592 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.670650  9131 raft_consensus.cc:3055] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:55.693604  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.697739  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.698825  4577 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.700644  4548 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:55.704931  4546 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.635725  9125 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.706506  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.710649  3847 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:55.698057  8592 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:55.698377  9131 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:55.711205  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:22:55.737043  3841 raft_consensus.cc:3060] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.737157  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.738269  3850 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10.
I20260709 12:22:55.739604  9205 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:55.740160  9205 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.740222  3919 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:55.740679  9205 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:55.741653  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.744067  4580 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:55.739302  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:55.747844  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.749106  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.749253  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.750269  3916 raft_consensus.cc:2410] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:55.752475  9125 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:55.753670  3999 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:55.753494  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.754557  3925 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:22:55.754657  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.755893  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.756181  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.757143  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.758463  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.759719  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.759955  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.760874  3923 raft_consensus.cc:2410] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:22:55.761854  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.762777  3923 raft_consensus.cc:2410] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:22:55.757170  3919 raft_consensus.cc:2410] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:22:55.748991  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.759131  3921 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:55.765928  3843 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:55.775547  3924 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:55.779253  3847 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:55.779726  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.778491  3850 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.774425  8581 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.727710  8864 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:22:55.795118  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 81593.9us
I20260709 12:22:55.797663  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.799502  3843 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:22:55.799428  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.801405  8749 raft_consensus.cc:2804] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:55.802316  8749 raft_consensus.cc:697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:55.803859  8749 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:55.806674  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.807483  8903 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:22:55.826740  9203 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.827275  8903 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:55.827908  8903 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:55.828889  8903 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.829577  9203 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.830370  8903 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:55.817306  3916 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:22:55.817695  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:55.807435  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.821604  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.820652  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.839066  4577 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:22:55.847914  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.848618  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.848896  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.849457  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.850368  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.851810  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.852658  3923 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:22:55.849594  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.855042  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.855834  3919 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:55.855986  8961 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:55.856405  8961 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.856576  8842 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:55.856781  8961 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.857012  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.856614  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.857872  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.858631  3919 raft_consensus.cc:2368] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:55.858512  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:55.857118  8842 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.857978  9000 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:55.859542  8842 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.859836  9000 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:55.860590  9000 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:55.860836  8759 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:55.861303  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.861488  8759 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:55.773998  9204 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.862685  8759 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.864631  9204 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.815884  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:55.866649  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50879.5us
I20260709 12:22:55.867568  3890 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:55.869140  8435 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:55.869390  3890 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:55.869976  8435 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:55.870546  3890 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:55.816417  9172 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:55.871482  9171 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:55.872150  9171 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.872663  9171 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.872205  9172 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.873039  3843 pending_rounds.cc:85] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 6
I20260709 12:22:55.873425  3843 pending_rounds.cc:107] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:22:55.873703  3843 raft_consensus.cc:2889] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.873766  3918 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:55.874830  9172 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:55.875699  3924 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:55.876396  3919 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:55.876878  3924 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:55.878044  3814 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.540s (SENT)
W20260709 12:22:55.878647  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 79847.2us
W20260709 12:22:55.879117  3814 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.552s (SENT)
I20260709 12:22:55.884027  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:55.884291  8864 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:55.884863  8864 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:55.886222  3814 leader_election.cc:336] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.662s (SENT)
I20260709 12:22:55.886725  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:55.875180  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.811887  9131 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.882395  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:55.871316  8435 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:55.887667  8889 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:22:55.887971  9197 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:55.889626  9131 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.898720  9203 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:55.899120  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 345157us
I20260709 12:22:55.888465  3918 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:55.901381  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.902948  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.904281  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.904415  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.905162  3991 raft_consensus.cc:2376] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8. Re-sending same reply.
I20260709 12:22:55.905303  3994 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:22:55.887395  8842 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.906279  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.906950  3994 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:22:55.907357  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.908146  3992 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:55.909158  3918 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:55.909592  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.910181  3995 raft_consensus.cc:3060] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:55.892580  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.911922  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:22:55.912494  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.912637  3990 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 18.
I20260709 12:22:55.893743  8435 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.913743  8435 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:55.914103  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.914222  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.912412  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.914831  3994 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:55.915819  4577 raft_consensus.cc:2410] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:22:55.909196  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.893993  8987 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:55.916898  3998 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 9: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:55.917122  8987 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:55.917904  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.918179  8987 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:55.918596  8987 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:55.911801  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.919850  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.894551  9006 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:55.920769  8987 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:55.921566  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.922360  8987 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.890163  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3234) took 1137 ms. Trace:
I20260709 12:22:55.913304  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:55.923168  3999 rpcz_store.cc:276] 0709 12:22:54.752840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.753001 (+   161us) service_pool.cc:224] Handling call
0709 12:22:55.889823 (+1136822us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400198cd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:55.890061 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273149312}
I20260709 12:22:55.914845  4582 raft_consensus.cc:2368] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:55.858474  3841 raft_consensus.cc:1275] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:22:55.853673  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.860718  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.893834  3888 leader_election.cc:400] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10.
I20260709 12:22:55.926554  3888 leader_election.cc:403] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.850791  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:55.924762  3841 pending_rounds.cc:85] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 5
I20260709 12:22:55.889984  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.928300  3841 pending_rounds.cc:107] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:55.918638  3998 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:22:55.928686  3841 raft_consensus.cc:2889] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.887143  8864 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.911801  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.832665  8581 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.908339  8842 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:55.952715  3916 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 19: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:55.952785  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59167us
I20260709 12:22:55.942739  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1176) took 1822 ms. Trace:
W20260709 12:22:55.948992  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.956482  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.953579  3841 rpcz_store.cc:276] 0709 12:22:54.118217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.118389 (+   172us) service_pool.cc:224] Handling call
0709 12:22:54.118818 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.690010 (+571192us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54000bf020. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296adc0 00007fdc529f51c0 00007fdc529f6231 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c
0709 12:22:55.658165 (+968155us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b54000bf020. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5297106f 00007fdc529e9f60 00007fdc529eb7de 00007fdc529f5b49 00007fdc529f6416 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62
0709 12:22:55.933417 (+275252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.937685 (+  4268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109710976}
I20260709 12:22:55.959704  3923 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:55.949908  3921 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 9.
I20260709 12:22:55.953661  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.963515  4582 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 14. Ops: [12.11-12.11]
I20260709 12:22:55.963927  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.965891  3918 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.976325  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:55.979354  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.980166  3923 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:55.962988  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:55.980958  3921 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:55.981926  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 95735.1us
I20260709 12:22:55.950780  3994 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:55.981060  3920 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:22:55.985595  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:55.985718  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.988204  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.985235  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.988921  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:55.989629  3916 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:55.990478  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:55.938110  8592 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:55.995708  3994 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:22:55.998142  9145 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:22:55.999651  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:56.003376  3995 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:22:56.006242  3916 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:56.010584  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:56.011402  3845 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:22:56.012367  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:56.012593  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:56.013039  3841 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:22:56.013360  3845 raft_consensus.cc:2368] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:56.013978  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:56.014369  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.978168  9203 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10.
I20260709 12:22:56.015317  3845 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:56.015825  3999 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:22:56.031356  3814 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.701s (SENT)
I20260709 12:22:56.017584  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:56.020231  3922 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:56.015365  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:55.991649  9204 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:56.033821  9181 consensus_queue.cc:1048] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:56.036296  8592 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:56.040078  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:56.032887  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:55.995319  8864 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.041760  3918 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:56.050666  4580 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:56.054659  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.055964  3998 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:22:55.991520  8950 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:56.051978  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64082.4us
I20260709 12:22:56.059854  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:56.060113  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:56.080636  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:56.039168  8529 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.084693  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.082355  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.057054  8864 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.063728  9125 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.123432  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:56.125265  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:56.126541  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:56.128786  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60588.5us
I20260709 12:22:56.033452  8435 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.149057  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:56.149564  3847 raft_consensus.cc:2368] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:56.086414  3999 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
W20260709 12:22:56.147415  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.077400  9124 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:56.152643  3962 leader_election.cc:400] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:56.153088  3962 leader_election.cc:403] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.157872  3990 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 10.
W20260709 12:22:56.159126  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 160223us
W20260709 12:22:56.160840  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 155610us
I20260709 12:22:56.084511  9195 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.124305  8864 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.167115  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:56.147853  9134 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:56.168123  3999 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:56.176100  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 91880.4us
I20260709 12:22:56.152751  9124 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.170387  4547 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:56.082273  8592 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:22:56.181823  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:56.128490  9125 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.147830  8950 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.195585  3846 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:56.225023  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48179.2us
W20260709 12:22:56.226583  3814 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.702s (SENT)
I20260709 12:22:56.227226  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:56.177191  9134 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:56.184104  9124 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:56.178972  8912 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:56.181862  9186 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:56.238237  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72698.5us
W20260709 12:22:56.244974  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 166130us
I20260709 12:22:56.189692  9175 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:56.167037  9205 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.253648  3846 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:56.243176  9134 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:56.243376  8889 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:56.264377  3921 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:56.280457  3925 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:56.281461  3850 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:22:56.256383  8581 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:56.294047  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 98105.9us
I20260709 12:22:56.288178  9126 raft_consensus.cc:2764] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:22:56.301324  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:56.301044  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:56.316270  3922 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:56.366753  3814 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.783s (SENT)
I20260709 12:22:56.353017  8581 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:56.361269  8435 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:56.391613  8435 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:56.392066  8435 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:56.392484  8435 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:56.394595  9004 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:56.395578  9213 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:22:56.398713  9125 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:56.376183  8529 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:56.410621  9205 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:56.410621  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.402550  9215 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.325s	user 0.002s	sys 0.006s
I20260709 12:22:56.448045  3999 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:56.452934  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.454016  3999 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:22:56.449473  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 454401us
W20260709 12:22:56.464655  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.416108  9000 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.004s
W20260709 12:22:56.488117  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 191328us
W20260709 12:22:56.489833  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 448980us
W20260709 12:22:56.517585  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 154627us
I20260709 12:22:56.523872  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:56.535598  9217 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.210s	user 0.003s	sys 0.001s
W20260709 12:22:56.536298  9219 log.cc:927] Time spent T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:22:56.540323  3814 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.865s (SENT)
I20260709 12:22:56.540915  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:56.485035  9059 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.551627  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.551038  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2467) took 1591 ms. Trace:
W20260709 12:22:56.553311  3997 consensus_meta.cc:287] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 12:22:56.640702  3997 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:56.514413  9126 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:56.530361  9171 consensus_meta.cc:287] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.004s
I20260709 12:22:56.515858  8950 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:56.484761  9000 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.517546  9204 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:56.567708  8435 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.560343  9004 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:56.569557  9134 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.558404  9059 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:56.572968  3814 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.932s (SENT)
I20260709 12:22:56.654646  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:22:56.573535  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49802us
I20260709 12:22:56.657315  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:56.591681  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.594514  9220 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:22:56.548660  9145 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:56.650617  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:22:56.662600  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 532863us
I20260709 12:22:56.664518  3997 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:56.640090  3848 rpcz_store.cc:276] 0709 12:22:54.959782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.408905 (+449123us) service_pool.cc:224] Handling call
0709 12:22:55.409519 (+   614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.470508 (+ 60989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.470547 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.471302 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.687364 (+216062us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:55.687533 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.687622 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.401926 (+714304us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:22:56.541886 (+139960us) raft_consensus.cc:1685] finished
0709 12:22:56.541905 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.550957 (+  9052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5779840,"thread_start_us":196796,"threads_started":1,"wal-append.queue_time_us":486101}
I20260709 12:22:56.674760  8435 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:56.679700  3889 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.885s (SENT)
I20260709 12:22:56.681156  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:56.676345  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:56.690878  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:56.698948  4574 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:56.703574  3841 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:56.675024  9195 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:56.707705  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:56.648761  9171 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.675717  8842 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:56.708659  9004 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:56.671991  8592 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:22:56.719401  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1185) took 1548 ms. Trace:
I20260709 12:22:56.660924  9126 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.721374  3962 leader_election.cc:400] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:56.745718  9000 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:56.746801  8759 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:56.748262  9171 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:56.749099  8961 consensus_meta.cc:287] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.006s
I20260709 12:22:56.749966  9134 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:56.752849  4546 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:56.798285  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 106460us
I20260709 12:22:56.796904  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:56.801765  3991 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:56.757953  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 75397.1us
I20260709 12:22:56.693300  9186 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:56.717213  8987 consensus_meta.cc:287] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.794s	user 0.016s	sys 0.000s
I20260709 12:22:56.759229  3844 rpcz_store.cc:276] 0709 12:22:55.179345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.639319 (+459974us) service_pool.cc:224] Handling call
0709 12:22:55.667068 (+ 27749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.677765 (+ 10697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.677796 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.678359 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.186831 (+508472us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:56.186886 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.186952 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.719163 (+532211us) raft_consensus.cc:1685] finished
0709 12:22:56.719187 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.719331 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":468238,"threads_started":1,"wal-append.queue_time_us":610531}
I20260709 12:22:56.762282  3962 leader_election.cc:403] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.768290  3845 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18. Ops: []
W20260709 12:22:56.759263  9216 log.cc:927] Time spent T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:22:56.766952  8759 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:22:56.809839  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 236905us
I20260709 12:22:56.719568  9145 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:22:56.818776  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:56.805217  3890 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:56.829833  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.809245  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:56.805572  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.027s
I20260709 12:22:56.797523  8529 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:56.810220  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:56.861591  3849 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:56.804389  9004 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.871728  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 66603.1us
W20260709 12:22:56.840941  9228 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:22:56.876405  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 177348us
I20260709 12:22:56.881469  3999 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:56.840546  8759 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:56.883433  3993 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:22:56.865931  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:56.884739  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:56.888921  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:56.782641  8961 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:56.886325  3814 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.942s (SENT)
W20260709 12:22:56.889829  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90618.5us
I20260709 12:22:56.889513  4580 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:56.889565  4575 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:56.890494  9206 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.401s	user 0.002s	sys 0.008s
I20260709 12:22:56.890702  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:56.889335  3844 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:56.893777  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:56.855384  8889 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:56.873275  9004 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:56.877401  8592 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:56.918161  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.919129  3999 raft_consensus.cc:2376] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14. Re-sending same reply.
I20260709 12:22:56.921648  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:56.922663  4582 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:56.885715  8529 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:56.940835  8529 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:56.928200  3845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3270) took 1114 ms. Trace:
I20260709 12:22:56.946281  3845 rpcz_store.cc:276] 0709 12:22:55.813584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.164315 (+350731us) service_pool.cc:224] Handling call
0709 12:22:56.765480 (+601165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.838204 (+ 72724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.928005 (+ 89801us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540008d9d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:56.928139 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335709952}
I20260709 12:22:56.947741  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:56.949213  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:56.949880  9230 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:22:56.929963  8720 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:22:56.930374  9225 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
W20260709 12:22:56.930698  9232 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:22:56.957738  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57642.2us
I20260709 12:22:56.931110  9006 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:56.931825  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 261845us
I20260709 12:22:56.958607  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:22:56.932122  9221 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:22:56.932868  9226 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:22:56.890704  3746 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 13, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.935432  3991 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:56.801401  9204 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:56.898589  9172 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:56.947854  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1331) took 1281 ms. Trace:
I20260709 12:22:56.929540  9235 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:56.951545  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3266) took 1139 ms. Trace:
I20260709 12:22:56.973318  4574 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:22:56.974725  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53722.1us
W20260709 12:22:56.975912  3889 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.958s (SENT)
I20260709 12:22:56.976598  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:56.976706  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:56.955077  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45187.9us
I20260709 12:22:56.983844  3991 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:56.985704  3849 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:22:56.973381  3843 rpcz_store.cc:276] 0709 12:22:55.812576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.872360 (+ 59784us) service_pool.cc:224] Handling call
0709 12:22:55.872786 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.874507 (+  1721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.874538 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:55.875128 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.352702 (+477574us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:56.352746 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.352818 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.951308 (+598490us) raft_consensus.cc:1685] finished
0709 12:22:56.951325 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.951484 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9244,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":446014,"threads_started":1,"wal-append.queue_time_us":838979}
I20260709 12:22:56.972123  3917 rpcz_store.cc:276] 0709 12:22:55.666781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.679869 (+ 13088us) service_pool.cc:224] Handling call
0709 12:22:55.690316 (+ 10447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.707947 (+ 17631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.708001 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.747038 (+ 39037us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.288765 (+541727us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:56.288809 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.288879 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.947632 (+658753us) raft_consensus.cc:1685] finished
0709 12:22:56.947650 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.947795 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5038,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":18526,"thread_start_us":493637,"threads_started":1,"wal-append.queue_time_us":1103513}
I20260709 12:22:56.993813  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 732) took 1078 ms. Trace:
I20260709 12:22:56.931834  9059 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.002341  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:56.988042  9247 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:22:57.005035  9172 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:57.005467  3746 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:57.006019  9251 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:56.965652  9240 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:57.043795  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 817) took 1021 ms. Trace:
W20260709 12:22:57.047639  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47292.7us
I20260709 12:22:56.998733  3996 rpcz_store.cc:276] 0709 12:22:55.906767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.922486 (+ 15719us) service_pool.cc:224] Handling call
0709 12:22:55.922854 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.923316 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.923341 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.955948 (+ 32607us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.546566 (+590618us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:56.546626 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.546720 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.970793 (+424073us) raft_consensus.cc:1685] finished
0709 12:22:56.970856 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.985505 (+ 14649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2748,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12751,"thread_start_us":481045,"threads_started":1,"wal-append.queue_time_us":799079}
I20260709 12:22:57.049683  4582 rpcz_store.cc:276] 0709 12:22:55.991860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.991985 (+   125us) service_pool.cc:224] Handling call
0709 12:22:57.013024 (+1021039us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54005e01d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:22:57.013242 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046572416}
I20260709 12:22:56.984675  9235 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:56.987811  9203 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:57.017521  3964 connection.cc:256] RPC call timeout handler was delayed by -1.4293132190000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:22:57.063134  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3663132189999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:22:57.063808  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3663132189999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:22:57.064482  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3600132189999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:22:57.065793  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3384132189999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:22:57.066895  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3384132189999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:22:57.070509  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3375132189999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:22:57.071368  3964 connection.cc:256] RPC call timeout handler was delayed by -1.3339132189998963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 12:22:57.071882  3964 connection.cc:256] RPC call timeout handler was delayed by -1.1719132190000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:22:57.074203  3964 connection.cc:256] RPC call timeout handler was delayed by -1.0414132189998782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:22:56.970681  8592 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:57.076175  3746 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 16, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:57.018687  8864 consensus_meta.cc:287] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.001s
I20260709 12:22:57.083467  3888 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:57.091857  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 215174us
W20260709 12:22:57.092905  3814 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.951s (SENT)
I20260709 12:22:57.093437  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:57.094667  9248 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:57.096568  9237 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:57.097330  9237 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:57.099624  9234 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
W20260709 12:22:57.102162  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 125864us
I20260709 12:22:57.103086  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:57.103593  9203 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:57.104486  8435 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:57.105046  8435 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:57.104688  9203 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.105257  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:57.105914  8435 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.106640  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.109074  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 731) took 1202 ms. Trace:
I20260709 12:22:57.109462  3992 rpcz_store.cc:276] 0709 12:22:55.906489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.922310 (+ 15821us) service_pool.cc:224] Handling call
0709 12:22:55.922599 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.922871 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.922898 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.924353 (+  1455us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.448931 (+524578us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:56.783317 (+334386us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.829875 (+ 46558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.829992 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.010562 (+180570us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b180045bd40. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:57.108726 (+ 98164us) raft_consensus.cc:1685] finished
0709 12:22:57.108837 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.108999 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10211,"prepare.queue_time_us":84188,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":40088,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":173,"spinlock_wait_cycles":10658560,"thread_start_us":740510,"threads_started":2,"wal-append.queue_time_us":887898}
I20260709 12:22:57.111604  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2468) took 2128 ms. Trace:
W20260709 12:22:57.113718  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 137874us
I20260709 12:22:57.112031  3842 rpcz_store.cc:276] 0709 12:22:54.982874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.605697 (+622823us) service_pool.cc:224] Handling call
0709 12:22:55.644204 (+ 38507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.644801 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.644826 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.645409 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:22:55.952381 (+306972us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:55.952427 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.952515 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.415525 (+463010us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b24001261e8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f94509d 00007fdc5257710e 00007fdc5258e88c 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221
0709 12:22:57.107996 (+692471us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b2400126308. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f944fb0 00007fdc525bb488 00007fdc525bbbe8 00007fdc52593398 00007fdc5258e76a 00007fdc5258dbb6
0709 12:22:57.111327 (+  3331us) raft_consensus.cc:1685] finished
0709 12:22:57.111348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.111539 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15965,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":92077952,"thread_start_us":295739,"threads_started":1,"wal-append.queue_time_us":601843}
I20260709 12:22:57.073287  8720 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.119396  4575 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:57.102197  9126 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:57.123183  8987 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.085297  3746 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 11 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:56.996469  9186 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:57.118014  9124 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.003s
I20260709 12:22:57.120627  9125 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:57.129632  9142 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:57.139408  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.140079  9142 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:57.140566  9142 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:57.146339  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3241) took 1106 ms. Trace:
I20260709 12:22:57.146808  3994 rpcz_store.cc:276] 0709 12:22:56.039871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.056008 (+ 16137us) service_pool.cc:224] Handling call
0709 12:22:56.080130 (+ 24122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.679738 (+599608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.679770 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.699985 (+ 20215us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.873530 (+173545us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.873569 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.873644 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.146110 (+272466us) raft_consensus.cc:1685] finished
0709 12:22:57.146130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.146276 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5494,"raft.queue_time_us":102675,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13890,"thread_start_us":615854,"threads_started":2,"wal-append.queue_time_us":425486}
W20260709 12:22:57.148327  9253 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 12:22:57.139487  9125 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:57.149778  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.150419  9184 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.150600  9125 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.151003  9184 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:57.151562  9184 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.154716  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2481) took 1305 ms. Trace:
W20260709 12:22:57.155074  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48517us
I20260709 12:22:57.147621  8581 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:22:57.156359  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.155153  3850 rpcz_store.cc:276] 0709 12:22:55.848888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.285652 (+436764us) service_pool.cc:224] Handling call
0709 12:22:56.286128 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.301499 (+ 15371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.301535 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.352336 (+ 50801us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.804027 (+451691us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.804098 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.804201 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.154465 (+350264us) raft_consensus.cc:1685] finished
0709 12:22:57.154493 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.154652 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10805,"raft.queue_time_us":64580,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":398955,"threads_started":1,"wal-append.queue_time_us":519040}
I20260709 12:22:57.178361  3746 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 14, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.124850  9131 raft_consensus.cc:2764] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:22:57.192781  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:57.202540  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:57.203662  3850 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.115003  8864 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.209465  3841 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:22:57.214236  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 86247.7us
I20260709 12:22:57.154767  8961 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:57.225054  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135205us
I20260709 12:22:57.199258  9134 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:57.201043  8912 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.128088  8720 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.120790  8889 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.157836  9124 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:57.254020  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52174.1us
I20260709 12:22:57.253449  3746 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.229264  9237 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.254968  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.201889  8581 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.257208  3746 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 16, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.265746  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:22:57.234851  9134 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:57.253921  8912 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.281822  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3248) took 1042 ms. Trace:
W20260709 12:22:57.270886  9249 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:22:57.222209  9126 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:22:57.287168  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1200) took 1045 ms. Trace:
I20260709 12:22:57.272785  8581 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.283957  3997 rpcz_store.cc:276] 0709 12:22:56.239070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.684859 (+445789us) service_pool.cc:224] Handling call
0709 12:22:56.709364 (+ 24505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.716683 (+  7319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.716718 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.766866 (+ 50148us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.920819 (+153953us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:56.920901 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.921030 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.281560 (+360530us) raft_consensus.cc:1685] finished
0709 12:22:57.281580 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.281747 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6982,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":84878,"threads_started":1,"wal-append.queue_time_us":421955}
I20260709 12:22:57.270253  9241 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.279601  9242 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.295042  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3244) took 1146 ms. Trace:
I20260709 12:22:57.200096  9172 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:57.280557  9258 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:57.229005  8592 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.269346  8529 raft_consensus.cc:2764] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:57.327838  3746 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 18, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.282724  9134 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:57.323308  3998 rpcz_store.cc:276] 0709 12:22:56.148263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.148403 (+   140us) service_pool.cc:224] Handling call
0709 12:22:56.162635 (+ 14232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.184245 (+ 21610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.184297 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.251883 (+ 67586us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.670765 (+418882us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.670854 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.670997 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.287600 (+616603us) raft_consensus.cc:1685] finished
0709 12:22:57.287629 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.294970 (+  7341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7594,"raft.queue_time_us":108759,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7961,"thread_start_us":386602,"threads_started":1,"wal-append.queue_time_us":789608}
I20260709 12:22:57.296384  3846 rpcz_store.cc:276] 0709 12:22:56.241794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.452187 (+210393us) service_pool.cc:224] Handling call
0709 12:22:56.489309 (+ 37122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.676390 (+187081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.676435 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.677036 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.799495 (+122459us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:56.799569 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.969785 (+170216us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400343fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:56.969859 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.285248 (+315389us) raft_consensus.cc:1685] finished
0709 12:22:57.285280 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.287092 (+  1812us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7564,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":12900,"spinlock_wait_cycles":429179264,"thread_start_us":79008,"threads_started":1,"wal-append.queue_time_us":573001}
W20260709 12:22:57.341826  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 78425us
I20260709 12:22:57.344105  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3251) took 1050 ms. Trace:
I20260709 12:22:57.345245  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3250) took 1066 ms. Trace:
I20260709 12:22:57.344666  3746 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 14, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:57.254845  9004 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.344532  3995 rpcz_store.cc:276] 0709 12:22:56.289761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.934619 (+644858us) service_pool.cc:224] Handling call
0709 12:22:56.934977 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.935244 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.935277 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.935890 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:22:57.073045 (+137155us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:22:57.090460 (+ 17415us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.119720 (+ 29260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.119902 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.340046 (+220144us) raft_consensus.cc:1685] finished
0709 12:22:57.340072 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.340226 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63852,"prepare.queue_time_us":15517,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":33376,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":10960,"thread_start_us":136712,"threads_started":1,"wal-append.queue_time_us":251154}
I20260709 12:22:57.345669  3999 rpcz_store.cc:276] 0709 12:22:56.279166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.920082 (+640916us) service_pool.cc:224] Handling call
0709 12:22:56.964430 (+ 44348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.998295 (+ 33865us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:57.004599 (+  6304us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.343037 (+338438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.343187 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:57.343316 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.343604 (+   288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.345176 (+  1572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18771,"prepare.queue_time_us":8258,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"thread_start_us":313010,"threads_started":2,"wal-append.queue_time_us":246664}
W20260709 12:22:57.339186  9267 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:57.223729  9235 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:57.353456  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.339097  9175 consensus_meta.cc:287] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 1.081s	user 0.010s	sys 0.005s
I20260709 12:22:57.359954  9175 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:57.328780  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:57.323572  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69827us
I20260709 12:22:57.365922  3746 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 16, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:57.367779  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 138371us
I20260709 12:22:57.373211  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:57.374135  3919 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:57.377113  8864 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.373297  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:57.385052  3746 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:57.388443  3890 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:57.390326  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:57.394116  4578 raft_consensus.cc:2393] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 6: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:57.391937  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2485) took 1498 ms. Trace:
I20260709 12:22:57.393080  3746 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:22:57.402410  4580 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:57.404258  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:57.404932  4574 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:57.396700  3847 rpcz_store.cc:276] 0709 12:22:55.893137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.316501 (+423364us) service_pool.cc:224] Handling call
0709 12:22:56.362525 (+ 46024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.484395 (+121870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.484446 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.519434 (+ 34988us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.800211 (+280777us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.800268 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.927308 (+127040us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400408154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:56.927355 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.383801 (+456446us) raft_consensus.cc:1685] finished
0709 12:22:57.383821 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.391855 (+  8034us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41274,"raft.queue_time_us":44328,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":26794,"spinlock_wait_cycles":122471680,"thread_start_us":189628,"threads_started":1,"wal-append.queue_time_us":567923}
I20260709 12:22:57.329450  9241 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.418262  3920 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:57.418747  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:57.422667  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:57.423538  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:57.424546  3842 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:57.395939  8864 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:57.426962  3746 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 7 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.433990  3922 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:22:57.484135  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67064.6us
I20260709 12:22:57.344594  9242 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.469671  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:57.387861  8759 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.491024  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.492796  3916 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:22:57.493391  3844 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.581s	user 0.003s	sys 0.018s
I20260709 12:22:57.493741  3920 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:57.493891  3844 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:22:57.495108  3746 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:57.486392  8864 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:57.506731  3916 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:57.490321  9124 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:57.535643  3889 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.068s (SENT)
W20260709 12:22:57.552134  9278 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:22:57.553944  9257 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:22:57.564903  9271 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:22:57.566754  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54917.8us
W20260709 12:22:57.568207  3889 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.129s (SENT)
W20260709 12:22:57.569712  3889 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.196s (SENT)
I20260709 12:22:57.570137  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:57.608413  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.542117  8720 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.577000  9242 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:57.606863  9283 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:22:57.542232  8529 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:22:57.603565  9004 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:57.630851  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61147.7us
I20260709 12:22:57.642144  9237 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:57.686822  3919 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:22:57.622087  9142 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.692246  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3139) took 1781 ms. Trace:
I20260709 12:22:57.699123  9293 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:22:57.692862  3923 rpcz_store.cc:276] 0709 12:22:55.910924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.985968 (+ 75044us) service_pool.cc:224] Handling call
0709 12:22:56.005366 (+ 19398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:56.075581 (+ 70215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:56.513989 (+438408us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.829201 (+315212us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:56.881817 (+ 52616us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.882008 (+   191us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:56.882049 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.882127 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.691880 (+809753us) raft_consensus.cc:1685] finished
0709 12:22:57.691913 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.692151 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39630,"prepare.queue_time_us":185224,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":792,"raft.queue_time_us":291769,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":16315,"thread_start_us":594730,"threads_started":2,"wal-append.queue_time_us":802258}
I20260709 12:22:57.704682  9145 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:57.707345  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.707639  9251 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:57.707916  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:57.707419  9184 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.001s
I20260709 12:22:57.708352  9251 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.709045  9184 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.709663  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.710366  4582 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:57.710702  8987 consensus_meta.cc:287] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.012s
I20260709 12:22:57.710847  8929 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:57.640388  8864 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.711561  8929 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.712934  9184 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.713682  8929 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.693485  9241 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.714975  8759 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.715133  9250 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:57.715224  9004 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:22:57.704710  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 611829us
I20260709 12:22:57.717458  9134 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:57.718449  3814 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.984s (SENT)
I20260709 12:22:57.710922  9251 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:57.726903  9275 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:22:57.733542  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:57.734444  4575 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 8: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:22:57.717465  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:57.711213  8987 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:57.748507  3889 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.212s (SENT)
I20260709 12:22:57.749241  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2487) took 1049 ms. Trace:
W20260709 12:22:57.762125  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 126790us
I20260709 12:22:57.765137  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:57.761792  3848 rpcz_store.cc:276] 0709 12:22:56.699499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.710376 (+ 10877us) service_pool.cc:224] Handling call
0709 12:22:56.750827 (+ 40451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.751120 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:56.883834 (+132714us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.054395 (+170561us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.644689 (+590294us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b18000fa600. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287 00007fdc52a0e208
0709 12:22:57.693998 (+ 49309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.694043 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:57.694090 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.694150 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.749145 (+ 54995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627691,"prepare.queue_time_us":26457,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":2751,"raft.queue_time_us":650516,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":8137,"spinlock_wait_cycles":16334208,"thread_start_us":279675,"threads_started":2,"wal-append.queue_time_us":314840}
I20260709 12:22:57.751757  9251 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:57.771193  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49610.5us
I20260709 12:22:57.776578  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:22:57.778512  9274 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:57.768783  9235 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.781251  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.782218  9241 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:57.769744  8987 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:57.789342  8987 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:22:57.790333  8987 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.795994  9134 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.798713  8912 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:57.801110  3848 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:22:57.803413  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.806103  3841 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:22:57.809815  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.810412  3846 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:57.813076  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.820490  3888 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:57.836225  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.821835  9204 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.870357  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.833796  8720 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:57.838176  8592 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.883939  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:57.884317  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 58336us
I20260709 12:22:57.892318  8581 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:57.886091  3814 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.064s (SENT)
I20260709 12:22:57.894673  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:57.881224  9203 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:57.900056  9203 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:57.900517  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3253) took 1535 ms. Trace:
I20260709 12:22:57.900759  9203 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:57.901106  3993 rpcz_store.cc:276] 0709 12:22:56.365455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.956893 (+591438us) service_pool.cc:224] Handling call
0709 12:22:56.992132 (+ 35239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.999694 (+  7562us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:22:57.068529 (+ 68835us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.228900 (+160371us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.720900 (+492000us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800432940. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8d42a6 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1
0709 12:22:57.722977 (+  2077us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b1800432940. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:57.815046 (+ 92069us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b1800432940. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f906522 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:22:57.899904 (+ 84858us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800432940. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc529eb060 00007fdc529fd716 00007fdc52a0e287
0709 12:22:57.900020 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.900076 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:22:57.900143 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.900240 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.900437 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53424,"prepare.queue_time_us":69043,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":8535,"raft.queue_time_us":128852,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":66387,"spinlock_wait_cycles":99277568,"thread_start_us":187314,"threads_started":2,"wal-append.queue_time_us":169209}
I20260709 12:22:57.911755  8720 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:57.878154  9204 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.912868  8720 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.915602  9204 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.899145  9186 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:57.916397  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 91335.9us
W20260709 12:22:57.918980  9311 log.cc:927] Time spent T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:22:57.919456  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:57.919894  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:57.920143  3918 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:22:57.921244  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:57.921976  3922 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:57.921887  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:22:57.923301  3925 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:57.886644  8592 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.929217  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3249) took 1670 ms. Trace:
I20260709 12:22:57.930485  9281 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:57.931080  9281 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:57.929642  3990 rpcz_store.cc:276] 0709 12:22:56.258609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.906159 (+647550us) service_pool.cc:224] Handling call
0709 12:22:56.927978 (+ 21819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.987420 (+ 59442us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:57.011828 (+ 24408us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.358846 (+347018us) log.cc:844] Serialized 14 byte log entry
0709 12:22:57.928905 (+570059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.928955 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:57.928996 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.929056 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.929161 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":590381,"prepare.queue_time_us":1143,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":9736,"raft.queue_time_us":707000,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":66,"thread_start_us":313649,"threads_started":2,"wal-append.queue_time_us":277237}
I20260709 12:22:57.927271  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:57.932788  9186 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:57.933571  9186 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:57.934434  9285 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:57.934681  9186 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:57.935027  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:57.935405  9287 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:57.935839  4574 raft_consensus.cc:2393] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 8: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:57.936190  4575 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:57.936055  9287 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.935039  9285 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.938328  9287 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.939610  9285 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.934706  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:57.940840  9281 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.942243  9281 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:57.943922  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 587122us
W20260709 12:22:57.945073  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 467473us
I20260709 12:22:57.948107  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:57.948659  9142 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.949672  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:57.950241  3850 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:57.954321  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:57.959515  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.963936  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:57.970217  8950 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:57.971746  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.972968  3925 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:57.972910  9240 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:57.976130  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:57.976006  9004 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:57.977188  3846 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:22:57.935060  9186 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:57.981462  9290 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:57.982863  3847 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 9 to 11, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:22:57.982343  9186 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:57.984652  9290 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.984849  9004 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:57.996882  3850 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:22:57.997200  3920 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:22:57.929597  8592 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:57.999577  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:57.985495  9287 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:58.009174  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:58.011860  9312 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:22:57.998349  8529 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.016064  3850 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:57.991991  9004 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:58.013860  9240 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:58.015923  9186 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:58.030040  8912 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:58.069556  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 70238.8us
I20260709 12:22:58.065805  9000 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:58.073032  9285 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:58.073602  9000 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:58.075544  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.076125  9000 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:57.997025  9290 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:57.998483  9174 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:22:58.137003  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:58.136965  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.065147  9277 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.138808  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 109742us
I20260709 12:22:58.092545  9240 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:58.028967  8529 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.197307  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:58.205195  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65310.6us
I20260709 12:22:58.201112  9287 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:58.219727  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 82830.1us
I20260709 12:22:58.205132  8912 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.226382  9145 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.196705  9277 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.228538  9145 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.230216  9277 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:58.230603  9145 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:22:58.231644  9316 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:58.233480  8912 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:22:58.235877  8912 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:58.241809  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:58.242527  3846 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
W20260709 12:22:58.244671  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 359590us
I20260709 12:22:58.247246  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:22:58.255635  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49554.4us
I20260709 12:22:58.256860  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:58.207769  9004 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.262392  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:58.264117  3916 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:58.264288  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:58.268486  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 380754us
I20260709 12:22:58.270107  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:58.271162  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:58.290933  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:58.296926  3920 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.297781  3921 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15. Re-sending same reply.
W20260709 12:22:58.265358  9319 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 12:22:58.323385  3923 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:22:58.496876  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.263700  8929 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:58.496963  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.499215  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 229370us
I20260709 12:22:58.518684  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:58.268421  9287 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:58.523466  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 225951us
I20260709 12:22:58.260222  9006 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.230s
I20260709 12:22:58.531690  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:58.544431  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:58.541335  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.544813  4575 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:58.525221  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:58.547591  3889 leader_election.cc:336] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.177s (SENT)
W20260709 12:22:58.549106  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 292315us
I20260709 12:22:58.548275  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.549929  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:22:58.553646  3923 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:22:58.515154  8929 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:58.536187  9004 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:58.564234  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:22:58.573211  3847 consensus_meta.cc:287] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.002s
I20260709 12:22:58.492719  9248 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:22:58.545033  9277 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.553717  9285 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:58.563704  9315 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.496s	user 0.001s	sys 0.000s
I20260709 12:22:58.534884  8864 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:22:58.565719  9145 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:58.590282  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.250931  9240 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.565629  9204 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.561932  9006 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:58.590694  9313 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 12:22:58.572002  8929 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:58.618551  8581 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:58.621654  8864 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:58.649094  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.623895  9321 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:22:58.622617  4582 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:58.623838  4574 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:22:58.655797  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65656.2us
I20260709 12:22:58.627749  9237 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.575907  9241 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:22:58.602990  8529 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:58.646135  8581 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:22:58.540175  9279 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 12:22:58.624050  9317 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.473s	user 0.001s	sys 0.000s
I20260709 12:22:58.614207  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:22:58.676559  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63001.4us
I20260709 12:22:58.600620  8912 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:58.682457  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:58.661731  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.667021  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:58.649245  8864 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:22:58.680102  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 132574us
I20260709 12:22:58.629839  9006 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:58.657869  9235 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.691742  9235 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:58.699987  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.701879  9006 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.631702  9204 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.690110  9282 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:58.648654  9145 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.602855  9277 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.709306  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:58.690503  8864 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.722087  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:58.713326  3916 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:22:58.722826  4574 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:22:58.737483  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 187634us
I20260709 12:22:58.755326  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:58.686259  8912 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.718696  9285 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:58.685061  9195 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.738916  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:58.772326  3921 raft_consensus.cc:2410] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:22:58.721349  9203 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.820s	user 0.007s	sys 0.007s
W20260709 12:22:58.741586  9257 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:58.720916  9243 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:58.712998  9235 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:58.786717  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:22:58.787338  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 125772us
I20260709 12:22:58.789433  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.793581  9145 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:58.794589  8864 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.795468  9282 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:58.766748  9324 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:58.798995  9324 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.799342  9324 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:58.804383  3844 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:58.807860  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:58.808497  3843 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:22:58.811403  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.812702  9235 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:58.813028  3920 consensus_meta.cc:287] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 12:22:58.813393  3920 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:22:58.813933  9235 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:58.767782  8912 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:58.816807  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:58.818053  9279 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:58.818445  9279 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.818791  9279 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.741016  9251 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:22:58.775220  8581 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:58.823895  8581 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.781836  9203 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.829955  3917 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:58.790925  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.827741  9324 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.884433  9290 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:58.887261  9324 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:58.811017  9006 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:58.831425  9203 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:58.833854  9243 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:58.877597  9172 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:58.881671  9326 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.004s
W20260709 12:22:58.887188  9318 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.959s	user 0.003s	sys 0.009s
W20260709 12:22:58.939774  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 148906us
I20260709 12:22:58.948817  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:58.910969  9248 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.968448  3845 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:58.971475  9287 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.944952  8529 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.966840  9172 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:58.966267  9282 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:58.966538  9285 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.997975  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 237750us
I20260709 12:22:58.977469  9287 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.014346  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.994736  9204 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:58.974051  9248 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.026773  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:59.040380  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:59.020996  9282 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:58.999557  8529 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.048776  9328 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:59.049417  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.051657  3815 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:59.051870  9172 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.056857  9237 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:59.058152  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:22:59.193482  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135453us
W20260709 12:22:59.081270  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.194581  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.010396  9285 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.196105  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 144539us
W20260709 12:22:59.200793  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.205250  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.206761  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63901.8us
I20260709 12:22:59.211879  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:59.238641  8529 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.245714  9285 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:59.250527  9277 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.252175  9248 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.185171  9243 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.258435  9004 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.008s
I20260709 12:22:59.069424  9282 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:22:59.268013  9282 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:59.269747  9240 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:22:59.270334  9240 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.270737  9240 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:22:59.277556  9006 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.278515  9328 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:59.279776  9328 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.206144  9251 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:59.283190  9251 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.285939  9251 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.286652  9251 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:59.188570  9287 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:22:59.192098  9186 consensus_meta.cc:287] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.108s	user 0.010s	sys 0.018s
I20260709 12:22:59.291406  9186 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.292028  9186 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.294688  9186 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.296517  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.300066  9279 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.302875  9279 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.306360  3920 raft_consensus.cc:2368] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:59.311498  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:59.312317  3916 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:22:59.323249  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 108059us
W20260709 12:22:59.326503  3922 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.032s	sys 0.074s
W20260709 12:22:59.336252  3922 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.032s	sys 0.074s
I20260709 12:22:59.287173  9251 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:59.213315  9310 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.211s	user 0.009s	sys 0.004s
W20260709 12:22:59.186535  9281 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.244s	user 0.015s	sys 0.011s
W20260709 12:22:59.363494  4580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.020s	sys 0.054s
W20260709 12:22:59.365795  4580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.020s	sys 0.054s
W20260709 12:22:59.366752  8929 consensus_meta.cc:287] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.000s
I20260709 12:22:59.388422  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.337574  9324 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:22:59.393711  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67595.8us
I20260709 12:22:59.395010  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1218) took 1440 ms. Trace:
I20260709 12:22:59.397980  3916 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:22:59.400696  3847 rpcz_store.cc:276] 0709 12:22:57.954265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.954388 (+   123us) service_pool.cc:224] Handling call
0709 12:22:57.968529 (+ 14141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.982666 (+ 14137us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:22:58.574599 (+591933us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.025258 (+450659us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.025580 (+   322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:59.026197 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:22:59.026353 (+   156us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:59.026400 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.026505 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:59.394781 (+368276us) raft_consensus.cc:1685] finished
0709 12:22:59.394803 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.394949 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36784,"prepare.queue_time_us":18841,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":89583,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":18455,"thread_start_us":409267,"threads_started":2,"wal-append.queue_time_us":412193}
I20260709 12:22:59.384951  9145 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:59.426997  3847 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:22:59.415812  9000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.024s	sys 0.065s
W20260709 12:22:59.431725  3814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.038s	sys 0.132s
W20260709 12:22:59.433708  3814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.038s	sys 0.132s
W20260709 12:22:59.433235  3844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.041s	sys 0.064s
W20260709 12:22:59.435384  3844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.041s	sys 0.064s
W20260709 12:22:59.426334  8912 consensus_meta.cc:287] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.001s
W20260709 12:22:59.429886  9000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.024s	sys 0.065s
I20260709 12:22:59.438830  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.454684  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1358) took 1229 ms. Trace:
I20260709 12:22:59.455556  9180 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.456432  9180 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:22:59.467728  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 681072us
I20260709 12:22:59.435003  9004 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.455269  3925 rpcz_store.cc:276] 0709 12:22:58.225488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.225638 (+   150us) service_pool.cc:224] Handling call
0709 12:22:58.225959 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.273390 (+ 47431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.297892 (+ 24502us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.324624 (+ 26732us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.978108 (+653484us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:58.978153 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.978238 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:59.454468 (+476230us) raft_consensus.cc:1685] finished
0709 12:22:59.454489 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.454621 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72972,"raft.queue_time_us":39480,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":37047,"thread_start_us":421923,"threads_started":1,"wal-append.queue_time_us":903781}
I20260709 12:22:59.394434  8929 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.476442  3841 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:22:59.479054  8929 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.429620  9145 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.486406  9323 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.990s	user 0.000s	sys 0.003s
W20260709 12:22:59.493312  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.494521  3814 connection.cc:256] RPC call timeout handler was delayed by -2.2800227300003826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:22:59.495239  9334 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 12:22:59.496516  3922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3167) took 1234 ms. Trace:
I20260709 12:22:59.496913  3922 rpcz_store.cc:276] 0709 12:22:58.262275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.267756 (+  5481us) service_pool.cc:224] Handling call
0709 12:22:58.498019 (+230263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.498378 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.498430 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.543398 (+ 44968us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.761378 (+217980us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:59.336819 (+575441us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.337147 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.337286 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:59.496271 (+158985us) raft_consensus.cc:1685] finished
0709 12:22:59.496295 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.496454 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30675,"prepare.queue_time_us":30563,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1296,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":20510,"thread_start_us":732062,"threads_started":2,"wal-append.queue_time_us":432198}
I20260709 12:22:59.462057  9251 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.494861  3814 connection.cc:256] RPC call timeout handler was delayed by -1.7778430430003027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:22:59.503214  3814 connection.cc:256] RPC call timeout handler was delayed by -1.7265430430002198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:22:59.503647  3814 connection.cc:256] RPC call timeout handler was delayed by -1.7103430430001936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 12:22:59.504055  3814 connection.cc:256] RPC call timeout handler was delayed by -1.1820430430002489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:22:59.504400  9260 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:59.505095  9260 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:22:59.514580  9341 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:59.484253  9004 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.518491  9004 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.523636  9145 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.524155  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1352) took 1651 ms. Trace:
I20260709 12:22:59.524602  3924 rpcz_store.cc:276] 0709 12:22:57.873065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.873194 (+   129us) service_pool.cc:224] Handling call
0709 12:22:57.873578 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.246853 (+373275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.246889 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.253343 (+  6454us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.570135 (+316792us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:58.570271 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.523692 (+953421us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5400215a54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:59.523747 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:59.523801 (+    54us) raft_consensus.cc:1685] finished
0709 12:22:59.523817 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.524086 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567224,"raft.queue_time_us":332778,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7768,"spinlock_wait_cycles":116330752,"thread_start_us":297463,"threads_started":1,"wal-append.queue_time_us":353625}
I20260709 12:22:59.526333  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:59.526670  9180 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.506398  9260 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.528227  9260 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:59.542654  9287 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:59.449934  8912 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.562397  3843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.016s	sys 0.021s
W20260709 12:22:59.563817  3843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.019s	sys 0.023s
W20260709 12:22:59.569591  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.574064  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:22:59.564764  3964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.037s
W20260709 12:22:59.580415  3964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.037s
I20260709 12:22:59.575034  3924 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:22:59.591616  3925 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:22:59.565557  8581 consensus_meta.cc:287] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.741s	user 0.014s	sys 0.000s
W20260709 12:22:59.594412  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 645698us
I20260709 12:22:59.594852  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:22:59.599458  9195 consensus_meta.cc:287] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.818s	user 0.017s	sys 0.001s
I20260709 12:22:59.565184  9282 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.600015  9195 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.601738  9282 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:59.603731  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.605708  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.610657  9282 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:59.610862  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:59.611742  9281 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:59.615092  3964 leader_election.cc:400] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:59.615535  3964 leader_election.cc:403] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:59.619239  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.619024  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.591315  9235 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:59.621860  3920 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:59.620365  9285 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:22:59.628856  9281 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:59.629837  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:22:59.631320  8912 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:59.641366  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:59.652931  3964 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:59.653541  3964 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:59.653673  9240 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.646081  9287 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:59.655537  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.656036  9287 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:22:59.656491  9277 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:59.657132  9287 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.657385  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.659458  9282 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:59.659524  8529 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:59.660156  9282 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.660400  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:22:59.660734  9282 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:59.661216  3841 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:22:59.666616  8912 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:59.638160  9235 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.712136  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2505) took 1048 ms. Trace:
I20260709 12:22:59.712925  3846 rpcz_store.cc:276] 0709 12:22:58.663663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.675372 (+ 11709us) service_pool.cc:224] Handling call
0709 12:22:58.701645 (+ 26273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.603770 (+902125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:59.603809 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:59.603854 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:59.603890 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.711871 (+107981us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540011a3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:22:59.711919 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.712059 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2759,"raft.queue_time_us":2905,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":2067425024}
I20260709 12:22:59.718245  8720 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:22:59.756220  9126 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.047s	sys 0.133s
W20260709 12:22:59.794613  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 345134us
I20260709 12:22:59.799050  3890 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:22:59.800403  9279 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:59.800797  9279 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.801118  9279 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:59.807426  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.795549  9126 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.048s	sys 0.133s
I20260709 12:22:59.795102  9240 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:59.810281  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.811017  4575 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:22:59.805038  9352 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.848271  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:59.792542  8720 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.851058  4582 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:59.853950  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 225983us
I20260709 12:22:59.842398  9277 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:22:59.811925  8581 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:22:59.859404  3814 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.602s (SENT)
I20260709 12:22:59.877480  4575 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:59.878026  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:22:59.880283  9260 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:22:59.880934  9260 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:22:59.881892  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.884518  3814 leader_election.cc:336] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.620s (SENT)
W20260709 12:22:59.886080  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 228790us
I20260709 12:22:59.894491  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:22:59.856783  9352 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.897046  8581 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:59.897444  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:59.898767  9352 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:22:59.899024  8720 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.899381  3815 leader_election.cc:400] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:59.899718  3815 leader_election.cc:403] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:59.900172  9348 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:22:59.900415  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:59.900790  9348 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:22:59.901769  9324 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:59.901798  9348 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:22:59.903322  8889 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:59.903815  8889 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.904006  4575 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:22:59.904333  8889 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:59.905012  9277 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:59.908423  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.909117  3999 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:22:59.909996  9324 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11.
I20260709 12:22:59.910172  9281 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:59.910851  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.914925  3990 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:22:59.882192  9006 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:59.915500  9006 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.915705  9279 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.917778  9006 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.911696  9235 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.911942  3995 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:59.912285  9333 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:59.870774  9328 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.921067  9260 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:22:59.920996  9328 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.922528  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.875741  9250 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:59.924829  9250 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.926700  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:22:59.927618  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.928520  4577 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:59.929649  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.930318  4578 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:22:59.875741  8842 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:22:59.932406  8842 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:22:59.934724  8842 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:59.936105  9351 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:59.937889  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2516) took 1113 ms. Trace:
I20260709 12:22:59.938367  9250 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.938284  3843 rpcz_store.cc:276] 0709 12:22:58.824360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.824589 (+   229us) service_pool.cc:224] Handling call
0709 12:22:58.824964 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.878243 (+ 53279us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:58.884766 (+  6523us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.565512 (+680746us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:59.566281 (+   769us) log.cc:844] Serialized 26 byte log entry
0709 12:22:59.566457 (+   176us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:59.566504 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.566595 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:59.937645 (+371050us) raft_consensus.cc:1685] finished
0709 12:22:59.937666 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.937795 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56736,"prepare.queue_time_us":6794,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":68827,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":9064,"thread_start_us":680047,"threads_started":1,"wal-append.queue_time_us":913239}
W20260709 12:22:59.939566  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55089.2us
W20260709 12:22:59.943693  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.925189  9328 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:22:59.945529  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.903954  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.913892  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.952291  3993 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:22:59.954494  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.960314  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.961581  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.962235  3995 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:22:59.918385  9279 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:22:59.971542  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.974653  3999 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:59.974977  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.975513  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:59.976094  3999 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:22:59.976401  3992 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.977494  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:22:59.977789  3846 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:59.978623  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.979410  3842 raft_consensus.cc:2410] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:59.979791  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:22:59.980425  3996 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:59.981724  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:59.971684  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:22:59.984660  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:22:59.985612  3994 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:59.987002  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.987978  3995 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:22:59.980419  3841 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:22:59.995677  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:22:59.996454  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:22:59.951025  9282 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.000198  9251 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:00.000824  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.003430  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.011601  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.024526  3995 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.044456  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.046226  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.047652  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.047652  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.017234  4582 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:00.068769  3997 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:23:00.070297  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.075827  3922 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:23:00.077236  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51707.9us
I20260709 12:23:00.081456  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:00.082440  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.083267  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.086229  3916 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:00.000973  9195 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:23:00.092388  3889 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.039s (SENT)
I20260709 12:23:00.094907  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:22:59.971310  8842 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:23:00.098213  3992 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6.
I20260709 12:22:59.974902  9328 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.100s
I20260709 12:23:00.108989  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.046087  9260 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:00.113202  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 306890us
I20260709 12:23:00.115474  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.118059  3992 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.063666  9352 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:00.122174  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.123092  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:00.128577  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:00.130744  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.138859  3995 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:00.141305  9333 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:00.121227  9260 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.142760  9260 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:00.149838  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.150650  3995 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:00.106338  9240 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:00.125926  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.151746  3999 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:00.164687  3997 raft_consensus.cc:2376] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 6. Re-sending same reply.
I20260709 12:23:00.165381  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:00.124068  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.154016  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.167284  3995 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:00.166131  3999 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:00.177655  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.126683  9235 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:00.181046  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.182842  3992 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:23:00.184103  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.185111  3992 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:00.186586  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:00.187335  9364 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:00.187934  9364 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.189654  9279 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:00.189941  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.190173  9279 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.190663  3999 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:00.192747  9126 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:00.193125  9126 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:00.193655  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:00.194072  9126 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:00.198586  9363 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:00.201493  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.202262  3993 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:00.204875  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.213469  3841 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:00.214535  3995 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:00.218524  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3177) took 1008 ms. Trace:
I20260709 12:23:00.219164  3917 rpcz_store.cc:276] 0709 12:22:59.209927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.213655 (+  3728us) service_pool.cc:224] Handling call
0709 12:22:59.214026 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.214285 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:59.346577 (+132292us) log.cc:844] Serialized 14 byte log entry
0709 12:22:59.522018 (+175441us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18002f0800. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f905c02 00007fdc5258d20b 00007fdc52592d23 00007fdc5259323a 00007fdc529fda2a
0709 12:23:00.218178 (+696160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.218238 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:00.218289 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.218355 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.218469 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131937,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2655,"raft.queue_time_us":33810,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":11533184,"thread_start_us":694815,"threads_started":2,"wal-append.queue_time_us":747174}
I20260709 12:23:00.222209  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.222950  3998 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:00.225567  3995 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:00.227226  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:00.231127  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 138813us
W20260709 12:23:00.232214  3889 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.088s (SENT)
I20260709 12:23:00.203635  9126 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:00.148697  9352 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.206856  9059 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:00.238118  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 377571us
I20260709 12:23:00.236832  3990 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:00.186002  3994 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:00.245530  3998 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:00.246692  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:00.249106  3992 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:00.249958  3990 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:00.216180  9240 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.251703  9355 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:00.252276  9355 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:00.252493  9240 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:00.253688  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.253448  9355 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.258002  3995 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:00.258196  3997 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:23:00.263111  9369 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:00.263847  9369 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:00.264851  9369 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.265719  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.268746  9282 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:00.267040  3998 raft_consensus.cc:2376] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:23:00.274422  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.275095  3998 raft_consensus.cc:2376] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16. Re-sending same reply.
I20260709 12:23:00.275484  9328 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:00.227880  8842 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:23:00.280089  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.239719  9235 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:00.297035  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.298784  3995 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:00.312140  3994 raft_consensus.cc:2376] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14. Re-sending same reply.
W20260709 12:23:00.313602  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.316331  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.255369  9355 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:00.319895  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.321920  3994 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18. Re-sending same reply.
I20260709 12:23:00.324579  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.329603  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.335062  3994 raft_consensus.cc:2376] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11. Re-sending same reply.
I20260709 12:23:00.335172  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.337769  3992 raft_consensus.cc:2468] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:23:00.341741  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.342655  3997 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:00.350929  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:00.354278  3920 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:00.354787  3841 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:00.314020  9235 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.355294  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.357331  3998 raft_consensus.cc:2376] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17. Re-sending same reply.
I20260709 12:23:00.360831  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.353966  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.361984  3990 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:00.358929  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.363034  3845 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:00.366391  3993 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:23:00.372175  3889 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.652s (SENT)
I20260709 12:23:00.318255  9328 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:00.355840  8720 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.387948  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.361588  3996 raft_consensus.cc:2376] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18. Re-sending same reply.
I20260709 12:23:00.401028  3997 raft_consensus.cc:2376] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9. Re-sending same reply.
I20260709 12:23:00.359890  9235 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:00.404723  3889 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.669s (SENT)
W20260709 12:23:00.398325  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 204751us
I20260709 12:23:00.362201  9279 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:00.412322  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:00.441605  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.448661  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.450233  3991 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:00.458611  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53936.2us
I20260709 12:23:00.367762  9356 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:00.458812  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46468.5us
W20260709 12:23:00.459950  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.283s (SENT) [suppressed 44 similar messages]
I20260709 12:23:00.391981  9145 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:00.403124  9247 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:00.469609  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:00.470274  3997 raft_consensus.cc:606] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.470633  3997 raft_consensus.cc:614] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:00.466516  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.478070  3991 raft_consensus.cc:2376] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17. Re-sending same reply.
I20260709 12:23:00.397759  9324 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:23:00.487190  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:00.492686  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:00.493515  3990 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:00.501041  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.403597  9376 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.092s
W20260709 12:23:00.484411  8889 consensus_meta.cc:287] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.005s
I20260709 12:23:00.465380  9365 raft_consensus.cc:2764] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:00.412910  8720 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.463789  9279 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:23:00.510304  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:00.511511  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 267126us
W20260709 12:23:00.506525  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 187580us
I20260709 12:23:00.484351  9364 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:00.479990  8529 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:23:00.522524  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:00.529484  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:00.534478  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.485389  9247 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.481732  9145 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.535146  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.539376  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:00.545364  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.545600  4546 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:00.563385  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:00.514187  8889 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:00.566990  9375 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:23:00.569304  9373 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:00.566813  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:00.579596  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:00.549824  9287 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.549443  9352 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:00.551151  9390 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.551386  9385 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.586572  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:00.625198  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.636729  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:00.637562  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.639420  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60088.5us
W20260709 12:23:00.640547  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 123035us
I20260709 12:23:00.639586  9180 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:00.630648  9282 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.644598  9385 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.622020  9388 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:00.666281  9180 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.723088  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.630715  9390 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.736313  3990 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:23:00.745829  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 103730us
I20260709 12:23:00.766744  4574 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:00.781282  9377 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
I20260709 12:23:00.783463  8581 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:00.784122  8581 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:00.785318  8581 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:00.791131  4574 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:23:00.803731  3889 leader_election.cc:336] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.967s (SENT)
I20260709 12:23:00.805958  3890 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:00.807979  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 245255us
I20260709 12:23:00.832352  9247 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:00.837225  9277 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:00.838182  9277 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:00.852236  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.864460  8581 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:00.732460  9180 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:00.745223  9282 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:00.877908  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 72056.3us
W20260709 12:23:00.878757  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.777055  9126 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:00.883960  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 76342.7us
W20260709 12:23:00.884790  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74784us
W20260709 12:23:00.891237  3889 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.746s (SENT)
I20260709 12:23:00.892776  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:00.893422  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.894470  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.930619  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.935418  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:00.856536  9277 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:00.877782  9282 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:00.940897  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 280793us
I20260709 12:23:00.878602  8720 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:00.944180  9380 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:23:00.958521  9386 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
W20260709 12:23:00.963852  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 72643.3us
I20260709 12:23:00.966799  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.968611  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:00.969348  3919 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:00.969630  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.971304  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:00.971683  8912 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:00.972704  8912 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:00.973106  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:00.974001  8912 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:00.974432  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:00.975613  9126 raft_consensus.cc:2764] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:23:00.976109  9382 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 12:23:00.981382  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:00.983526  3919 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
W20260709 12:23:00.983611  3732 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bd47d64594f743eba2922d79251c1c5c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:00.985859  9390 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:00.987326  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:00.983283  3916 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:00.993994  4574 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:23:00.995792  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:00.997407  9374 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.492s	user 0.001s	sys 0.001s
I20260709 12:23:00.948932  9145 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:01.019830  9355 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.006s
W20260709 12:23:01.029837  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 269045us
W20260709 12:23:01.037024  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.038827  9369 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:01.010118  9235 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
W20260709 12:23:01.027601  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 53236.6us
I20260709 12:23:01.043032  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:01.064760  9279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.016s
W20260709 12:23:01.081925  9279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.017s
W20260709 12:23:01.090431  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 94766.1us
I20260709 12:23:01.090684  9403 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:01.091101  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59260.1us
I20260709 12:23:01.074122  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:01.099745  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 56839.2us
W20260709 12:23:01.072458  9260 consensus_meta.cc:287] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.926s	user 0.015s	sys 0.001s
I20260709 12:23:01.054498  9369 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:01.113951  3889 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 3.153s (SENT)
W20260709 12:23:01.111507  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.114713  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.071424  9126 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:01.097277  9409 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:01.130756  3964 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:01.133417  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 209387us
I20260709 12:23:01.127403  9391 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:01.160535  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.066069  9235 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:01.162009  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60565.8us
I20260709 12:23:01.113837  9355 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:01.106760  9059 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:01.166376  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51783.5us
I20260709 12:23:01.117894  9260 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:01.169797  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.074216  9407 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:01.097553  9403 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:01.223929  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 93311.9us
I20260709 12:23:01.113519  9145 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:23:01.128026  9006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.022s
I20260709 12:23:01.235041  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:01.226001  9384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.020s	sys 0.020s
I20260709 12:23:01.251909  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:01.223241  9385 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:01.252918  3923 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:01.251333  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.231707  9279 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:01.271253  3814 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.789s (SENT)
I20260709 12:23:01.229298  9126 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:01.269150  9006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.002s	sys 0.022s
W20260709 12:23:01.272204  9384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.020s	sys 0.022s
W20260709 12:23:01.290642  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 176739us
W20260709 12:23:01.342468  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.295377  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44144.5us
I20260709 12:23:01.343874  3964 leader_election.cc:400] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15.
I20260709 12:23:01.345949  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:01.314096  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.239034  9355 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:01.339169  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 825) took 1117 ms. Trace:
W20260709 12:23:01.276907  9281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.013s	sys 0.034s
I20260709 12:23:01.351697  9420 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:01.358371  9126 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.362097  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.363456  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.337643  9400 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.364997  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.381625  3999 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:01.366118  9429 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:01.280827  9277 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:01.247843  9403 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:01.391006  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 230558us
W20260709 12:23:01.391458  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 165927us
I20260709 12:23:01.355931  4578 rpcz_store.cc:276] 0709 12:23:00.221398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.221528 (+   130us) service_pool.cc:224] Handling call
0709 12:23:00.221979 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.484795 (+262816us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:00.639053 (+154258us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.875243 (+236190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:01.004786 (+129543us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000127c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:23:01.005315 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:23:01.005527 (+   212us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:01.005572 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.005658 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.285943 (+280285us) raft_consensus.cc:1685] finished
0709 12:23:01.335025 (+ 49082us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.339074 (+  4049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5965,"prepare.queue_time_us":399450,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":42569,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":56791,"spinlock_wait_cycles":23623040,"thread_start_us":531085,"threads_started":3,"wal-append.queue_time_us":283844}
I20260709 12:23:01.234416  9391 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.398140  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.403103  3991 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:01.334967  8912 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:01.405628  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 134410us
I20260709 12:23:01.427942  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.434267  3993 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:01.434973  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.384043  9281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.013s	sys 0.037s
I20260709 12:23:01.352723  9385 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:01.367288  9279 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:01.438007  3996 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:01.440142  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:01.444046  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 87357.5us
I20260709 12:23:01.363139  9180 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:01.446079  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49743.7us
I20260709 12:23:01.238788  9059 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:01.446128  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54211.8us
I20260709 12:23:01.384533  9420 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:01.449369  3999 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:01.454844  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.449998  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.459324  3995 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:01.449397  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.460565  3994 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:23:01.464501  3991 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:01.465303  3998 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:01.468127  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.468844  3999 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:23:01.469935  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.483857  9434 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:01.484522  9434 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.486742  9434 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:01.488831  9059 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:01.489709  9235 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:01.491593  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:01.500542  9408 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
W20260709 12:23:01.502159  9427 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
I20260709 12:23:01.462332  9420 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:01.505662  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.506237  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:01.507938  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3207) took 1144 ms. Trace:
W20260709 12:23:01.508522  9425 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:23:01.509472  9418 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:23:01.512185  9180 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:01.434909  8912 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:01.517072  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 265237us
I20260709 12:23:01.521183  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:01.521782  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:01.508543  3923 rpcz_store.cc:276] 0709 12:23:00.363833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.366986 (+  3153us) service_pool.cc:224] Handling call
0709 12:23:00.367398 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:01.273770 (+906372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.507556 (+233786us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b540036e7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:01.507832 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035890560}
W20260709 12:23:01.526012  3889 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.581s (SENT)
I20260709 12:23:01.527801  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.531013  3993 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
W20260709 12:23:01.575632  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51953.7us
I20260709 12:23:01.580194  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:01.581878  3889 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.623s (SENT)
I20260709 12:23:01.583345  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:01.583673  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:01.517239  9282 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
I20260709 12:23:01.396656  9400 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:01.585455  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67495.9us
I20260709 12:23:01.472138  9277 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:01.239183  9369 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.599119  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:01.617995  3848 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.593343  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:01.608464  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.577096  9410 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:23:01.456158  9279 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.623591  3997 raft_consensus.cc:606] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:01.623548  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.631672  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.627565  4580 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:01.629882  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.632840  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.633500  3998 raft_consensus.cc:2376] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16. Re-sending same reply.
I20260709 12:23:01.638288  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.639025  3993 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:01.633653  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:01.637475  3814 leader_election.cc:336] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.005s (SENT)
I20260709 12:23:01.643752  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:01.648588  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:01.658597  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.621040  8912 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:01.663420  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.666141  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:01.666929  3916 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.672892  9381 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:01.673436  9381 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:01.674368  9381 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:01.608563  9282 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.677605  9282 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:01.685042  9391 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:01.687503  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45208 (request call id 29) took 1121 ms. Trace:
I20260709 12:23:01.687970  3997 rpcz_store.cc:276] 0709 12:23:00.566465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.566669 (+   204us) service_pool.cc:224] Handling call
0709 12:23:01.687295 (+1120626us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003e2454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529ed853 00007fdc579bb60a 00007fdc50f417d4 00007fdc50f41762 00007fdc50f41691 00007fdc50f4160c 00007fdc50f408c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:01.687385 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406780288}
I20260709 12:23:01.640877  9059 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:23:01.653069  9434 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.693831  8889 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:01.694171  9260 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:01.699673  9426 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:23:01.703966  4547 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.577s (SENT)
I20260709 12:23:01.704510  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:01.705693  4547 leader_election.cc:336] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.749s (SENT)
I20260709 12:23:01.706104  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:01.527758  9355 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:01.710870  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89917.1us
I20260709 12:23:01.730907  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:01.712070  4547 leader_election.cc:336] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.861s (SENT)
I20260709 12:23:01.731801  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:01.732384  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:01.722577  3848 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:01.656704  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:01.719468  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60944.3us
I20260709 12:23:01.739431  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:01.741222  3847 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:01.742455  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:01.743131  9445 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:01.728708  9126 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:01.737996  9437 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.743986  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:01.744549  9392 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:01.744689  3921 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:01.622375  9277 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:01.757030  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44987.7us
I20260709 12:23:01.781829  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:01.781385  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 145125us
I20260709 12:23:01.766680  3916 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:23:01.783133  4578 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 10: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:01.781462  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:01.666824  9398 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.810191  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:01.811549  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:01.772353  3993 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:01.815182  3994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:01.816098  3994 raft_consensus.cc:606] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:01.816538  3994 raft_consensus.cc:614] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:01.830194  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:01.836634  3875 heartbeater.cc:646] Failed to heartbeat to 127.2.157.126:36337 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.157.126:36337 timed out after 15.000s (SENT)
W20260709 12:23:01.849848  9435 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 12:23:01.777060  9333 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:01.860960  9433 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:23:01.886821  3889 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.721s (SENT)
W20260709 12:23:01.890386  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.891469  3889 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.037s (SENT)
W20260709 12:23:01.887313  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 157277us
I20260709 12:23:01.888957  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:01.741861  9381 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:01.895044  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:01.899495  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.900470  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:01.894968  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 257624us
W20260709 12:23:01.895320  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84809.4us
I20260709 12:23:01.895982  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.906229  3993 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:01.896226  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.743980  9126 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:01.897470  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.898097  9446 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.914512  3998 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:01.915225  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.916144  3994 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15.
W20260709 12:23:01.917972  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 134577us
I20260709 12:23:01.776506  9364 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:01.920835  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:01.920855  3814 leader_election.cc:336] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.009s (SENT)
I20260709 12:23:01.922572  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.922785  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:01.923323  3995 raft_consensus.cc:2368] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:01.924136  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.924723  3995 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:01.925516  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.926167  3995 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:01.926753  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.927507  3992 raft_consensus.cc:2393] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 17: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:01.928238  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.930207  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.934717  3997 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:01.936054  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:01.937158  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44536.7us
I20260709 12:23:01.938169  3998 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:01.939477  3994 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:01.941759  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:01.944638  4578 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.780176  8720 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:01.949144  9293 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:01.949851  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.956492  3990 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:23:01.943495  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49931.7us
I20260709 12:23:01.955241  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.957633  3997 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:01.957800  3993 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:01.959118  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:01.955881  3991 raft_consensus.cc:2410] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:01.957039  3998 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:01.859172  9403 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:01.966511  3997 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:01.990475  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.991285  3997 raft_consensus.cc:2393] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:01.995888  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.996601  3990 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:01.995815  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:01.998551  3997 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:01.999548  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.000391  3997 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.001272  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:01.959896  3996 raft_consensus.cc:2376] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:23:01.962657  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:02.016467  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 63561.5us
I20260709 12:23:02.017565  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:01.996719  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.020579  3998 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15. Re-sending same reply.
I20260709 12:23:02.025300  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.025977  3993 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:02.028218  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.030808  3997 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:01.960665  9145 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.032042  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:02.032433  3999 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:01.963506  9434 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:02.034312  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.034569  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.034992  3990 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:02.035104  3999 raft_consensus.cc:2376] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11. Re-sending same reply.
I20260709 12:23:01.963886  9448 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:02.038146  3845 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:02.039816  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.040633  3997 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:02.041585  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.042784  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.042858  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.043794  3997 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:02.044688  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:02.046765  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 125935us
W20260709 12:23:02.047406  3814 leader_election.cc:336] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.009s (SENT)
I20260709 12:23:02.047640  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:02.050273  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.045856  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.050948  3998 raft_consensus.cc:2368] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:02.055843  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.057518  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.058290  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:02.056620  3999 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:02.056512  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.059345  3997 raft_consensus.cc:2376] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12. Re-sending same reply.
I20260709 12:23:02.060324  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.060833  3993 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:02.062165  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.063352  3998 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:02.065775  3997 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:02.068020  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.027189  9391 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:01.954294  9419 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:23:02.069579  3999 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:01.936107  9446 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.073091  3996 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:02.039297  9448 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:02.074880  9431 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:02.075554  9324 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:02.054498  9435 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:02.038432  9434 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:02.051641  9389 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:02.088049  3993 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:02.076519  9387 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:23:02.089983  3814 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.028s (SENT)
I20260709 12:23:02.130880  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:02.005556  8720 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:23:01.964277  8529 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 12:23:01.996410  9440 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:23:02.033154  9390 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:23:02.119347  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.140266  3999 raft_consensus.cc:2393] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:02.141201  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.142318  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.143283  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.144402  3999 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:02.145224  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.129042  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.080528  9277 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:02.118862  3990 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:02.168144  3996 raft_consensus.cc:2376] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13. Re-sending same reply.
I20260709 12:23:02.169289  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.169607  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.138482  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.079272  9428 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:23:02.069003  3997 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:02.114416  3998 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:02.136029  9389 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:23:02.184091  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.182947  3990 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:02.183097  3993 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 7.
I20260709 12:23:02.187321  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.174216  3999 raft_consensus.cc:2410] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:23:02.127400  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75145.4us
I20260709 12:23:02.124596  9434 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.203864  3998 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:02.208458  3996 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:02.127313  9371 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:23:02.215758  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.212599  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:02.217573  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 127638us
I20260709 12:23:02.128626  9324 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.185755  9243 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:02.182287  9006 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.224056  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.250464  3999 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:02.224448  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:02.206641  9435 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:02.228567  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.251600  3998 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 6.
I20260709 12:23:02.236327  9389 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.217041  9390 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:23:02.245244  9387 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:02.245615  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.253167  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3216) took 1287 ms. Trace:
I20260709 12:23:02.256090  3924 rpcz_store.cc:276] 0709 12:23:00.965925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.985450 (+ 19525us) service_pool.cc:224] Handling call
0709 12:23:00.985764 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:01.087937 (+102173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:01.087982 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:01.088670 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 12:23:01.276366 (+187696us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:01.276426 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.276543 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:02.252907 (+976364us) raft_consensus.cc:1685] finished
0709 12:23:02.252930 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:02.253100 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101643,"raft.queue_time_us":104235,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":187272,"threads_started":1,"wal-append.queue_time_us":805112}
W20260709 12:23:02.258737  9454 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:23:02.262277  9451 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:23:02.263931  9403 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.269649  9446 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.278215  9126 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:02.281147  9324 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.282007  9281 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.282580  9281 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.282773  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:02.283799  4580 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:02.284955  9281 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:02.206180  9448 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.285558  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:02.286573  9448 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:02.286818  9324 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:02.287524  9324 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.288084  9324 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:02.250491  9282 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:02.289623  9282 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:02.290004  9282 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:02.209864  9384 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.291778  9384 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.220590  9277 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:02.296540  9420 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.001s
I20260709 12:23:02.297022  9420 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.299971  9420 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.301020  9400 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:02.301604  3922 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:02.301753  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:02.313066  9324 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.320047  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.320992  4580 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:02.226068  9443 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.323575  9324 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.326752  9387 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.329110  9387 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.331597  9463 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:02.333954  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 88418.9us
I20260709 12:23:02.334775  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:02.335984  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.290859  9282 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.348131  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:02.345736  4580 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:02.372823  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:02.377177  9371 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:02.377714  9371 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.378136  9371 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.377741  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.342408  9419 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:02.343767  9392 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 12:23:02.394574  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.362617  9440 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:02.401111  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 182846us
W20260709 12:23:02.402359  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54353.3us
I20260709 12:23:02.403689  4547 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:02.406049  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:02.408650  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.398193  9446 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:02.399171  9282 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:02.410854  3814 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.103s (SENT)
W20260709 12:23:02.412350  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 187979us
I20260709 12:23:02.414181  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:02.421205  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.422145  4580 raft_consensus.cc:2393] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:02.400554  9407 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:23:02.423355  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.398591  9460 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:02.405011  9419 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.407807  9415 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:02.407567  8912 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:02.435976  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.440542  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.440542  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:02.428138  8581 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.440984  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.441445  4582 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.441520  4580 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:02.452939  9279 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.443075  9460 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:02.456102  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.458621  9434 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.455120  9460 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.460335  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:02.431792  9126 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.464216  8581 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:02.467413  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.409155  9440 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.445564  3842 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:02.419852  9446 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.487985  4582 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
W20260709 12:23:02.444164  3814 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.111s (SENT)
I20260709 12:23:02.510066  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.423269  9037 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:02.431468  9281 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.505967  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:02.443683  9417 raft_consensus.cc:2764] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:23:02.514710  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:02.446580  9420 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.512840  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.526386  9440 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.514717  9446 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:02.514889  9459 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:02.529531  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85400.8us
W20260709 12:23:02.569196  3814 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.296s (SENT)
I20260709 12:23:02.569846  3814 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:02.532027  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:02.532728  9403 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:02.573788  9403 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.574385  9403 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:02.533257  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:02.581429  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48232.5us
I20260709 12:23:02.583252  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:02.533803  9400 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:02.585354  9400 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.585829  9400 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:02.586736  9432 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.810s	user 0.002s	sys 0.002s
I20260709 12:23:02.587570  9417 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:02.588299  9417 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.588431  9456 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:02.588909  9456 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.589272  9417 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.589743  9456 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.508378  8581 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.542517  4575 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:02.556258  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43527.7us
W20260709 12:23:02.594776  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.508121  9364 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.606173  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.599375  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:02.609155  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.597605  4546 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.614414  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.555276  9037 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:02.617147  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:02.621639  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:02.564466  9279 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:02.608218  8581 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.554854  9281 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.618746  9460 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:02.671972  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.607492  9364 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:02.645198  9279 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.645438  9180 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:02.640383  9456 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:02.618566  9463 consensus_queue.cc:1175] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 14 index: 9 } }
I20260709 12:23:02.647717  9434 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:02.649187  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.623775  9420 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:02.641306  8720 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:02.656852  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.687718  3998 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:02.688230  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 119074us
W20260709 12:23:02.688599  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89345.9us
W20260709 12:23:02.689807  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 75499.4us
I20260709 12:23:02.691318  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.691680  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.625169  9440 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.639408  9415 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:02.686278  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46179.2us
I20260709 12:23:02.677394  9364 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.681730  9180 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:02.617656  9419 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.720115  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.721586  9037 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.722236  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.714952  9398 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:23:02.724155  3921 raft_consensus.cc:1217] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-11.8]   Dedup: 11.8->[]
I20260709 12:23:02.724663  3921 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 12:23:02.725653  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.727253  9403 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.732213  3917 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:02.733258  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.733557  9403 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:02.734436  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.735803  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.735934  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.737021  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.738185  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.683619  9400 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:02.740666  9400 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.742472  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:02.743083  4577 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.747772  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.749122  3924 raft_consensus.cc:2410] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:23:02.739202  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:02.750633  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.717845  3998 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:23:02.753082  4577 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:02.754375  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:02.755193  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:02.760787  3925 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:02.765542  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.766538  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.768283  3923 raft_consensus.cc:2368] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:23:02.697412  9344 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.776959  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.772231  3922 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:23:02.779024  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.780735  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.785390  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:02.764834  9381 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
I20260709 12:23:02.685894  9371 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.787209  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:02.798316  3917 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:02.787914  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.788491  3995 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:23:02.799065  3990 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:23:02.789053  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.800437  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:02.800813  3994 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.792709  9423 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:02.769428  9443 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.773581  8912 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.775185  9472 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.775010  9277 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.822052  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.829555  3922 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:02.842170  3923 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:02.842876  9281 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:02.774801  9328 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:02.853363  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:02.804734  9400 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:02.806923  9398 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:02.850693  3922 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:02.858811  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 232882us
I20260709 12:23:02.863286  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.849973  3925 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:02.867815  3994 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:23:02.872216  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.872823  3994 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.786779  9344 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.885195  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.846279  9423 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:02.909897  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.796547  9279 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.911123  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:02.919668  3994 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:02.914702  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.827065  8912 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.826737  9277 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:02.929208  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 174911us
I20260709 12:23:02.922322  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:02.890072  9400 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:02.846504  9472 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.819164  9443 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.910612  9381 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.854131  9446 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:02.943560  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71940.8us
I20260709 12:23:02.948411  3994 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:02.948662  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.954810  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.881994  9398 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:02.929301  9440 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:02.956462  9493 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.958673  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.965816  9446 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:02.921272  9407 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:02.899631  9465 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:23:02.946053  9490 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.952829  9126 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.941408  9492 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:23:03.016294  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 57704.2us
I20260709 12:23:03.017635  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.020313  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:02.993101  9493 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:03.023203  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.023437  9490 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:03.031659  9460 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:03.009882  9391 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:03.036158  9391 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.038511  9391 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:03.002756  9491 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:03.016469  9479 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:23:03.040335  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:03.028654  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.042186  3923 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:03.067004  9172 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:03.072893  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:03.057890  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 182059us
I20260709 12:23:03.074764  9462 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:03.075363  9462 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:03.075870  9462 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:03.081792  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:03.082971  9497 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:03.083665  9497 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:03.084568  9497 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.088415  9459 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:03.089100  9459 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.091859  9459 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.064608  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.104265  9490 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:03.104975  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.107836  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.020673  9371 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.123050  3994 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:23:03.133184  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49760us
I20260709 12:23:03.134822  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.039809  9126 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:03.138454  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:03.141548  9477 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:23:03.157778  9059 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:03.142338  9496 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 12:23:03.143033  9480 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:23:03.041683  9344 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:03.114703  9431 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:23:03.158746  9126 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:03.152451  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.044652  9493 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:03.159941  9126 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.160497  9126 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.162885  9126 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:02.987083  9423 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.026871  9465 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:23:03.165468  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.170907  3964 leader_election.cc:400] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:23:03.171813  3964 leader_election.cc:403] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.158285  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:03.004583  9400 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.178675  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:03.151777  9491 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:03.192452  4577 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:03.180766  3814 leader_election.cc:400] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:03.209784  3814 leader_election.cc:403] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.174329  9126 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:03.176122  9493 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 10. Current term is 11.
I20260709 12:23:03.180173  8912 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:03.231192  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50562.9us
I20260709 12:23:03.190075  9465 consensus_queue.cc:1243] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:03.235670  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.211433  9398 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.212756  9491 raft_consensus.cc:2764] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:23:03.230705  8581 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:23:03.279119  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:03.217347  9328 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:03.290534  8889 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:03.193675  9462 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.218889  9006 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:23:03.240058  9439 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:03.277464  9472 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:03.281564  9443 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:03.309337  9145 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:03.289743  9497 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:03.292830  9243 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:03.309705  9464 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:03.316093  9328 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.350458  8889 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:03.292243  9490 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:03.385143  3814 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.357478  9281 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:03.293196  8581 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.368831  9243 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:03.376976  9006 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:23:03.397017  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.380765  9464 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:03.389752  9172 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:03.537367  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 140429us
I20260709 12:23:03.538439  3814 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:03.544157  3919 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:03.426434  9439 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:03.429700  9243 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:03.525063  9464 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:03.556735  9172 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:03.575515  9494 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:03.548734  9510 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:03.577304  9456 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.001s
I20260709 12:23:03.582217  3991 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:03.583839  9364 consensus_meta.cc:287] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.004s
W20260709 12:23:03.602167  9415 consensus_meta.cc:287] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.891s	user 0.009s	sys 0.002s
I20260709 12:23:03.604784  9328 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:03.607190  9282 consensus_meta.cc:287] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.184s	user 0.006s	sys 0.007s
I20260709 12:23:03.608494  9462 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.651250  3921 raft_consensus.cc:2410] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:03.666906  9415 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:03.665194  9364 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.702437  9364 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.649309  9172 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:03.712203  9172 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.720418  8581 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.720793  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:03.684700  9516 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:23:03.640642  9403 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.837486  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2373) took 1050 ms. Trace:
I20260709 12:23:03.838081  3997 rpcz_store.cc:276] 0709 12:23:02.787251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.789655 (+  2404us) service_pool.cc:224] Handling call
0709 12:23:02.790059 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.878987 (+ 88928us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:03.038702 (+159715us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.213168 (+174466us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.225232 (+ 12064us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.230658 (+  5426us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:03.244561 (+ 13903us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.347989 (+103428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.348105 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.837189 (+489084us) raft_consensus.cc:1685] finished
0709 12:23:03.837219 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.837408 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271921,"prepare.queue_time_us":450154,"prepare.run_cpu_time_us":202,"prepare.run_wall_time_us":793,"raft.queue_time_us":139460,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":8263,"thread_start_us":246965,"threads_started":2,"wal-append.queue_time_us":364492}
I20260709 12:23:03.828729  9282 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.834182  9403 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.850600  9282 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.858426  9522 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.866537  9522 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.868341  9464 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.870272  9522 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.875254  9464 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.876804  9282 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.888657  9403 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:03.827426  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 289076us
I20260709 12:23:03.885990  9243 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:03.919092  9279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.006s	sys 0.005s
I20260709 12:23:03.935433  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:03.935875  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.936122  3991 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:03.936331  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.937119  3998 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:03.936991  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.938627  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:03.939222  3994 raft_consensus.cc:2376] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17. Re-sending same reply.
I20260709 12:23:03.939355  3998 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:03.942377  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.944891  3993 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:23:03.934530  9279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.007s	sys 0.005s
I20260709 12:23:03.929630  9282 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:03.950587  9282 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.952960  9282 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.956482  9448 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:03.956959  9448 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:03.957775  9448 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.958297  9510 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.958868  9510 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.961727  9510 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.962255  9510 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.962591  9462 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.962713  9510 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.941162  9526 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:03.963155  9462 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.963909  9527 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:03.979797  9527 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.982187  9527 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.964360  9522 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:03.965837  8912 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.983765  8912 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.986001  8912 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:03.983135  9522 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:03.989470  9522 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:03.991173  9462 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.947201  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.966662  9328 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:03.992558  3993 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:03.992364  9328 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.967263  3814 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:03.995884  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:03.998044  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:03.971278  9439 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.000803  9462 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:04.001173  9439 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.971462  9282 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.003774  9282 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.006449  9282 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.971729  9059 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.007629  9059 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:03.959242  9448 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:04.016997  9439 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.974586  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2613) took 1191 ms. Trace:
I20260709 12:23:03.976608  9510 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.018326  3921 rpcz_store.cc:276] 0709 12:23:02.782820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.785133 (+  2313us) service_pool.cc:224] Handling call
0709 12:23:03.974302 (+1189169us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540024ed54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:03.974508 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983865728}
I20260709 12:23:03.976795  9384 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.977949  9243 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:03.968425  9006 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.019935  9282 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.019941  9006 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.020694  9282 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.022534  9006 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.022781  9282 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.994832  9328 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.011101  9059 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.028273  3993 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:04.032708  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.037122  3993 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:04.034906  9282 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.047151  9282 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.049824  9282 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:03.934775  9464 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:23:04.037248  3991 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:04.057888  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1400) took 1069 ms. Trace:
I20260709 12:23:04.051553  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:04.063499  9482 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.222s	user 0.006s	sys 0.005s
I20260709 12:23:04.069525  3925 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:04.070472  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:04.070559  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.063321  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.068984  3916 rpcz_store.cc:276] 0709 12:23:02.988360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.989545 (+  1185us) service_pool.cc:224] Handling call
0709 12:23:03.007927 (+ 18382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.147948 (+140021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.147988 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:03.148028 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:03.148070 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.057550 (+909480us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400215a54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:04.057612 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.057783 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321494784}
I20260709 12:23:04.074002  3994 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:04.077389  3993 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:04.080545  9472 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.081171  9472 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.072276  9277 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:04.083411  9472 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.075618  9384 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 12:23:04.092689  9478 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 1.404s	user 0.025s	sys 0.000s
W20260709 12:23:04.088086  9417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.015s	sys 0.026s
W20260709 12:23:04.098448  9417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.015s	sys 0.026s
I20260709 12:23:04.097345  9437 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:04.099308  9437 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.100860  9180 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.101634  9437 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:04.102192  9180 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:04.103566  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:04.104974  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3244) took 1277 ms. Trace:
I20260709 12:23:04.103636  8912 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.105350  3919 rpcz_store.cc:276] 0709 12:23:02.827842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.832221 (+  4379us) service_pool.cc:224] Handling call
0709 12:23:02.870798 (+ 38577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.544648 (+673850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.104694 (+560046us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400312ed4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:04.104854 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548127616}
I20260709 12:23:04.105868  8912 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.108239  8912 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:04.109552  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.109740  9464 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:04.110440  3995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 2377) took 1315 ms (client timeout 1514 ms). Trace:
I20260709 12:23:04.110375  9464 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:04.110932  3995 rpcz_store.cc:269] 0709 12:23:02.795404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.799974 (+  4570us) service_pool.cc:224] Handling call
0709 12:23:04.109433 (+1309459us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58001a0198. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8ceeee 000000000036eb39 00007fdc579421e0 00007fdc57a0b0c4 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:23:04.110366 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384064}
I20260709 12:23:04.112959  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.115926  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.116514  3842 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:04.118115  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.122503  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.123068  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.123133  3842 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:04.124634  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.125258  3846 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:04.120867  9464 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.128741  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.129348  3847 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:04.130201  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.131338  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.131958  3848 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:04.132833  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.133996  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.134438  9464 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.135018  9464 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.135593  9497 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:04.136128  9497 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.137003  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.137214  9464 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.137795  9464 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:04.138195  9497 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:04.148833  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:04.149914  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.151072  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.154242  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.138298  9464 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.155313  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:04.159679  3845 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:04.162412  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.163100  3842 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:04.166391  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:04.170080  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:04.171515  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.172176  3848 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:04.177793  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.180763  3844 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:04.181675  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.173359  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.179140  9448 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:23:04.189441  9448 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:04.189795  9448 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:04.190573  9448 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.197542  9448 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:04.180353  9491 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:04.179363  9472 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:04.200114  9472 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.200548  9472 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:04.199733  9491 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.203807  9491 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:04.159322  9489 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.187496  3962 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.187266  9328 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:04.208348  9328 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.208055  9489 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.208740  9328 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:04.210414  9489 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.212356  8912 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:04.212813  8912 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.213204  9277 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:04.213699  9277 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.214164  9277 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:04.179600  9421 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.195577  9243 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:04.215688  9243 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.215575  9421 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.216223  9243 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:04.179909  9059 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:04.213218  8912 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:04.219202  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:04.219720  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.179459  9497 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:23:04.224125  9282 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:04.224582  9282 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.225024  9282 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:04.226413  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2370) took 1440 ms. Trace:
W20260709 12:23:04.192498  9503 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.968s	user 0.006s	sys 0.005s
I20260709 12:23:04.235018  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:04.235047  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49934.7us
I20260709 12:23:04.238835  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.240085  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.242408  3849 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:04.242628  3962 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:04.226853  3996 rpcz_store.cc:276] 0709 12:23:02.786434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.786561 (+   127us) service_pool.cc:224] Handling call
0709 12:23:02.793368 (+  6807us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:02.822124 (+ 28756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.822166 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:02.822894 (+   728us) log.cc:844] Serialized 78 byte log entry
0709 12:23:02.900885 (+ 77991us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:03.135851 (+234966us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.226467 (+ 90616us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.393692 (+167225us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.394504 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.394588 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.136496 (+741908us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4800060cd8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:23:04.222436 (+ 85940us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b24002c44b8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f944fb0 00007fdc525bb488 00007fdc525bbbe8 00007fdc52593398 00007fdc5258e76a 00007fdc5258dbb6
0709 12:23:04.226151 (+  3715us) raft_consensus.cc:1685] finished
0709 12:23:04.226177 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.226343 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263522,"prepare.queue_time_us":719632,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":4420,"raft.queue_time_us":130828,"raft.run_cpu_time_us":22033,"raft.run_wall_time_us":777544,"spinlock_wait_cycles":27312768,"thread_start_us":272464,"threads_started":3,"wal-append.queue_time_us":127965}
I20260709 12:23:04.248773  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.249651  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:04.250140  3849 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:04.252012  3849 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:04.252234  3842 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:04.298199  8581 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:04.300305  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:04.300432  9504 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.076s	user 0.002s	sys 0.023s
I20260709 12:23:04.301970  9483 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:04.303344  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:04.304698  9279 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:04.305855  9344 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:04.307037  9344 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:04.308127  9344 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.309640  9344 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:04.312691  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 763) took 1886 ms. Trace:
I20260709 12:23:04.313133  3999 rpcz_store.cc:276] 0709 12:23:02.426602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.426714 (+   112us) service_pool.cc:224] Handling call
0709 12:23:02.427037 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.439512 (+ 12475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.439547 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.488428 (+ 48881us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.654108 (+165680us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4800060cd8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:23:02.683940 (+ 29832us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:02.711798 (+ 27858us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.712018 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.712106 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.311459 (+1599353us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b24002c44b8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f944fb0 00007fdc525bb488 00007fdc525bbbe8 00007fdc52593398 00007fdc5258e76a 00007fdc5258dbb6
0709 12:23:04.312465 (+  1006us) raft_consensus.cc:1685] finished
0709 12:23:04.312488 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.312626 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6323,"prepare.queue_time_us":353239,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7317,"raft.run_cpu_time_us":1541,"raft.run_wall_time_us":225047,"spinlock_wait_cycles":151248896,"thread_start_us":148682,"threads_started":1,"wal-append.queue_time_us":374405}
I20260709 12:23:04.314671  9279 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:04.316124  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:04.319675  8581 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.247555  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:04.324237  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.326265  3846 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:04.326272  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78882.5us
W20260709 12:23:04.327381  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85699.7us
I20260709 12:23:04.333254  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.234737  9419 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.338382  3842 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:04.340785  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:04.341861  9371 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:04.362145  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:04.363355  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:23:04.407167  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.325084  9464 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.332993  9522 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:04.432583  9522 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.406481  9419 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:04.567422  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 240225us
W20260709 12:23:04.591413  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 370549us
I20260709 12:23:04.318331  9279 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:04.624498  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 257989us
I20260709 12:23:04.409348  9497 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:23:04.322338  9398 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:23:04.321702  9059 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.166s
W20260709 12:23:04.636292  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 286763us
W20260709 12:23:04.637849  9506 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.027s	user 0.003s	sys 0.034s
W20260709 12:23:04.634410  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 236080us
W20260709 12:23:04.696038  3997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.025s
W20260709 12:23:04.702071  3997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.025s
I20260709 12:23:04.703693  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2375) took 1908 ms. Trace:
W20260709 12:23:04.710280  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 490946us
I20260709 12:23:04.624295  9494 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:04.704114  3990 rpcz_store.cc:276] 0709 12:23:02.794868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.801711 (+  6843us) service_pool.cc:224] Handling call
0709 12:23:02.802186 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:02.950901 (+148715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.950967 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:02.967025 (+ 16058us) log.cc:844] Serialized 52 byte log entry
0709 12:23:02.999312 (+ 32287us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:03.377929 (+378617us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.391208 (+ 13279us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.391708 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.391842 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.051647 (+659805us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003894a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f906522 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:04.192182 (+140535us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b24002c45d8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f94509d 00007fdc5257710e 00007fdc5258e88c 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221
0709 12:23:04.340125 (+147943us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4800060cd8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5791caa1 00007fdc57913b37 00007fdc579139ca 00007fdc57a0b26f 00007fdc57a0af37 00007fdc57a1f55c 00007fdc57a1f508 00007fdc57a1f488 00007fdc57a1f443 00007fdc57a1e6ec 00007fdc56948a96
0709 12:23:04.703471 (+363346us) raft_consensus.cc:1685] finished
0709 12:23:04.703500 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.703633 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174723,"prepare.queue_time_us":436794,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":11081,"raft.queue_time_us":54348,"raft.run_cpu_time_us":18180,"raft.run_wall_time_us":953154,"spinlock_wait_cycles":61734912,"thread_start_us":360206,"threads_started":3,"wal-append.queue_time_us":185015}
I20260709 12:23:04.633448  9464 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:04.683699  9522 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:04.758546  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.700377  9538 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:04.759932  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.768504  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.769609  4574 raft_consensus.cc:2410] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:04.721663  9384 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:04.770435  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.697662  9481 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.771775  4575 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:04.780714  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.726882  9421 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.789155  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.794215  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.764012  9485 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.765384  9543 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.754674  9459 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.772670  9541 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.799836  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.800073  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.763388  9464 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.760953  9494 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.779150  9384 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:04.813282  9536 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:23:04.845646  4575 raft_consensus.cc:1240] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:04.785674  9481 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:04.848196  3962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.015s	sys 0.060s
W20260709 12:23:04.855474  3962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.016s	sys 0.061s
W20260709 12:23:04.855850  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 613259us
I20260709 12:23:04.803699  9421 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:23:04.869709  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:04.870535  8581 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.872126  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 155386us
I20260709 12:23:04.872835  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:04.880892  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:04.881865  4575 raft_consensus.cc:2410] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:23:04.889156  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 172481us
W20260709 12:23:04.856995  9491 consensus_meta.cc:287] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.002s
I20260709 12:23:04.806180  9459 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.802989  9485 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.803581  9543 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.912547  9293 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:04.934196  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 239409us
W20260709 12:23:04.918669  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 216911us
I20260709 12:23:04.809824  9541 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:04.941967  9293 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:04.910526  9492 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.953004  4578 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 10.
I20260709 12:23:04.891914  8581 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:04.941110  9472 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.006s
W20260709 12:23:04.944602  9180 consensus_meta.cc:287] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.012s
W20260709 12:23:04.939357  9328 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
W20260709 12:23:04.937398  9243 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.001s
I20260709 12:23:04.910401  9491 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:04.936245  9558 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:04.978222  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:04.973351  9472 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:04.979184  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 285784us
I20260709 12:23:04.951907  9293 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:04.930061  9371 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:04.983793  3841 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:04.950634  9550 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.958278  9419 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.008893  3918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2602) took 2251 ms. Trace:
I20260709 12:23:04.915935  9421 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
W20260709 12:23:05.009925  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 156947us
I20260709 12:23:05.032052  3998 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:04.962560  9398 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:23:05.043666  9398 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:05.044282  9398 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:05.043895  9371 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:05.044866  9344 consensus_meta.cc:287] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.007s
I20260709 12:23:04.956907  9492 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.045347  9398 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.047101  9492 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.033023  9552 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.033612  3918 rpcz_store.cc:276] 0709 12:23:02.729316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.751591 (+ 22275us) service_pool.cc:224] Handling call
0709 12:23:02.752016 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:02.783457 (+ 31441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.783507 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:02.784256 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 12:23:03.176425 (+392169us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:03.224699 (+ 48274us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.228714 (+  4015us) log.cc:844] Serialized 14 byte log entry
0709 12:23:03.228928 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.228998 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.946803 (+717805us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800363e80. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:04.637460 (+690657us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b2400277448. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f94509d 00007fdc5257710e 00007fdc5258e88c 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221
0709 12:23:04.980785 (+343325us) raft_consensus.cc:1685] finished
0709 12:23:04.980808 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.980956 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55760,"prepare.queue_time_us":774318,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":36702,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":13640,"spinlock_wait_cycles":24185984,"thread_start_us":355663,"threads_started":1,"wal-append.queue_time_us":805713}
I20260709 12:23:05.048102  9552 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.047024  9398 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:05.051098  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3328) took 1104 ms. Trace:
W20260709 12:23:05.052750  9282 consensus_meta.cc:287] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.004s
I20260709 12:23:05.051559  3994 rpcz_store.cc:276] 0709 12:23:03.947636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.076311 (+128675us) service_pool.cc:224] Handling call
0709 12:23:04.076624 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.079159 (+  2535us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:04.085752 (+  6593us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.562178 (+476426us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.915862 (+353684us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b2c0001d038. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:23:04.916290 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.916454 (+   164us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:04.918897 (+  2443us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.922494 (+  3597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.922598 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.050862 (+128264us) raft_consensus.cc:1685] finished
0709 12:23:05.050889 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.051031 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13318,"prepare.queue_time_us":8883,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":870,"raft.queue_time_us":78133,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":7451,"spinlock_wait_cycles":12867456,"thread_start_us":471177,"threads_started":2,"wal-append.queue_time_us":268796}
I20260709 12:23:05.053249  9282 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.054452  3993 raft_consensus.cc:1240] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:05.054401  9541 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.037945  9550 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.056860  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:05.057847  8912 consensus_meta.cc:287] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.001s
I20260709 12:23:05.057981  9550 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.058343  8912 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.059562  8581 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.977864  9328 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:05.064270  9548 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:23:05.064097  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.064846  3841 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.065622  9328 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:04.981411  9243 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:05.066414  9539 log.cc:927] Time spent T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:23:05.068243  9243 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.068696  3999 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:05.011626  9558 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.069561  9552 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.067636  8912 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.036382  9562 consensus_queue.cc:1059] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:23:05.072561  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.072804  9552 consensus_queue.cc:1059] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:23:05.074754  9562 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.075464  9562 raft_consensus.cc:3055] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:05.075850  9562 raft_consensus.cc:740] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:05.073832  9277 consensus_meta.cc:287] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.859s	user 0.015s	sys 0.005s
I20260709 12:23:05.073704  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.008781  9551 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 12:23:05.078023  9421 consensus_queue.cc:1243] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:23:05.077893  9277 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.079324  9384 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.080065  9541 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.080786  9494 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.076704  9562 consensus_queue.cc:260] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.081053  9541 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.081938  9562 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.081857  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.082224  9543 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.082810  3843 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:05.083134  9541 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.072767  9472 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.080019  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.080070  4577 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:05.085160  4574 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:05.085747  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.072233  9282 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.086591  9472 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.087201  9472 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.088884  9282 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.089303  9490 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.091250  9417 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:05.091679  9417 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:05.091728  9277 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.089841  9282 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.092622  9417 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.093914  9417 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:05.094499  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.097347  9472 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.086407  4580 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
W20260709 12:23:05.080230  9448 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.882s	user 0.011s	sys 0.003s
I20260709 12:23:05.089807  9490 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.096778  9459 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.104861  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:05.106536  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 166352us
I20260709 12:23:05.118034  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.125679  3843 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:23:05.119237  3841 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:05.130411  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.174396  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.073376  9398 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:05.102706  9542 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:05.185515  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47713.7us
I20260709 12:23:05.099046  9464 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.180800  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:05.098843  9282 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.103890  9558 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:05.185029  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 54725.4us
I20260709 12:23:05.203547  9491 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.203979  9529 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:05.203785  9522 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.204437  9529 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.204816  9529 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.136107  9505 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.123620  9407 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.214607  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.178359  3962 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:05.107154  9403 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.102841  9490 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.189196  9541 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:05.190778  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.190584  9489 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:05.120347  9428 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:23:05.217768  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.191429  9543 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:05.192085  8581 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.231729  8581 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.234331  8581 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.178848  9448 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:23:05.185696  9542 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:23:05.194104  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 89356.5us
I20260709 12:23:05.192235  9419 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.237303  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:05.237661  4575 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:05.194442  9552 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.121019  9483 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.208635  9235 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.200603  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.200529  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:05.248291  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 47827.4us
I20260709 12:23:05.201418  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.251891  3916 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:05.253155  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.255470  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.257385  3992 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:05.206343  4547 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:05.207023  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.207134  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:05.187079  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.207763  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:05.259766  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.208464  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.210063  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.210903  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.211377  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.212071  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.178982  9492 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.172413  9277 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.172602  9472 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.172703  9494 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.178704  8912 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:05.223543  3991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.002s	sys 0.023s
W20260709 12:23:05.313740  3991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.002s	sys 0.023s
I20260709 12:23:05.225910  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.226886  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:05.314777  3922 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:05.228498  3845 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:05.229272  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.315371  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 773) took 1081 ms. Trace:
I20260709 12:23:05.315747  3843 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:05.185397  9545 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:05.221545  9491 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:05.195742  9551 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:05.374310  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 132255us
I20260709 12:23:05.182432  9398 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:05.199807  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.250972  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.263327  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.209030  9459 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.231361  9481 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.305050  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.219239  9558 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.184854  9344 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:23:05.226924  9403 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:05.309458  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58581.5us
I20260709 12:23:05.315830  3998 rpcz_store.cc:276] 0709 12:23:04.234077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.234188 (+   111us) service_pool.cc:224] Handling call
0709 12:23:04.234517 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.037063 (+802546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.315138 (+278075us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001987d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:05.315308 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833676032}
I20260709 12:23:05.408846  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:05.374927  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 168649us
I20260709 12:23:05.410353  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.410579  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.304697  9490 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:05.377956  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.413414  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.379050  9522 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.325647  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.476269  3925 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:05.323925  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.389405  3918 raft_consensus.cc:2393] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:05.477743  3921 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:23:05.389885  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 139039us
I20260709 12:23:05.481424  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.388334  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.484663  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:05.287503  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50307.3us
I20260709 12:23:05.485540  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:05.486176  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.397446  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 776) took 1162 ms. Trace:
I20260709 12:23:05.486667  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.373881  9547 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.308733  4581 raft_consensus.cc:2393] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 7: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:05.206344  9505 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.479718  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:05.507493  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.508496  3998 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:05.509837  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.407312  3994 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:05.316212  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.312884  9428 consensus_queue.cc:1243] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:05.411487  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:05.375921  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 188907us
I20260709 12:23:05.326416  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.376451  8912 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.373699  9554 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.382390  9551 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.397365  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3330) took 1449 ms. Trace:
I20260709 12:23:05.486958  3993 rpcz_store.cc:276] 0709 12:23:04.235146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.638774 (+403628us) service_pool.cc:224] Handling call
0709 12:23:04.683820 (+ 45046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.055076 (+371256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.397242 (+342166us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54003e3d54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:05.397390 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851841280}
I20260709 12:23:05.486661  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.386497  9485 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.320272  9472 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.489818  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.492908  3992 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:05.395364  9364 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.493038  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:05.493472  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 82974.1us
I20260709 12:23:05.494653  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.401021  9495 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.534339  3995 rpcz_store.cc:276] 0709 12:23:03.948060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.113656 (+165596us) service_pool.cc:224] Handling call
0709 12:23:04.113993 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:04.117630 (+  3637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.117661 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:04.121272 (+  3611us) log.cc:844] Serialized 52 byte log entry
0709 12:23:04.585345 (+464073us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:04.701281 (+115936us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.771405 (+ 70124us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.802668 (+ 31263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.802746 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.235158 (+432412us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b1800276b80. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:05.392039 (+156881us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b1800276b80. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:05.397148 (+  5109us) raft_consensus.cc:1685] finished
0709 12:23:05.397172 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.397308 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99666,"prepare.queue_time_us":658469,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":41475,"raft.run_cpu_time_us":1837,"raft.run_wall_time_us":28398,"spinlock_wait_cycles":76662016,"thread_start_us":389574,"threads_started":1,"wal-append.queue_time_us":545369}
I20260709 12:23:05.406291  9459 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.501367  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.223222  9407 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.503609  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.577616  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.309110  9277 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.309010  9492 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.521234  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:05.304471  9552 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.250244  9419 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.597290  9472 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.534042  9398 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.598292  9419 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.528884  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.599269  3916 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:05.586766  9563 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.532997  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.600211  9563 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.600703  8912 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.602315  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.322235  9235 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.605706  9235 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.494860  9481 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:05.606530  9481 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.607066  9481 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.538805  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.389531  9544 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.613602  9544 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.375684  9494 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.551101  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.541368  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:05.619424  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.621116  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.555073  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.622560  4574 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:05.623924  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.382567  9542 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.490870  9545 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.514288  9384 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.559603  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:05.561309  9293 consensus_meta.cc:287] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.003s
I20260709 12:23:05.231285  9543 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.567673  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:05.311792  9483 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.578521  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:05.577697  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:05.648478  3995 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:05.577659  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.539312  9522 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.517104  9567 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:05.651701  9567 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.652087  9567 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:05.652199  9543 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.640527  9545 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.656152  9545 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.582647  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.521205  9491 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:05.657065  9483 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.657631  9491 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.585765  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.658871  4579 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:05.541215  9551 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.660305  3996 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:05.584329  3998 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:05.416443  9558 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.586287  9282 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.587811  3994 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:05.663621  9277 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.664583  3994 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:23:05.664950  3994 pending_rounds.cc:85] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 8
I20260709 12:23:05.665120  9558 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.665155  3994 pending_rounds.cc:107] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:05.666006  3994 raft_consensus.cc:2889] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.668066  9578 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.668707  9403 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.668642  9578 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.670639  9459 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.671006  9578 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.670718  9551 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.672353  3925 raft_consensus.cc:2368] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14.
I20260709 12:23:05.667613  3995 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:05.673738  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.674944  9505 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.674988  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.676424  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.540795  9554 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.677266  3925 raft_consensus.cc:2410] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:23:05.677313  9461 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:05.677795  9461 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:05.678301  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.678649  9461 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.699540  9461 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:05.626336  3993 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:05.705282  3996 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:05.706703  3996 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:23:05.679342  9554 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.713678  9578 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.713959  9505 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.714504  9505 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:05.647294  3964 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.624s (SENT) [suppressed 22 similar messages]
I20260709 12:23:05.650650  9293 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:05.717190  9569 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.221s	user 0.003s	sys 0.000s
I20260709 12:23:05.718257  9293 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.657889  9522 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.721624  4577 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:05.658067  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.663342  9282 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.593851  9579 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.514729  9547 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.680953  9551 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.725538  9579 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.727975  3992 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:05.684654  9492 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.686501  9407 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.733350  9544 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.693562  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 777) took 1458 ms. Trace:
I20260709 12:23:05.734203  3999 rpcz_store.cc:276] 0709 12:23:04.235391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.639182 (+403791us) service_pool.cc:224] Handling call
0709 12:23:04.639539 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.069125 (+429586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.693145 (+624020us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400390b54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:05.693450 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986521344}
I20260709 12:23:05.736058  3999 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:05.738241  3999 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:05.612882  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.595803  9552 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.714365  9578 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.718700  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3331) took 1770 ms. Trace:
I20260709 12:23:05.742558  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:05.741881  3991 rpcz_store.cc:276] 0709 12:23:03.948332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.124144 (+175812us) service_pool.cc:224] Handling call
0709 12:23:04.178507 (+ 54363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.323705 (+145198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.323750 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.336162 (+ 12412us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.314254 (+978092us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:05.401868 (+ 87614us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.567317 (+165449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.567394 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.716484 (+149090us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:05.718342 (+  1858us) raft_consensus.cc:1685] finished
0709 12:23:05.718468 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.718625 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30330,"prepare.queue_time_us":74183,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":118831,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":16526,"spinlock_wait_cycles":46888832,"thread_start_us":782277,"threads_started":2,"wal-append.queue_time_us":913849}
I20260709 12:23:05.625399  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:05.748605  9542 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:05.749331  9579 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:05.749562  9529 consensus_meta.cc:287] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 12:23:05.750273  9282 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.751001  9282 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.754220  4547 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:05.603178  9563 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:05.667282  9562 consensus_meta.cc:287] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.005s
I20260709 12:23:05.758386  8529 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.756521  9488 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:23:05.756541  9541 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:23:05.750608  9529 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.771874  9529 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.772043  9567 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.773584  4581 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:23:05.756022  9545 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.773536  9522 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.775812  9579 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.799088  9578 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.794044  9579 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.803253  9579 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.532758  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:05.833284  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.498255  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 89812.1us
I20260709 12:23:05.600620  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.571012  3843 raft_consensus.cc:2468] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:05.839870  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.841159  3916 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:05.843713  3918 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 7.
I20260709 12:23:05.844681  3844 raft_consensus.cc:1240] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:23:05.513541  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.845227  3919 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:05.845332  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.842826  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:05.849357  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.847422  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.662781  3924 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:05.679409  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.853912  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:05.852036  3924 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:05.861435  3924 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.864989  3924 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.868981  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:05.871389  3997 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:05.874850  9006 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.876196  9006 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.885532  9059 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:05.886782  9059 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:05.888585  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 124471us
I20260709 12:23:05.842885  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:05.895781  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48047us
I20260709 12:23:05.896121  9006 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.897189  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.897491  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.897972  8529 consensus_queue.cc:1059] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:05.898619  9059 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:05.901043  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.901295  9243 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.885694  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:05.906368  3920 raft_consensus.cc:2393] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:05.913401  9371 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:05.914083  9371 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.914677  9371 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:05.756737  9282 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.915858  9554 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.913959  9510 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:05.916676  9554 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.917311  9510 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.776799  9398 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:05.920943  9510 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.923979  3848 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:05.913440  9407 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:05.925343  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:05.925933  9554 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.926904  9579 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:05.927783  9579 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.937781  9567 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:05.939942  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.941311  3847 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:05.934702  9579 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.946483  8529 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:05.947023  8529 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:05.948735  8529 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.789381  9545 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:05.797271  9547 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.964438  3845 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:23:05.956128  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:05.955597  9279 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:23:05.984392  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 98895.6us
I20260709 12:23:05.955401  9545 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.955478  9282 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:05.956248  9578 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:05.964573  9494 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:05.990844  9407 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:05.993474  9566 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:05.993971  9566 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:05.992930  9578 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:05.992908  3843 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:05.956629  9243 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.003772  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:06.007145  3849 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:05.991178  8581 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.004820  4575 raft_consensus.cc:1217] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Deduplicated request from leader. Original: 6.6->[7.7-9.8]   Dedup: 9.8->[]
I20260709 12:23:06.009523  3924 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:06.009722  4575 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:23:06.004796  4574 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:06.011783  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.012317  9293 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:06.014034  9293 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:06.016558  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:06.017907  9293 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.018687  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:06.007352  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:06.021422  9556 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:06.023778  9243 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.028749  3917 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:06.031570  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.037358  3994 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:06.039270  4575 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:06.039552  3919 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:06.009359  8581 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:06.051659  8529 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:06.054508  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.065678  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:06.074167  3848 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:06.082659  3845 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:06.087617  4582 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:06.087836  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.088712  3841 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:06.068854  8581 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.001151  9566 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.077867  9293 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:06.104362  9243 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.105316  9243 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.081189  9578 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:06.107930  9243 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:06.112859  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 215998us
I20260709 12:23:06.111093  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:06.120101  4583 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:06.122273  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:06.123955  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 405018us
I20260709 12:23:06.118873  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.100327  9407 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:06.130992  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:06.122851  9243 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.132289  9566 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:06.143256  9243 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.143741  9403 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:06.146970  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1409) took 2414 ms. Trace:
I20260709 12:23:06.147064  9243 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.152670  9398 consensus_queue.cc:1059] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:06.153448  9282 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:06.153765  9398 raft_consensus.cc:3055] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:06.154156  9282 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.156893  9282 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.131855  9505 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.154179  9398 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:06.164014  4579 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:23:06.165302  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.164290  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.164448  4579 pending_rounds.cc:85] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 14
I20260709 12:23:06.165195  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.165944  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.166566  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.165874  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.171532  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.170184  4579 pending_rounds.cc:107] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:23:06.172899  4579 raft_consensus.cc:2889] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:06.164954  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.169747  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:06.174649  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 174302us
I20260709 12:23:06.148124  9578 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:06.176291  3922 consensus_meta.cc:287] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.007s
I20260709 12:23:06.176045  9578 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.176826  3922 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:06.177939  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.178902  9578 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:06.176054  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 100745us
I20260709 12:23:06.190519  9243 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:06.180061  3745 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 9 to 11, term changed from 13 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.151655  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.164573  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.193933  3845 raft_consensus.cc:2410] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:23:06.147699  3924 rpcz_store.cc:276] 0709 12:23:03.732798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.740216 (+  7418us) service_pool.cc:224] Handling call
0709 12:23:03.740841 (+   625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.662676 (+1921835us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400212da0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296adc0 00007fdc529f51c0 00007fdc529f6231 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c
0709 12:23:06.013325 (+350649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.146611 (+133286us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400331154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:06.146868 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4129790592}
I20260709 12:23:06.203100  3745 catalog_manager.cc:5697] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.205446  3745 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.207975  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.208485  4582 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:23:06.200480  3921 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.533s	user 0.017s	sys 0.001s
I20260709 12:23:06.208858  8581 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.211982  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.212919  3845 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:06.213115  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:06.214066  9578 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:06.214272  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.214586  9578 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.215101  9578 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.215533  9505 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.215895  3745 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 9, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:06.218691  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.218349  3745 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.220125  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.226460  3923 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:06.198623  9243 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.164114  9398 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.236840  3921 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:06.243371  3850 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:06.230778  9243 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:06.252540  3841 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:06.234253  9505 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.262506  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40578 (request call id 3261) took 1035 ms. Trace:
I20260709 12:23:06.262953  3921 rpcz_store.cc:276] 0709 12:23:05.224924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.492693 (+267769us) service_pool.cc:224] Handling call
0709 12:23:06.255018 (+762325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.264384  3745 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 7 to 8, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:06.267598  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49068us
I20260709 12:23:06.271683  3962 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.270159  9488 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 12:23:06.273742  9481 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.012s
W20260709 12:23:06.274201  9461 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.005s
I20260709 12:23:06.274358  9481 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.274901  3847 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
W20260709 12:23:06.276228  3746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 268) took 19969 ms (client timeout 15000 ms). Trace:
I20260709 12:23:06.276964  9481 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.279191  9398 raft_consensus.cc:3060] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:06.280059  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.281997  9541 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:06.282416  9541 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:06.283605  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:06.285557  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:06.287775  9489 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:06.288722  8529 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:06.289196  8529 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:06.289345  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:06.290262  9545 raft_consensus.cc:2804] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:06.290747  3962 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.290390  8529 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.288223  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2623) took 1076 ms. Trace:
W20260709 12:23:06.297760  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 74689.3us
I20260709 12:23:06.291706  3923 rpcz_store.cc:276] 0709 12:23:05.211359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.048706 (+837347us) service_pool.cc:224] Handling call
0709 12:23:06.287987 (+239281us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b540024f754. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:06.288155 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226234240}
I20260709 12:23:06.301913  8581 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.303124  9563 raft_consensus.cc:2764] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:06.304131  3745 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 5 to 6, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:06.306097  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.291096  9545 raft_consensus.cc:697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:06.313481  8529 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:06.313750  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:06.316887  4580 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:06.322750  9481 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:06.328927  9481 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:06.330178  9481 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.320602  9282 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.336539  9282 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:06.336968  9282 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.342442  9384 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.344982  9384 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:06.345538  9384 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.349503  9578 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.349931  9545 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:06.352556  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.276767  3746 rpcz_store.cc:269] 0709 12:22:46.306287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.306568 (+   281us) service_pool.cc:224] Handling call
0709 12:23:06.275862 (+19969294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:57.789757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:57.790632 (+   875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:57.790702 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:22:57.790747 (+    45us) tablet.cc:662] Decoding operations
0709 12:22:57.792692 (+  1945us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:57.792799 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:57.792843 (+    44us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:22:57.794432 (+  1589us) tablet.cc:701] Row locks acquired
0709 12:22:57.794490 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:22:57.794727 (+   237us) write_op.cc:270] Start()
0709 12:22:57.794912 (+   185us) write_op.cc:276] Timestamp: P: 1783599777794645 usec, L: 0
0709 12:22:57.794956 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:22:57.823601 (+ 28645us) log.cc:844] Serialized 5597 byte log entry
0709 12:22:58.514426 (+690825us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529eee28 00007fdc56429581 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901 00007fdc5642cb2d 0000000000388634 0000000000388479
0709 12:22:59.452105 (+937679us) op_driver.cc:464] REPLICATION: finished
0709 12:22:59.944589 (+492484us) write_op.cc:301] APPLY: starting
0709 12:22:59.944691 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:00.464793 (+520102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:00.465062 (+   269us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:00.965369 (+500307us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5c00195c8c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc58be5331 00007fdc58be5221 00007fdc58bdff6c 00007fdc5634030b 00007fdc5633ffd3 00007fdc5643ee34 00007fdc5642a97c 00007fdc5642ed61 00007fdc5642ed19 00007fdc5642eca9 00007fdc5642ec71
0709 12:23:01.745968 (+780599us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:01.746371 (+   403us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:23:01.746452 (+    81us) write_op.cc:312] APPLY: finished
0709 12:23:01.746911 (+   459us) log.cc:844] Serialized 129 byte log entry
0709 12:23:01.948251 (+201340us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:01.948433 (+   182us) write_op.cc:454] Released schema lock
0709 12:23:01.948511 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:02.024846 (+ 76335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.036370 (+ 11524us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57361,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":431402,"apply.run_cpu_time_us":46972,"apply.run_wall_time_us":2012841,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":166840,"prepare.run_cpu_time_us":61689,"prepare.run_wall_time_us":750927,"raft.queue_time_us":743588,"raft.run_cpu_time_us":23440,"raft.run_wall_time_us":344290,"replication_time_us":1656908,"spinlock_wait_cycles":57103360,"thread_start_us":931294,"threads_started":5,"wal-append.queue_time_us":392331,"wal-append.run_cpu_time_us":33721,"wal-append.run_wall_time_us":3029822}]]}
I20260709 12:23:06.360061  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.361145  9344 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:06.361246  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.361836  9344 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:06.362707  9344 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.363407  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.367332  9448 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.373229  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.374315  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.379110  3847 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:23:06.379585  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.379330  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 56066.6us
I20260709 12:23:06.389099  9448 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:06.396299  9448 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.390805  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.377774  9541 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.396927  9371 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.397641  3849 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:06.398357  9541 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.391121  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.395493  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.398201  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.396723  9448 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:06.377990  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.389191  3846 raft_consensus.cc:2393] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:06.397369  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.391409  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:06.404520  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 79036.9us
I20260709 12:23:06.393951  3842 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:06.406033  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:06.406481  9505 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.407042  9505 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:06.388852  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.391517  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:06.404289  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 101666us
I20260709 12:23:06.409639  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:06.407584  9505 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:06.389529  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.389981  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.319954  9542 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 12:23:06.427774  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.415782  9371 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.431510  9582 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:23:06.433990  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44072.2us
I20260709 12:23:06.442281  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:06.440323  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:06.447492  3993 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:06.412788  9578 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.438130  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.472000  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.411339  9448 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.430521  9488 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.482796  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 53714us
I20260709 12:23:06.478312  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.480933  3998 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:06.484347  9384 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.489759  9578 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.490280  9578 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:06.490722  9578 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.491163  9384 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:06.495642  9597 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:23:06.518553  8529 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:06.523746  3847 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:06.527377  8529 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:06.527181  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:06.545001  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135459us
I20260709 12:23:06.550158  9566 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:06.551805  9566 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:06.552222  9566 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:06.553334  9566 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.554859  9566 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:06.560065  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.565048  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.566077  3844 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.568873  9448 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.570402  9243 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.571928  3841 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:06.573673  9243 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:06.574664  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.499873  9488 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.576846  9488 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.584020  8529 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.587836  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.588625  3844 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:06.590629  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.593639  9344 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.594875  3845 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:06.525102  9398 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:06.600123  9398 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:06.600967  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90240.6us
I20260709 12:23:06.609333  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:06.625491  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.620173  9243 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.652705  3847 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:06.620247  9582 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:06.605084  9344 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:06.602614  9398 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.624255  9384 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:06.619483  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 105845us
I20260709 12:23:06.622596  3845 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:06.660991  3922 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:06.662106  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71557.7us
I20260709 12:23:06.670702  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.676823  3918 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:06.688139  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.684772  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.654553  9282 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.683954  9384 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:06.607832  9505 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.701712  9494 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.703344  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.710676  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.711301  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.661832  9556 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:06.716547  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:06.717525  3921 raft_consensus.cc:2410] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:23:06.719002  3815 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.708348  9582 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:06.722282  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 97505.7us
I20260709 12:23:06.726549  9558 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.726316  9384 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.726984  9558 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:06.730697  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.732445  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:06.721902  9582 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:06.724872  9344 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:06.734719  9407 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:23:06.731628  9558 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.748531  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:06.742379  9582 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:06.780457  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.788954  9578 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.783972  9371 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:06.796010  9371 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:06.797259  9371 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.798967  9371 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:06.801813  3815 leader_election.cc:400] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14.
I20260709 12:23:06.802292  9558 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.803056  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.804260  9344 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:06.804622  9558 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.808579  4579 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:06.811810  9545 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:06.812047  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.813465  9578 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:06.814136  9279 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:06.821956  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.813537  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 70959.7us
I20260709 12:23:06.824843  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.826715  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.827426  9566 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:06.828644  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:06.830777  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.838156  9494 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:06.839301  9282 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:06.847033  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:06.847788  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 64909us
I20260709 12:23:06.852486  9505 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:06.864873  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:06.874985  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46419us
I20260709 12:23:06.872898  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.865792  9344 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.868503  9578 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.877800  8581 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:06.878476  8581 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:06.873265  9371 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.881894  9545 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:06.882375  9545 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:06.882757  9403 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.883332  9403 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.885989  9403 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.887333  9461 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:06.887420  9243 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:06.887811  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:06.888707  9344 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:06.889138  9344 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:06.889187  9578 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:06.891937  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.892083  3844 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:06.895027  4579 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:06.896756  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.896984  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.882771  9545 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:06.897464  9344 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.898921  9344 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:06.899557  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.892819  9578 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.904649  9578 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:06.908361  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.909394  9243 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:06.910080  9371 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:06.890507  9282 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.910977  9371 consensus_queue.cc:1243] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:06.911164  9282 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.911672  9371 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:06.911726  9282 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.912228  9371 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:06.913309  9371 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.914659  9371 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.919425  9243 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:06.920549  9243 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.916340  9505 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:06.926553  9505 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:06.925858  9461 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.927834  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.927739  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:06.927556  9461 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.928754  9505 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:06.930543  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 103975us
I20260709 12:23:06.930819  9461 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:06.931524  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:06.932438  8581 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:06.937901  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:06.938252  9448 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:06.940824  9448 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:06.942484  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.942273  9448 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:06.945978  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68304.8us
I20260709 12:23:06.948498  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:06.949802  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.951223  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:06.962054  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:06.962791  3844 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:06.964154  3842 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:06.996148  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.968227  9579 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:06.938715  9505 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:23:06.938289  9582 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.017066  9611 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:07.023192  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91801.7us
I20260709 12:23:07.030445  3847 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
W20260709 12:23:07.053582  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260709 12:23:07.056331  8529 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.057026  8529 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.013872  9578 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.045310  9611 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.080096  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:07.088224  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.106313  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.105399  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.120198  8529 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:07.123528  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 191762us
I20260709 12:23:07.124363  8581 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:07.124754  8581 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.125100  8581 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:07.073114  9461 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:23:07.118012  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 156879us
I20260709 12:23:07.135627  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.139812  9403 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:07.140471  9403 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:07.140484  3918 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:07.144773  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.148713  3850 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:07.148856  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:07.150012  3924 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:07.122915  9494 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:07.083544  9611 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:07.151907  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.152211  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 90574.1us
I20260709 12:23:07.148881  9293 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:23:07.105217  9243 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:07.158722  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:07.146485  9545 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.162573  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.164687  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.168447  3841 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:07.169795  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.170517  3925 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:07.171173  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:07.171872  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:07.172596  9461 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.173121  9461 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.173952  9243 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:07.174340  9243 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:07.175290  9243 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.154708  9282 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.176802  9243 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:07.177466  9611 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:07.178129  9282 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:07.141584  9403 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.180191  9578 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:07.181095  9582 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.187103  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:07.196527  3925 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:07.202064  8581 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.204162  3924 raft_consensus.cc:2368] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:07.209056  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.209901  3918 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:07.180219  9545 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:07.181594  9461 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.220474  8581 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.227404  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.228585  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:07.232151  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.234819  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.235558  3847 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:07.236651  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:07.237993  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.229238  9494 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:07.239754  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:07.240291  9494 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.240765  9494 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:07.239405  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:07.244357  4580 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:07.245321  9461 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:07.205627  9488 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.260289  9488 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.260712  9621 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:07.261792  9621 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:07.262171  9621 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:07.262732  9488 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.270215  3918 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:07.271409  3924 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: [14.12-15.13]
I20260709 12:23:07.264114  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:07.272605  4575 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:07.269495  3847 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:07.275159  3962 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:07.280529  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 121906us
I20260709 12:23:07.280402  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.278931  9579 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:07.284242  9579 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:07.302860  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.311187  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:07.301497  9243 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:07.314029  9243 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:07.314450  9243 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:07.316332  9629 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:23:07.324987  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:07.263130  9621 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.357039  4575 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:07.301043  9461 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:23:07.280313  9488 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:23:07.326938  9622 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:07.345801  9494 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.328016  9579 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:07.349025  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48812.8us
I20260709 12:23:07.328292  9623 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:07.344698  9448 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:07.379959  9623 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:07.380692  9623 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:07.351810  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.383986  3847 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:07.354221  9558 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:07.337662  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.364780  3844 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:07.367022  3815 leader_election.cc:400] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:07.340394  8529 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.387472  8529 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.368456  9566 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:07.390223  8529 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.370829  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.372387  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.392150  9488 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:07.392678  9488 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:07.392697  3848 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:07.379566  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.380116  9448 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:07.386912  3815 leader_election.cc:403] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:07.397014  9448 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.328647  9628 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.398365  9448 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:07.398521  9628 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.401036  9628 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:07.402194  9622 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:07.403209  9622 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.373884  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.347584  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:07.406234  8581 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:07.406802  8581 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:07.407840  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.393610  9488 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.379642  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:07.414790  3848 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:07.416245  3815 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.406550  3919 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:07.424715  3924 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:07.426517  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.430058  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:07.432442  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:07.432442  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 52926.3us
I20260709 12:23:07.433845  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.434374  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:07.434504  3847 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:07.435484  8581 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.435830  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.433163  3919 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 7.
I20260709 12:23:07.408231  9621 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:07.437565  4581 raft_consensus.cc:2410] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:23:07.445582  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.451243  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.422086  9628 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:07.469288  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.338708  9243 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.431308  9566 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:07.469919  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.432142  9481 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:07.439368  9488 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:07.450915  9541 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:07.457451  9505 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:23:07.508919  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.497643  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:07.442798  9384 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 12:23:07.510692  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63417us
I20260709 12:23:07.492998  9344 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:07.503427  9566 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:07.495203  9541 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.497319  9481 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:07.504403  9505 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:07.497488  9613 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
W20260709 12:23:07.545425  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47883.2us
I20260709 12:23:07.521726  9344 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.548381  9344 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:07.550432  9566 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.551599  9423 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:23:07.544729  9505 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:07.542814  9541 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:07.564764  9344 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.567086  9344 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.567554  9579 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.568075  9579 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:07.568423  9505 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.571152  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.573626  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:07.594897  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96828us
W20260709 12:23:07.569214  9632 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:23:07.600080  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.598680  3925 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:07.568455  9579 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:07.610070  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.597321  9563 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.614188  9494 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:07.628471  9633 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:07.619192  9481 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.635555  4548 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:07.643253  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48569.6us
W20260709 12:23:07.650048  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.657408  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:07.657385  9293 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:07.696965  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:07.618403  9563 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.696295  9293 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.706643  9293 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.710259  9623 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.712838  9243 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:07.715905  9505 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:07.724293  9631 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.305s	user 0.004s	sys 0.000s
W20260709 12:23:07.727761  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 103758us
I20260709 12:23:07.682799  9628 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:07.755347  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:07.756631  9505 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:07.757236  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:07.763612  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.765678  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.766638  3924 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:07.772194  3841 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:23:07.775826  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.776539  3919 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:07.781104  3846 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:07.771885  9505 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:07.784245  9623 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:07.787837  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.788707  3993 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:07.790221  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.791160  3998 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:07.791898  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.792315  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.792677  3997 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:07.793172  3996 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:07.793853  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.794337  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.795058  3999 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:07.790274  3991 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:07.797555  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.760517  9637 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.805490  3924 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:07.811363  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.812096  3993 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:07.814468  3841 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:07.816027  9578 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:07.818233  3850 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:07.819938  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.821033  3992 raft_consensus.cc:2410] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:23:07.827683  9243 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:07.805814  9545 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:07.808255  9398 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.850260  9563 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.807551  9637 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.853358  9637 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.854384  9398 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.856833  9398 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:07.858717  9293 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.872681  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:07.864327  3992 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:07.867093  9243 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:07.867656  3846 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:07.868021  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.868269  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:07.868564  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:07.868695  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:07.883262  3850 raft_consensus.cc:606] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:07.883781  3850 raft_consensus.cc:614] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:07.882613  3845 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:07.892424  4546 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.887080  3815 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:07.885598  9545 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:07.900558  9545 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.905546  9558 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:07.905938  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:07.906615  3993 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:07.908353  9566 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:07.909003  9566 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:07.910004  9566 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:07.891175  9403 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:23:07.947907  4580 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:07.929986  9637 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:07.971197  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.976361  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:07.977052  3919 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.980093  9541 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:07.980980  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.982376  9541 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:07.987375  3919 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:23:08.001624  9279 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.002168  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:08.002238  9279 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.002859  3850 raft_consensus.cc:606] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:08.003237  3850 raft_consensus.cc:614] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:08.004225  9293 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:08.005002  9646 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
I20260709 12:23:08.005167  9279 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:08.006525  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:08.007628  3919 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:08.008090  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84233.5us
I20260709 12:23:08.015754  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:08.016211  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.016477  3848 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:08.017719  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:08.021014  4581 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:08.027474  4581 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:23:08.028084  4581 pending_rounds.cc:85] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 12
I20260709 12:23:08.028441  4581 pending_rounds.cc:107] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 15.13
W20260709 12:23:08.028883  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.028774  4581 raft_consensus.cc:2889] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.030440  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:08.030932  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.031819  3992 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:07.944214  9579 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:07.970335  9637 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:08.038146  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.033221  9403 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:08.041659  9403 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.035912  9637 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:08.028883  9407 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:08.043918  9407 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.044315  9407 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:08.057534  9645 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.278s	user 0.003s	sys 0.001s
I20260709 12:23:08.067582  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.067862  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.068408  3999 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:08.068714  3994 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:08.069327  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.070003  3848 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:08.071067  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.072747  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.071833  3991 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:08.082031  3993 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
W20260709 12:23:08.085592  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.089191  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:08.090094  3992 raft_consensus.cc:1217] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.6->[7.7-9.8]   Dedup: 9.8->[]
I20260709 12:23:08.090700  3992 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:23:08.094159  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.098078  3993 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:08.102341  9647 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 12:23:08.109359  4548 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:08.110175  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 109454us
W20260709 12:23:08.115631  9621 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.003s
I20260709 12:23:08.116353  9542 raft_consensus.cc:2804] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:08.116935  9542 raft_consensus.cc:697] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:08.118023  9542 consensus_queue.cc:237] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.121050  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.121696  3991 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:08.122835  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.123554  3999 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:08.123507  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.125496  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.126118  3997 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:08.128441  3996 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:08.129110  9628 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:08.129835  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.130455  3998 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:08.139956  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:08.141227  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45605.6us
I20260709 12:23:08.147001  3920 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:08.148054  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.158221  9637 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:08.161439  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.166636  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:08.171103  3848 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:08.138724  9407 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.182255  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:08.168094  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:08.177220  3845 raft_consensus.cc:606] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:08.184504  3845 raft_consensus.cc:614] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:08.185839  3815 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:08.176677  9628 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.188005  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.191265  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.193279  3991 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:08.196847  3992 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:08.212143  3993 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:08.259766  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 55209.4us
W20260709 12:23:08.261765  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.264906  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 60769.1us
I20260709 12:23:08.191566  9582 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:08.272395  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.276108  3993 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:08.274003  3998 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:08.200634  9566 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:08.284052  9643 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:08.284559  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.285372  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.301704  3999 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:08.311434  3992 raft_consensus.cc:2393] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:08.312350  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.312577  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:08.316645  3745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 167) took 19069 ms (client timeout 15000 ms). Trace:
I20260709 12:23:08.313060  3991 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:08.315132  3995 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:08.263227  9545 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.335664  3999 raft_consensus.cc:2376] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18. Re-sending same reply.
I20260709 12:23:08.314601  9643 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.337685  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.338400  3995 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:08.250736  9628 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.314368  9582 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:08.264295  9623 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:23:08.325632  9566 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:08.359504  3992 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:23:08.353752  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 170468us
I20260709 12:23:08.367066  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:08.317235  3745 rpcz_store.cc:269] 0709 12:22:49.247426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.247959 (+   533us) service_pool.cc:224] Handling call
0709 12:22:50.447290 (+1199331us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:08.316542 (+17869252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:06.679297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:06.680313 (+  1016us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:06.680384 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:23:06.680412 (+    28us) tablet.cc:662] Decoding operations
0709 12:23:06.681703 (+  1291us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:06.681827 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:06.681870 (+    43us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:06.682835 (+   965us) tablet.cc:701] Row locks acquired
0709 12:23:06.682903 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:23:06.683165 (+   262us) write_op.cc:270] Start()
0709 12:23:06.683380 (+   215us) write_op.cc:276] Timestamp: P: 1783599786683079 usec, L: 0
0709 12:23:06.691853 (+  8473us) op_driver.cc:348] REPLICATION: starting
0709 12:23:06.749980 (+ 58127us) log.cc:844] Serialized 2876 byte log entry
0709 12:23:07.146505 (+396525us) op_driver.cc:464] REPLICATION: finished
0709 12:23:07.247086 (+100581us) write_op.cc:301] APPLY: starting
0709 12:23:07.247205 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:07.259192 (+ 11987us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:07.259330 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:07.454352 (+195022us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:07.454697 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:23:07.454765 (+    68us) write_op.cc:312] APPLY: finished
0709 12:23:07.455157 (+   392us) log.cc:844] Serialized 73 byte log entry
0709 12:23:07.455369 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:07.455511 (+   142us) write_op.cc:454] Released schema lock
0709 12:23:07.455576 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:07.456102 (+   526us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:07.456132 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3626084,"reported_tablets":13,"spinlock_wait_cycles":558526720,"child_traces":[["op",{"apply.queue_time_us":100248,"apply.run_cpu_time_us":14520,"apply.run_wall_time_us":208981,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":226909,"prepare.run_cpu_time_us":13005,"prepare.run_wall_time_us":195645,"raft.queue_time_us":75178,"raft.run_cpu_time_us":12172,"raft.run_wall_time_us":66557,"replication_time_us":454411,"spinlock_wait_cycles":3840,"thread_start_us":258614,"threads_started":4,"wal-append.queue_time_us":129196}]]}
I20260709 12:23:08.342057  9643 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:08.370299  9637 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:08.396301  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78160.5us
I20260709 12:23:08.403227  3994 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
W20260709 12:23:08.400214  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.409456  3992 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:23:08.409940  3992 pending_rounds.cc:85] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 8
I20260709 12:23:08.370697  9579 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.414470  3992 pending_rounds.cc:107] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:23:08.414834  3992 raft_consensus.cc:2889] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.352126  9545 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.415843  4581 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:08.402289  9293 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:08.437278  3847 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:08.446843  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:08.448318  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.448676  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:08.449410  3848 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:08.442487  9651 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 12:23:08.454016  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:08.455554  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46747.1us
W20260709 12:23:08.456739  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.414870  9344 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:23:08.472714  3924 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:08.482556  9658 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:23:08.487911  9644 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:08.454159  9407 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:08.490804  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.491657  3991 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:08.498747  3848 raft_consensus.cc:2468] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:08.497256  9407 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.503252  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.504000  3999 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:08.506229  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.506371  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.506978  3995 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:08.509284  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.509985  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.509193  4546 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:08.512286  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.514043  3993 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:08.505914  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.513025  3992 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:08.515925  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.521059  3997 raft_consensus.cc:2410] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:23:08.516394  3996 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
W20260709 12:23:08.505752  9661 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:23:08.528626  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.445765  9566 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.521725  9489 raft_consensus.cc:2804] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:08.445812  9582 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.516964  9293 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:08.520305  9664 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.503386  9407 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.522570  9644 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:23:08.540613  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.607124  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.607383  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.607846  3999 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:08.607708  9293 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.609016  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:08.604451  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.614836  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.616793  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:08.599071  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:08.618193  3848 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:08.620008  3993 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:08.614008  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.621433  3997 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
W20260709 12:23:08.623167  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.613201  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.629601  3998 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:08.636528  3999 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
W20260709 12:23:08.552616  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.641458  9558 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:08.628278  9489 raft_consensus.cc:697] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:23:08.602221  9656 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.413s	user 0.004s	sys 0.000s
I20260709 12:23:08.643812  9489 consensus_queue.cc:237] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:08.593231  9660 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.404s	user 0.000s	sys 0.004s
I20260709 12:23:08.544199  9628 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.613408  9579 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.646024  9579 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.647104  9407 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.648257  9579 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.592448  9545 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.565492  9403 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:08.598539  9657 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.408s	user 0.003s	sys 0.000s
I20260709 12:23:08.657882  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.658787  3925 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:08.639955  9664 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.661335  9664 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:08.666875  3850 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:08.668462  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.670133  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.542049  3747 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 15 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:08.769150  9667 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.277s	user 0.000s	sys 0.009s
W20260709 12:23:08.770493  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 103946us
I20260709 12:23:08.771037  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.771862  3995 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:08.773655  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:08.774255  3995 raft_consensus.cc:2376] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15. Re-sending same reply.
I20260709 12:23:08.671908  9545 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:08.776453  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:08.776615  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:08.791740  3995 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:08.543111  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:08.823271  3992 raft_consensus.cc:606] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:08.823881  3992 raft_consensus.cc:614] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:08.791898  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 272009us
I20260709 12:23:08.830766  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.789289  3848 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
W20260709 12:23:08.782984  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.803684  3747 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.804499  9545 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:08.793036  9488 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:23:08.844570  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.813539  9643 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:08.846017  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.847745  3919 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:08.835048  3850 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:08.850242  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.850857  3850 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:08.851953  3747 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:08.863029  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.844448  9505 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.875901  9505 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.878441  9505 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:08.881122  3747 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 17, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 17 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:08.888824  9643 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:08.894165  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:08.894915  3846 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:08.902017  3747 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.910246  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:08.909019  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60208us
I20260709 12:23:08.921478  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:08.853727  9621 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:23:08.939530  9558 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:08.940237  9558 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:08.941246  9558 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:08.946612  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:08.881155  9545 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:08.949149  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:09.002873  3889 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.584s (SENT)
I20260709 12:23:08.909304  9461 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:23:09.000229  3846 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:08.972643  9407 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:09.004117  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:08.976316  9371 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:09.011220  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 43944.6us
I20260709 12:23:08.989076  9545 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:09.017763  3992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:09.012351  9407 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.009788  9680 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:09.012473  9371 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.036121  9664 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:09.045109  9371 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:09.035321  9407 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:09.065901  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.072407  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.074093  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 71257.3us
I20260709 12:23:09.076385  9664 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:09.032109  9545 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.079201  9545 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:09.085783  9623 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:23:09.098348  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.122581  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:09.123201  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:09.123786  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:09.124928  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:09.129334  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:09.116099  9674 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.003s
I20260709 12:23:09.156822  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:09.196972  9684 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:09.064504  9680 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.150372  9669 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.242654  9669 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:09.245208  9669 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:09.246992  9689 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:23:09.243227  9688 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:23:09.265406  9680 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:09.285677  9371 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:09.292856  9407 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.295425  9407 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:09.304702  9682 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:09.312608  9371 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:09.318630  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:09.319425  3918 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:23:09.324314  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 168706us
I20260709 12:23:09.344139  3916 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:09.377185  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.378178  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:09.387229  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:09.393802  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.402948  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:09.403987  3849 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.405671  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:09.406612  3846 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:09.408522  3889 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.846s (SENT)
I20260709 12:23:09.411536  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.416913  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:09.394986  9423 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:09.427610  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.432368  3850 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:09.432561  9423 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:09.433585  9423 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.433982  9697 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:09.437142  3850 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:09.437481  4575 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:09.439734  9670 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:09.441082  9668 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:09.441514  9668 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:09.449396  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:09.456578  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.414758  9623 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:23:09.451717  4574 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:09.542091  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:09.601171  9628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.006s
W20260709 12:23:09.601670  9628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.006s
W20260709 12:23:09.606171  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 153533us
W20260709 12:23:09.609231  3814 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.726s (SENT)
I20260709 12:23:09.444146  9668 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.627365  3846 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
W20260709 12:23:09.646740  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 223766us
W20260709 12:23:09.671732  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.694398  3889 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.681s (SENT)
I20260709 12:23:09.695979  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:09.613453  9488 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 12:23:09.708211  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 108411us
W20260709 12:23:09.713543  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100206us
I20260709 12:23:09.694480  9668 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:09.702705  9689 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:23:09.716341  3888 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:09.719854  9558 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:09.748484  8581 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:09.749722  8581 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:09.750164  8581 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:09.751278  8581 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:09.758432  8581 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.728098  9672 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:09.806674  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.809150  3999 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:09.811486  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.812119  3998 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:09.812057  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.813069  3997 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:09.813954  3993 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:09.826725  9545 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:09.827093  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.827395  9545 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:09.828933  9669 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:09.831882  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.833015  3999 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:09.808372  9672 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:09.838582  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.838815  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.840116  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.844326  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:09.845196  4574 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:09.846232  8581 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:09.846580  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.853631  3997 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:09.859542  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 56348.1us
I20260709 12:23:09.864106  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.864108  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.865094  3999 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:09.808174  9613 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:23:09.866089  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:09.866452  4574 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:09.866111  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:09.854812  9398 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:23:09.869619  4575 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:23:09.872012  9702 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:23:09.873034  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.873835  3993 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:09.874325  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.876637  9398 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:09.877666  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:09.878178  9398 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:09.878559  9398 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:09.879709  9398 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:09.881155  9398 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:09.886636  9545 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:09.874950  4577 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:09.893378  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.913990  3999 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:09.916622  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:09.917397  3999 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.923300  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.889935  9718 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.911979  9697 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:09.940183  3992 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:09.887866  9407 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:23:09.944128  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.951937  3997 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:09.945071  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.953255  3993 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:09.953400  3999 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
W20260709 12:23:09.945793  3849 consensus_meta.cc:287] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.537s	user 0.018s	sys 0.002s
I20260709 12:23:09.956219  3849 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:09.957804  3850 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:09.959717  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 82117us
I20260709 12:23:09.960968  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:09.907222  9698 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:23:09.984179  9701 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:23:09.988471  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:09.989931  3996 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:09.990114  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:09.991179  3994 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:09.991897  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.992786  3991 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:09.995867  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:09.996750  3998 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.001317  3996 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:10.009656  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.012300  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.012964  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.017313  3991 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:10.022267  3991 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:10.000808  3999 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:10.024132  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.024798  3999 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:10.025657  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.026820  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:09.938859  9697 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.033453  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:10.037689  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 76872.2us
I20260709 12:23:10.033345  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.027388  3999 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:10.057682  3993 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:10.033388  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.059734  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.060012  3996 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:10.060374  3999 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:10.043848  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.064733  3998 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.067849  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.040684  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.069128  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.069809  3994 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:10.072135  4575 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:23:10.069876  3995 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:10.073649  3991 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:23:10.072126  3814 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.760s (SENT)
I20260709 12:23:10.077160  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.077873  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:10.078359  3814 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.975s (SENT)
I20260709 12:23:10.080344  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:09.939273  9718 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.042606  9683 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.081313  9664 raft_consensus.cc:2764] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 12:23:10.101002  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.101881  3997 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.102918  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.078830  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:09.931739  9672 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.092219  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.099145  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.108362  3999 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13. Re-sending same reply.
I20260709 12:23:10.109627  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.110978  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.111815  3999 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:10.066675  9697 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.115432  3990 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.120265  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.122617  9726 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.123107  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.123775  3990 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:10.127825  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.128564  3999 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:10.131086  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.131361  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.148475  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.152700  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.152948  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:10.156399  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 99053.2us
I20260709 12:23:10.157579  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.159770  3993 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:10.160915  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.161717  3995 raft_consensus.cc:3060] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:10.162423  3997 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.163739  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.164101  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.163753  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.165383  3997 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:10.166255  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:10.167625  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.168329  3993 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
W20260709 12:23:10.169251  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 90927.5us
I20260709 12:23:10.147238  9683 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:10.172978  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.173053  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.174610  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.174675  3993 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 12: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:10.176570  4547 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.568s (SENT)
I20260709 12:23:10.177049  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:10.177218  3814 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.846s (SENT)
I20260709 12:23:10.177709  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.173913  3997 raft_consensus.cc:2376] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18. Re-sending same reply.
I20260709 12:23:10.180030  3996 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:10.180768  3999 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:10.181149  3997 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:23:10.172070  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 97102.6us
W20260709 12:23:10.182317  3814 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.924s (SENT)
I20260709 12:23:10.163787  9727 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:10.182749  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.182899  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.184722  3997 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:10.178251  3993 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:10.185063  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:10.185185  3814 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.976s (SENT)
I20260709 12:23:10.188647  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.189836  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.170960  9714 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:10.187294  9398 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.205120  9371 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.205206  9579 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.176146  9556 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:10.206369  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.206805  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.182873  9715 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:10.208369  4547 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.888s (SENT)
I20260709 12:23:10.179318  9680 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.206070  9556 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.219799  9556 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.183840  9566 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:10.209884  9720 consensus_queue.cc:1059] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:23:10.190600  9613 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:10.178979  9692 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:23:10.244684  3841 raft_consensus.cc:1240] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:10.246495  9692 consensus_queue.cc:1243] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:10.210351  9708 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:23:10.178846  9664 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:10.248494  9708 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:10.248960  9708 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:10.210435  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.252030  9715 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:10.206660  9545 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:10.215248  9718 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.253158  9697 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:10.254406  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 47706us
I20260709 12:23:10.228298  3990 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:10.242456  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45208 (request call id 32) took 1237 ms. Trace:
I20260709 12:23:10.261575  3995 raft_consensus.cc:2468] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:23:10.263672  3999 raft_consensus.cc:1275] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:10.260848  3992 rpcz_store.cc:276] 0709 12:23:09.005463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.005638 (+   175us) service_pool.cc:224] Handling call
0709 12:23:10.242269 (+1236631us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54003507d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529ed853 00007fdc579bb60a 00007fdc50f417d4 00007fdc50f41762 00007fdc50f41691 00007fdc50f4160c 00007fdc50f408c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:10.242363 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093106048}
W20260709 12:23:10.272409  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 66096.5us
I20260709 12:23:10.274339  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.217060  9727 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:10.217764  9407 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:10.277469  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46518.5us
I20260709 12:23:10.282485  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:10.284236  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:10.286391  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.262923  9664 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.293040  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.295499  9708 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.291009  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:10.302630  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.260067  9725 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:10.280953  9727 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.312788  8581 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:10.280133  9720 consensus_queue.cc:1243] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:10.309059  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.301990  9683 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:23:10.311065  9669 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.307194  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:10.311677  9710 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:10.307994  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:10.323606  9710 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.324096  9710 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.324782  9721 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:10.325240  9721 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:10.325388  3814 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.160s (SENT)
I20260709 12:23:10.326030  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.283011  9407 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:10.293835  9672 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:10.281997  9566 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.302237  9713 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:23:10.327778  9566 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.290836  9545 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:10.307297  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:10.321039  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.325592  9721 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.301254  9664 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.312013  9708 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.317155  9727 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:10.347086  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.343540  9672 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:10.346882  9664 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.352170  3991 raft_consensus.cc:3055] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:10.352743  3991 raft_consensus.cc:740] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:10.352114  9672 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.353960  3991 consensus_queue.cc:260] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.355156  3991 raft_consensus.cc:3060] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.330603  9407 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.360438  9407 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.371686  8581 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.372541  8581 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.373980  3991 raft_consensus.cc:1275] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:10.319569  9371 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:10.338353  9611 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:10.392789  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51612.1us
I20260709 12:23:10.396447  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.342758  9698 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:10.416863  8581 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:10.420800  8581 raft_consensus.cc:2764] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:23:10.346124  9613 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.426358  9613 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.429050  9613 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:10.431093  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.436173  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.437574  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.447604  8581 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:10.448027  8581 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:10.448066  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 163886us
I20260709 12:23:10.448504  8581 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:10.417480  9683 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:10.451871  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:10.454670  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.466378  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.468410  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:10.473587  9739 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:10.473407  8581 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.448648  9735 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:10.477538  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.480023  9566 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:10.461555  9714 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:23:10.432351  9371 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.488919  9371 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:10.453662  9683 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.490006  9683 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.494946  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.476289  8581 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.454159  9698 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:10.501644  8581 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.491881  9697 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.515059  8581 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:10.521822  3841 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:10.501183  9727 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:10.523635  9542 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:10.525826  9727 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:10.526978  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 70108.7us
I20260709 12:23:10.527848  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.500217  9698 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:10.576428  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.593454  3814 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 2.223s (SENT)
I20260709 12:23:10.594146  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:10.575614  9730 log.cc:927] Time spent T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:10.539759  9698 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:10.607856  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 76013us
W20260709 12:23:10.610854  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 69287.4us
W20260709 12:23:10.624099  9628 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:23:10.629129  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 162831us
I20260709 12:23:10.629896  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.634235  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.606786  9556 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.628157  9566 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.639317  9556 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.639935  9566 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.613090  9713 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.642234  9566 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.627843  9664 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.644310  9664 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.646337  9714 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:10.646636  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 169181us
I20260709 12:23:10.647409  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.648717  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.652485  9735 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.656642  9545 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:10.658202  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.658859  3993 raft_consensus.cc:2376] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16. Re-sending same reply.
I20260709 12:23:10.659219  3994 raft_consensus.cc:1240] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:23:10.659920  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.660518  3997 raft_consensus.cc:2376] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13. Re-sending same reply.
I20260709 12:23:10.660799  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.661887  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.662317  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.662490  3997 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:10.673439  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43621.2us
I20260709 12:23:10.674252  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.603381  9721 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.678653  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.680523  9672 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:10.681411  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:10.682961  9461 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:10.683620  9461 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:10.684705  9461 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.689070  9721 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.690201  9747 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:10.690763  9747 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:10.691962  9747 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.681437  9622 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:23:10.703390  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.686801  9683 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.706216  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.705533  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.720692  3916 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:10.707702  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:10.709055  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.721582  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.722133  3921 raft_consensus.cc:2410] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:10.695612  9566 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:10.712440  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:10.673313  9398 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:10.729027  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:10.729187  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.723541  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.724120  3993 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:10.732441  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:10.724865  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.735671  3916 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:10.726226  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.736265  3996 raft_consensus.cc:2376] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19. Re-sending same reply.
I20260709 12:23:10.726528  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.728307  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.737905  3922 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:10.730206  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.738454  3999 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17.
I20260709 12:23:10.740322  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.741837  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:10.744448  3992 raft_consensus.cc:2393] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.745867  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:10.747053  9718 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.742753  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.756604  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.757884  3916 raft_consensus.cc:2410] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:10.781718  9724 consensus_queue.cc:1048] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:10.782631  9724 consensus_queue.cc:1243] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:10.782419  9623 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:10.783391  9623 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:10.785202  9623 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:10.785670  9683 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:10.786571  9488 consensus_queue.cc:1048] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:10.728859  9398 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.788429  9398 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.790067  9719 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:10.790547  9719 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:10.734812  9668 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:10.791909  9668 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:10.792101  3815 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.537s (SENT) [suppressed 57 similar messages]
I20260709 12:23:10.792346  9668 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.793299  9613 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:10.794231  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49223.1us
I20260709 12:23:10.791435  9719 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.796720  9719 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.809454  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.829459  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.830719  3995 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.835237  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:10.837152  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.855507  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:10.856235  3993 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:10.858414  3990 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:10.862551  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.866629  3924 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:10.868425  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:10.787143  9623 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 12:23:10.748302  9293 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:10.879530  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.882676  3997 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:10.754570  9713 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:10.890787  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:10.895772  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.898591  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.881632  9749 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:10.881287  9293 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.910223  3924 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:23:10.907872  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.917423  3994 raft_consensus.cc:2376] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8. Re-sending same reply.
I20260709 12:23:10.905745  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.914827  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.920332  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.937949  9623 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.938666  9623 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.939579  9749 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:10.941560  9710 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260709 12:23:10.942077  9710 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:10.892128  9713 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:10.947896  9713 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.951422  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.952230  3918 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.954869  3843 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:10.961899  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 58440.2us
I20260709 12:23:10.962988  3890 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:10.967124  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.968151  3997 raft_consensus.cc:2376] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14. Re-sending same reply.
I20260709 12:23:10.969736  3993 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:10.987699  3920 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:10.988956  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.990666  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.991848  3994 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 17: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:10.970049  3916 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:23:10.916585  3924 pending_rounds.cc:85] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 11
I20260709 12:23:10.992905  3924 pending_rounds.cc:107] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:23:10.993196  3924 raft_consensus.cc:2889] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.975788  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.977720  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.978135  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:10.978322  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:10.995143  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.996071  3922 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:23:10.996440  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 204361us
I20260709 12:23:10.997403  3849 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:10.996078  3997 raft_consensus.cc:2410] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:23:11.006628  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:11.007714  3994 raft_consensus.cc:2376] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8. Re-sending same reply.
W20260709 12:23:11.008679  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.016986  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:10.959789  9293 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.021721  3995 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:11.020578  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:11.026670  3993 pending_rounds.cc:85] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 10
I20260709 12:23:11.027033  3993 pending_rounds.cc:107] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:23:10.971823  9692 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:11.031328  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.027299  3993 raft_consensus.cc:2889] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.028322  3849 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:10.976323  9556 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:11.041356  3814 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17.
I20260709 12:23:11.056818  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.058312  3918 raft_consensus.cc:2410] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:11.060241  9749 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.060127  9726 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:11.061370  9726 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:11.061753  9726 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.062564  9726 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.064030  9732 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:11.118880  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:11.120484  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68644.3us
I20260709 12:23:11.121448  3922 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:11.130980  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:11.136209  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 72217.8us
W20260709 12:23:11.140637  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 95261.9us
I20260709 12:23:11.150950  3921 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:23:11.152947  3925 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:11.164795  3921 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:11.137588  9726 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.153204  9718 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:11.186313  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46515.8us
W20260709 12:23:11.172547  9698 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
I20260709 12:23:11.179955  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.170629  9672 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:11.172832  9710 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.185660  9664 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.247262  3921 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:11.152886  9556 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:23:11.274995  3964 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.624s (SENT)
I20260709 12:23:11.216979  9398 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.291761  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:11.180943  9558 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
W20260709 12:23:11.249420  9753 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.594s	user 0.009s	sys 0.018s
I20260709 12:23:11.287943  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:11.307626  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 155281us
I20260709 12:23:11.215075  9672 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:11.314157  3921 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:11.314708  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:11.315116  9762 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:11.312273  9628 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:11.296314  9708 consensus_meta.cc:287] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.927s	user 0.013s	sys 0.000s
I20260709 12:23:11.291388  9398 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.359175  3925 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:11.373023  3921 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:11.373126  3924 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:11.248219  9668 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.381017  3924 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:11.383303  3916 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:11.212436  9698 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:11.384897  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 183476us
W20260709 12:23:11.394016  3964 leader_election.cc:336] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Timed out: RequestConsensusVote RPC to 127.2.157.66:38799 timed out after 1.710s (SENT)
I20260709 12:23:11.385290  3925 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:11.389487  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 76247.1us
I20260709 12:23:11.409533  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.412923  3921 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:11.417723  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.419951  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.420897  3916 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:11.421644  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:11.423177  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.296627  9664 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.426443  9664 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:11.429616  3918 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
W20260709 12:23:11.434856  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 309726us
W20260709 12:23:11.413972  9767 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:23:11.437983  9719 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.001s
I20260709 12:23:11.489686  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.482440  9725 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:11.500651  9761 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:11.501029  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.502238  3925 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:11.503991  9766 log.cc:927] Time spent T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:23:11.507313  9763 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:23:11.510062  9765 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:23:11.450448  9747 consensus_queue.cc:1059] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:11.513325  9683 raft_consensus.cc:3055] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:11.513805  9683 raft_consensus.cc:740] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:11.526475  9668 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.527858  9778 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:23:11.530618  9757 log.cc:927] Time spent T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:23:11.531129  9566 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
I20260709 12:23:11.532219  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:11.535801  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.536684  3916 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.546627  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:11.549193  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.544046  9778 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.545781  9566 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:11.553004  9778 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.555498  9717 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.556104  9717 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:11.557871  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 148435us
I20260709 12:23:11.558041  9775 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:11.558373  9717 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:11.558977  9717 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:11.559409  9710 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:11.543352  9725 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:11.561184  9713 consensus_meta.cc:287] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260709 12:23:11.561020  9723 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:11.561623  9713 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.562209  9723 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:11.562600  9723 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.563480  9723 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.564543  9723 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:11.482472  9708 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:23:11.559868  9710 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.562719  3847 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:11.568853  9710 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.569952  9710 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.558828  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.571655  9708 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:11.572876  9708 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:11.573256  9708 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:11.582347  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84731.6us
I20260709 12:23:11.584241  9770 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:11.585784  3815 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:11.587302  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:11.433755  9672 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.589665  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:11.595310  4580 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:11.594029  4577 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:11.597447  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:11.599933  3890 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:11.584282  9708 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.600890  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.601706  9708 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:11.603533  9727 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:11.604122  4574 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:23:11.604508  4574 pending_rounds.cc:85] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 9
I20260709 12:23:11.604722  4574 pending_rounds.cc:107] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:23:11.604945  4574 raft_consensus.cc:2889] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:11.607764  3916 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:11.514833  9683 consensus_queue.cc:260] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.562660  9725 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:11.619647  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.626822  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:11.629916  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.599225  9721 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:11.655403  9772 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:23:11.651413  9725 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:11.662779  9710 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.663672  9778 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:11.665607  9545 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:11.667771  9698 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.669713  9777 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:11.620476  9719 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:11.593765  9637 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
W20260709 12:23:11.680913  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 187807us
I20260709 12:23:11.587963  9461 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 12:23:11.675868  9293 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.001s
I20260709 12:23:11.654083  9672 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:11.628028  9727 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 12:23:11.690531  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79122.1us
I20260709 12:23:11.686288  9683 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:11.694890  9777 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:11.711632  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84887us
I20260709 12:23:11.718047  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:11.716850  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:11.691767  9710 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:11.695844  9293 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.726164  9713 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.728405  4575 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:11.719483  9777 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.731539  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.726948  9713 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:11.734194  9623 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.736677  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.726938  9786 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:11.719467  9461 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:11.740162  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:11.747774  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:11.761849  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:11.724057  9725 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.763942  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.756093  9721 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:11.748805  9713 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:11.753297  9726 consensus_meta.cc:287] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260709 12:23:11.773869  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.776173  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:11.767588  9545 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.812762  9545 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:11.813243  9545 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:11.813665  9545 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:11.824661  9768 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.330s	user 0.002s	sys 0.002s
W20260709 12:23:11.830904  9756 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.521s	user 0.000s	sys 0.002s
I20260709 12:23:11.775166  9293 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.835019  9732 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:23:11.840708  9732 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:11.842705  9558 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:11.843302  9558 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:11.844345  3991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2456) took 1185 ms. Trace:
I20260709 12:23:11.844863  9558 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.844744  3991 rpcz_store.cc:276] 0709 12:23:10.658721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.659718 (+   997us) service_pool.cc:224] Handling call
0709 12:23:10.660013 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.660230 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.660255 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.660762 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.990389 (+329627us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:11.023359 (+ 32970us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.024308 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.024389 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.829872 (+805483us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:11.843984 (+ 14112us) raft_consensus.cc:1685] finished
0709 12:23:11.844097 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.844254 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":644,"prepare.queue_time_us":93163,"raft.queue_time_us":898,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13687,"spinlock_wait_cycles":17310464,"thread_start_us":282563,"threads_started":1,"wal-append.queue_time_us":512484}
I20260709 12:23:11.846263  9558 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.850852  9719 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:11.855695  9719 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.856786  9719 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.858408  9719 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:11.808146  9787 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:11.859856  9787 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:11.860996  9787 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.867805  3922 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:11.870905  9623 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:11.878466  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:11.808759  9780 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:11.776399  9727 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:11.879856  9780 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:11.880890  9780 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.754074  9461 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.881209  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:11.882500  9461 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.883980  9461 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:11.884338  9713 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:11.883942  3841 raft_consensus.cc:2410] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:23:11.885775  9713 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:11.890197  3920 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:11.894310  9729 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:11.894950  9729 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.897444  9729 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:11.899037  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:11.904114  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.907994  9721 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:11.909174  9721 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:11.909605  9721 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:11.910494  9721 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.911960  9721 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:11.916949  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.925220  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:11.926173  3841 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:11.934114  9729 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.964489  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:11.967408  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.969173  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 195365us
I20260709 12:23:11.970242  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:11.937553  9672 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:23:11.973291  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:11.981236  3747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 287) took 18704 ms (client timeout 15000 ms). Trace:
I20260709 12:23:11.949931  9732 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:23:11.972791  9692 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.973258  9708 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:11.987478  9708 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.989255  9717 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:11.990372  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:11.991840  4582 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:11.992547  9708 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.000893  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.001718  3991 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:11.972261  9726 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:12.003381  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.003150  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:12.004069  3993 raft_consensus.cc:2376] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13. Re-sending same reply.
I20260709 12:23:11.968092  9786 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:12.005467  3845 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:11.981963  3747 rpcz_store.cc:269] 0709 12:22:53.277184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.277305 (+   121us) service_pool.cc:224] Handling call
0709 12:23:11.981131 (+18703826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:09.235001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:09.267794 (+ 32793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:09.267855 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:23:09.267877 (+    22us) tablet.cc:662] Decoding operations
0709 12:23:09.268643 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:09.268714 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:09.268743 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:09.269360 (+   617us) tablet.cc:701] Row locks acquired
0709 12:23:09.269384 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:23:09.269556 (+   172us) write_op.cc:270] Start()
0709 12:23:09.269697 (+   141us) write_op.cc:276] Timestamp: P: 1783599789269498 usec, L: 0
0709 12:23:09.269724 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:23:09.270527 (+   803us) log.cc:844] Serialized 2069 byte log entry
0709 12:23:10.091596 (+821069us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800395b60. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:10.252028 (+160432us) op_driver.cc:464] REPLICATION: finished
0709 12:23:10.532297 (+280269us) write_op.cc:301] APPLY: starting
0709 12:23:10.539769 (+  7472us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:10.591022 (+ 51253us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:10.591060 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:10.627222 (+ 36162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:10.635795 (+  8573us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:23:10.651577 (+ 15782us) write_op.cc:312] APPLY: finished
0709 12:23:10.677040 (+ 25463us) log.cc:844] Serialized 57 byte log entry
0709 12:23:10.687884 (+ 10844us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:10.688026 (+   142us) write_op.cc:454] Released schema lock
0709 12:23:10.688079 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:10.688532 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:10.688566 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53541,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":251645,"apply.run_cpu_time_us":9956,"apply.run_wall_time_us":175143,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24997,"num_ops":5,"prepare.queue_time_us":104274,"prepare.run_cpu_time_us":34761,"prepare.run_wall_time_us":390353,"raft.queue_time_us":158114,"raft.run_cpu_time_us":64036,"raft.run_wall_time_us":166096,"replication_time_us":982115,"spinlock_wait_cycles":5001984,"thread_start_us":616640,"threads_started":4,"wal-append.queue_time_us":355566,"wal-append.run_cpu_time_us":24747,"wal-append.run_wall_time_us":1601307}]]}
I20260709 12:23:12.011212  3991 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:12.011581  3993 pending_rounds.cc:85] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 7
I20260709 12:23:12.011888  3993 pending_rounds.cc:107] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:23:12.012126  3993 raft_consensus.cc:2889] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:12.017136  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.022550  3994 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:11.968246  9729 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:11.995944  9714 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.028107  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.029461  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.030530  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.026216  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.015410  9398 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:12.044042  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.046859  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.047672  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.050277  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.050693  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.048413  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.051273  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.054997  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.055928  3919 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:12.055121  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.048949  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.058235  3918 raft_consensus.cc:2376] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12. Re-sending same reply.
I20260709 12:23:12.058375  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.059851  3921 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:12.005623  9692 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.061144  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.062309  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.062388  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.062448  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.063062  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.067368  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:12.068684  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.071086  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.071141  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.072557  3921 raft_consensus.cc:2410] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:12.072906  3918 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:12.070228  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:12.068356  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.076689  3922 raft_consensus.cc:2368] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:12.078152  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.042896  9726 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:12.079248  3994 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:12.074004  3923 raft_consensus.cc:2376] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15. Re-sending same reply.
I20260709 12:23:12.044639  9398 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:12.081627  3994 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:12.082293  3916 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:12.083756  3744 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.085934  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.088307  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.085951  3744 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 12 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.062003  9556 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:12.097289  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:12.125224  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 82752.5us
I20260709 12:23:12.048516  9747 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:23:12.092561  3995 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:12.100539  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.086400  9782 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.148370  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.159807  9777 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.164215  3997 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:23:12.154949  3744 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 13, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:12.097252  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.096042  9735 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:12.099066  9796 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:23:12.161787  9732 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:12.160735  9729 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.124886  9556 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:12.181958  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.194232  3744 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.198009  3997 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:23:12.200310  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52724.1us
I20260709 12:23:12.215193  3924 raft_consensus.cc:2368] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:12.217659  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.218914  3997 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:12.220743  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:12.171756  9672 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:12.199851  9798 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.080080  9786 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.224623  3744 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.221771  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.212970  9739 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.213459  9637 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:12.237618  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:12.193859  9735 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.247121  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:12.209976  9732 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.162793  9782 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.260933  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:12.295312  9801 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:23:12.300791  9810 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.301748  9800 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:23:12.310324  9556 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.314450  9735 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.304621  9545 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.306108  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:12.252367  9729 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:12.306183  9811 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:12.229205  9398 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:12.302774  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65262us
I20260709 12:23:12.364300  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.258725  9798 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.316661  9732 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.319476  3995 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:12.319123  3744 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.321599  3990 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:12.369033  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 127425us
I20260709 12:23:12.323980  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:12.307425  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 60442.9us
I20260709 12:23:12.353897  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:12.354648  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:12.358968  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.370062  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.322060  9623 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:12.396149  3744 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 13 to 17, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 17 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.227303  9726 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.326397  9778 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.351403  9670 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:12.368569  9811 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:12.414377  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:12.431661  3744 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.393504  9787 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:12.559063  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 458621us
I20260709 12:23:12.413003  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.393019  9727 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:12.476928  3994 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.325364  9739 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.355229  9810 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.405499  9398 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:12.573858  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.407146  9780 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:12.574672  3849 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:12.570451  9735 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:12.439613  9579 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:12.603363  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 190453us
I20260709 12:23:12.635869  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.564747  9747 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.606365  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.625689  9739 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:12.611302  9809 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:23:12.614113  9713 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.000s
I20260709 12:23:12.615718  9628 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:12.435380  9670 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.616905  9637 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:12.410998  9719 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 12:23:12.617784  9810 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.618135  9811 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.619040  9777 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.406592  9692 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.576417  9725 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:12.639868  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:12.610010  9808 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:23:12.642542  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.645987  3744 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 11, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:12.657001  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:12.626427  9727 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.639768  9545 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:12.651226  9816 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:12.750494  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 108049us
I20260709 12:23:12.751405  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:12.726388  4549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.001s	sys 0.017s
I20260709 12:23:12.669755  9637 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.649945  9558 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:12.676981  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:12.669955  9787 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:12.650034  9579 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:23:12.752810  4549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.001s	sys 0.017s
I20260709 12:23:12.754236  3744 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 11 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 16 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.644872  9747 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.753507  3845 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:12.638612  9780 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.758173  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.745777  9556 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:12.769140  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.746338  9725 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.770958  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.771934  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:12.772382  9725 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.772867  9812 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.773589  9812 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:12.774327  9725 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:12.765220  3744 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.776821  3744 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.727139  9729 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:12.780211  9729 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.782632  9729 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:12.784696  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.786070  9725 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.775337  9812 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:12.786742  9812 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.787098  9812 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.787906  9824 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:12.789795  9822 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:12.790195  9824 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:12.791433  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.792426  9822 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:12.794875  9623 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.795356  9623 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.797641  9623 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.778703  3744 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 7 to 8, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.800210  4575 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:12.800580  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:12.801245  4581 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.802785  3744 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 17, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 17 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:12.800415  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:12.808717  4581 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:12.809233  3744 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:12.811517  3890 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:12.813995  9732 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.817863  3744 catalog_manager.cc:5697] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 13, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 13 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.746443  9782 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.645195  9735 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.730124  9698 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:23:12.842782  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.844175  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.845297  3919 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:12.846675  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:12.847208  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.847314  3921 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:12.848417  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.759883  9672 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:23:12.769023  9805 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 12:23:12.844767  3925 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:12.837415  3744 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 5 to 6, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 6 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.855428  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:12.761439  9692 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:12.863798  3916 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:12.863929  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 52530us
I20260709 12:23:12.867530  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:12.870925  9729 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:12.873565  3890 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:12.874980  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.900621  9727 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.900756  9810 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:12.901477  9810 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:12.902326  9398 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:12.902936  9398 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.903743  9732 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.904376  9732 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:12.906947  9820 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:23:12.876042  9821 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:23:12.877732  9782 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:12.911121  9670 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.911633  9782 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.912187  9782 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:12.913901  9798 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:12.878870  9719 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:12.881244  9735 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.917243  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:12.757655  9558 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.894428  9710 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:12.897740  9812 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:12.915983  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.916463  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:12.888808  9780 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:12.920432  3921 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:12.866751  3744 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.902586  9810 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:12.942119  3921 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:12.947022  3744 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 6 to 9, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 9 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.916639  9719 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.953418  3744 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 7 to 10, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 10 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.959800  3925 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:12.945577  3921 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:12.964040  3921 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:12.987299  3744 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 10 to 11, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:12.939706  9710 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:12.993959  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 52428.6us
W20260709 12:23:12.994313  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 354485us
I20260709 12:23:12.995112  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.002096  3744 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:13.004176  3744 catalog_manager.cc:5697] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:12.987828  9719 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.046123  3744 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 13 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:13.048399  9637 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.050812  9637 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.044780  9683 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.052073  9683 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.055068  9683 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.055820  4581 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:13.057710  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.058485  4582 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:13.063395  9398 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:13.066184  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 48625us
I20260709 12:23:13.066243  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:13.068502  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.009961  9729 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.074162  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.076956  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.077692  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.078567  3921 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:23:13.084090  3921 pending_rounds.cc:85] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 9
I20260709 12:23:13.084131  3846 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:13.084527  3921 pending_rounds.cc:107] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:23:13.084806  3921 raft_consensus.cc:2889] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.118956  9780 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.119694  9780 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.121899  9780 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.083468  3847 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
W20260709 12:23:13.072996  9821 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:13.124393  9672 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:13.124804  9672 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.125159  9672 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.125065  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:13.125716  3996 raft_consensus.cc:606] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.126057  3996 raft_consensus.cc:614] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:13.002609  9579 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:13.128262  9817 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:23:13.144259  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 66919.6us
W20260709 12:23:13.191851  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.192997  9637 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.065398  9830 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.193600  9637 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:13.184782  9836 log.cc:927] Time spent T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:23:13.212366  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65271.8us
W20260709 12:23:13.079010  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 83970.1us
I20260709 12:23:13.239588  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.237010  3888 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:13.250283  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:13.251149  3996 raft_consensus.cc:606] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.251592  3996 raft_consensus.cc:614] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:13.237485  9721 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 1.314s	user 0.013s	sys 0.001s
I20260709 12:23:13.259470  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:13.210593  9829 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.211871  9828 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.213994  9398 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.123711  9719 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.238993  9749 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.185330  9729 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.305540  9840 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:13.308449  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 49086.9us
I20260709 12:23:13.258279  9683 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.296619  9692 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:13.316097  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
W20260709 12:23:13.317389  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.309620  3964 leader_election.cc:400] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:13.317857  3847 raft_consensus.cc:606] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:13.318041  3964 leader_election.cc:403] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:13.211901  9710 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.240550  9830 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.328037  9558 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.303222  9398 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.330771  9724 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.333454  9729 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.334381  9729 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:13.335558  9841 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:13.336671  9848 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.331410  9724 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.337399  9848 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.340130  9710 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.341150  3844 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 21.
I20260709 12:23:13.343492  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2690) took 1341 ms. Trace:
I20260709 12:23:13.303737  9828 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.343829  3844 rpcz_store.cc:276] 0709 12:23:12.001622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.002810 (+  1188us) service_pool.cc:224] Handling call
0709 12:23:13.343067 (+1340257us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540011bcd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:13.343210 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3003092352}
I20260709 12:23:13.344972  9719 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.346153  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2691) took 1344 ms. Trace:
I20260709 12:23:13.346230  9828 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.346596  3849 rpcz_store.cc:276] 0709 12:23:12.001997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.002161 (+   164us) service_pool.cc:224] Handling call
0709 12:23:12.002527 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.630037 (+627510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.345844 (+715807us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540008e3d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:13.346068 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313354624}
I20260709 12:23:13.264091  9780 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.349570  9834 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.350281  9834 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.351608  9637 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.352469  9735 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:13.353471  9714 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 1.317s	user 0.007s	sys 0.005s
I20260709 12:23:13.308303  9749 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:13.357919  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.358911  3841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2684) took 1379 ms. Trace:
I20260709 12:23:13.359799  9812 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.360354  9747 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.361071  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3425) took 1275 ms. Trace:
I20260709 12:23:13.319598  9692 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.364058  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.313688  9628 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.360291  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2689) took 1299 ms. Trace:
I20260709 12:23:13.381784  3924 rpcz_store.cc:276] 0709 12:23:12.062725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.062840 (+   115us) service_pool.cc:224] Handling call
0709 12:23:13.360008 (+1297168us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000465d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:13.360166 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327328640}
I20260709 12:23:13.378782  3990 rpcz_store.cc:276] 0709 12:23:12.088185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.135173 (+ 46988us) service_pool.cc:224] Handling call
0709 12:23:12.161203 (+ 26030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.373023 (+211820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.360808 (+987785us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400392454. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:13.361004 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368394112}
I20260709 12:23:13.327209  9830 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.376430  3841 rpcz_store.cc:276] 0709 12:23:11.979501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.980450 (+   949us) service_pool.cc:224] Handling call
0709 12:23:11.980811 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:12.086287 (+105476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.086324 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:12.139082 (+ 52758us) log.cc:844] Serialized 52 byte log entry
0709 12:23:12.632861 (+493779us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:12.632921 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.358453 (+725532us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b540008e8d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:13.358510 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.358559 (+    49us) raft_consensus.cc:1685] finished
0709 12:23:13.358571 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.358839 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25507,"raft.queue_time_us":38852,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11708,"spinlock_wait_cycles":142049024,"thread_start_us":410175,"threads_started":1,"wal-append.queue_time_us":530794}
I20260709 12:23:13.335026  9729 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:13.384323  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61212us
I20260709 12:23:13.386121  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.387610  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:13.398104  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:13.383121  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 194859us
I20260709 12:23:13.391558  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:13.399197  3846 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.392058  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.397894  3842 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 21.
I20260709 12:23:13.377498  9714 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.403033  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:13.312252  9840 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.372134  9782 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.430342  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.385347  9799 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.374269  9683 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.383591  9692 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:13.440212  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3431) took 1304 ms. Trace:
W20260709 12:23:13.440131  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 119640us
I20260709 12:23:13.454028  3846 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:13.451746  3994 rpcz_store.cc:276] 0709 12:23:12.135393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.167235 (+ 31842us) service_pool.cc:224] Handling call
0709 12:23:12.167843 (+   608us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:23:12.192367 (+ 24524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.192399 (+    32us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:23:12.234477 (+ 42078us) log.cc:844] Serialized 634 byte log entry
0709 12:23:12.372471 (+137994us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:12.642955 (+270484us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.956232 (+313277us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.067662 (+111430us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.406929 (+339267us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b1800386560. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f880c0a 00007fdc58fc0219 00007fdc4f908a40 00007fdc4f9034e4 00007fdc4f903455 00007fdc563eb3c7 00007fdc529fd9a7 00007fdc52a0d0bf 00007fdc52a0d038
0709 12:23:13.407282 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.439799 (+ 32517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.439896 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.439942 (+    46us) raft_consensus.cc:1685] finished
0709 12:23:13.439949 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.440146 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219048,"prepare.queue_time_us":255396,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":176601,"raft.run_cpu_time_us":632,"raft.run_wall_time_us":79487,"spinlock_wait_cycles":132803072,"thread_start_us":321695,"threads_started":2,"wal-append.queue_time_us":355370}
I20260709 12:23:13.457554  3995 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:13.458904  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:13.434590  9670 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:13.436071  9727 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:13.464378  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.468705  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:13.485355  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:13.486472  9840 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.445243  9398 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.498937  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.504804  9729 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.505720  9729 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.506400  9729 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.487918  9811 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:13.508248  9749 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.495012  9727 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:13.509829  9727 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.466985  9670 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:13.514952  9670 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:13.465214  9827 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:13.515547  9808 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:23:13.515867  9827 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.489934  9715 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:13.518105  9827 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.462198  9810 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.520001  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.521162  9732 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.522109  9714 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.522977  9461 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:13.522754  9714 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.523469  9683 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.523795  9840 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.524348  9840 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.524832  9819 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.525285  9714 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.525523  9782 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.525383  9819 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.526396  9840 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.523474  9461 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.532080  9461 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:13.463073  9852 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.518894  9810 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.464540  9799 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.523619  9628 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.537544  9852 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.564459  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.566103  9729 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.584208  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.585068  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.585923  3918 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:13.538730  9848 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.545679  9829 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.568703  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.531096  9672 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.572819  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:13.562341  9803 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.822s	user 0.002s	sys 0.018s
I20260709 12:23:13.457203  9832 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:13.572654  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:13.578068  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.582676  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.609733  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:13.623818  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51230.5us
I20260709 12:23:13.579749  9669 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.626264  3842 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:13.604404  9819 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.632541  9714 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.633123  9714 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.633783  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.636255  9852 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.584345  9628 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.637187  9668 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.616417  9735 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:13.619797  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.642027  3919 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:13.617324  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.628525  3888 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:13.629873  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:13.642891  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 190675us
I20260709 12:23:13.643748  3849 raft_consensus.cc:2410] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:13.630525  9669 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.636358  9829 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.610971  9672 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.638230  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.638828  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 830) took 1432 ms. Trace:
I20260709 12:23:13.639858  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.644132  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.644421  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:13.644843  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.648062  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:13.646795  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 182523us
I20260709 12:23:13.649092  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:13.650264  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.684965  4575 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:13.688131  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.691617  3846 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:23:13.693497  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:13.694329  4579 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.695530  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.696918  3925 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:13.671998  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.698536  3919 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:13.702297  9669 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.703743  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.704484  3918 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:13.705924  9781 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:13.706501  9781 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.706935  9781 raft_consensus.cc:3060] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.709277  9461 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.710119  9735 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:13.710989  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 86386.8us
I20260709 12:23:13.710796  9735 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.688107  9829 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.712857  9776 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:13.713217  9735 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.713402  9776 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:13.713701  9829 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.714475  9776 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.693694  9822 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.716078  9822 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.647161  9692 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.720495  9692 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.721280  3924 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:13.724097  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.686617  3997 rpcz_store.cc:276] 0709 12:23:12.206362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.413867 (+207505us) service_pool.cc:224] Handling call
0709 12:23:12.478471 (+ 64604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.626789 (+148318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.626822 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:12.635043 (+  8221us) log.cc:844] Serialized 26 byte log entry
0709 12:23:12.762135 (+127092us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:12.849281 (+ 87146us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.849508 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.619705 (+770197us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540002ec54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:13.619755 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.619801 (+    46us) raft_consensus.cc:1685] finished
0709 12:23:13.638586 (+ 18785us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.638758 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5205,"prepare.queue_time_us":150219,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":11201,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":60640,"spinlock_wait_cycles":340160384,"thread_start_us":43281,"threads_started":1,"wal-append.queue_time_us":407955}
I20260709 12:23:13.726495  9461 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.642169  9398 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:13.727736  9398 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.728253  9398 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:13.700533  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.738077  4581 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:13.737447  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:13.743026  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.745049  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.689198  9780 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.750150  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.646580  9778 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.747099  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.646442  9799 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.758209  9862 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.704176  9749 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:23:13.781584  9747 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.781869  9749 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:13.782277  9749 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:13.752614  9811 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:13.782932  9811 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:13.782969  9810 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.783257  9749 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.783918  9811 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.784650  9749 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.784896  9822 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.786484  9724 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.764833  9780 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.766916  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a268ae9485472a8208827344502203"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:13.779104  9862 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.768736  9714 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.770510  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.791309  3997 raft_consensus.cc:606] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.801573  3997 raft_consensus.cc:614] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:13.789978  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.802376  4581 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:23:13.792773  9780 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.808991  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.772868  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:13.798030  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.799237  3995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3433) took 1618 ms. Trace:
I20260709 12:23:13.809784  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:13.810497  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:13.796343  3925 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:13.813089  3842 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:13.811865  3995 rpcz_store.cc:276] 0709 12:23:12.181135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.396041 (+214906us) service_pool.cc:224] Handling call
0709 12:23:12.396366 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.458019 (+1061653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.798974 (+340955us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003e1554. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:13.799175 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430318976}
I20260709 12:23:13.813364  3847 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:13.816094  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:13.768404  9670 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:13.819473  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.827836  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55134us
I20260709 12:23:13.829278  3814 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.769407  9778 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.833186  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.812402  9558 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.803884  9847 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:13.843407  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:13.844030  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.812600  9692 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:13.844686  3999 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:13.844054  3992 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.841197  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.846603  3990 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:13.835646  4579 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:13.839339  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.835851  9866 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:13.840049  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:13.842904  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.848327  3996 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:13.849992  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.850875  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.821466  9672 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:13.852075  3995 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:13.852568  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.825784  9840 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.823210  9735 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:13.823540  9832 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.831678  9669 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:13.849432  3890 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:13.790014  9799 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:13.860803  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.858880  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.861536  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.863358  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:13.866987  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.867638  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.867813  3998 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:13.869344  9799 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.870214  9670 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.872011  9708 raft_consensus.cc:993] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:13.872597  9708 raft_consensus.cc:1081] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:13.859365  9692 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.854604  9672 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.875794  9672 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.867012  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.878089  9558 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:13.878641  9558 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:13.879046  9692 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.879513  9558 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:13.884320  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:13.888712  9834 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:13.831836  9461 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:13.889561  9780 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:13.890488  9628 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:13.862999  3847 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:13.899359  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.897075  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.906916  3992 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:13.896936  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:13.983479  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.984369  3999 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:13.931211  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:13.936537  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.985041  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.825505  9822 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:23:13.978752  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:13.989699  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.894043  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:13.990886  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:13.976452  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:13.985874  3992 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:13.986084  3846 raft_consensus.cc:606] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:13.995755  3846 raft_consensus.cc:614] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:13.985888  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2694) took 1887 ms. Trace:
I20260709 12:23:13.826115  9863 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:23:13.848908  9729 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.131s
W20260709 12:23:14.001550  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 70483.3us
I20260709 12:23:13.996690  3923 rpcz_store.cc:276] 0709 12:23:12.086803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.086938 (+   135us) service_pool.cc:224] Handling call
0709 12:23:12.087370 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.089905 (+  2535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.089955 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:12.090581 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:23:12.395173 (+304592us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:13.538228 (+1143055us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800198100. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc563eb3c7 00007fdc529fd9a7 00007fdc52a0d0bf 00007fdc52a0d038
0709 12:23:13.753326 (+215098us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.895239 (+141913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.895328 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.895375 (+    47us) raft_consensus.cc:1685] finished
0709 12:23:13.973978 (+ 78603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.974203 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17042,"prepare.queue_time_us":854565,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":19952,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":97826,"spinlock_wait_cycles":23913728,"thread_start_us":533373,"threads_started":3,"wal-append.queue_time_us":276311,"wal-append.run_cpu_time_us":6322,"wal-append.run_wall_time_us":1149786}
I20260709 12:23:13.975905  9747 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.012694  3997 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:13.912122  9812 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:14.017590  3996 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:14.020630  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.023234  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.024518  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:13.852803  9847 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.033018  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.033737  3998 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:13.891396  9840 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.003376  9698 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.891628  9735 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.006291  9811 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:14.040185  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.040906  3996 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
W20260709 12:23:14.041806  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 213529us
I20260709 12:23:13.983835  9461 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.049355  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.061247  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.062263  3996 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:14.071581  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.072119  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.072966  3849 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:14.073689  3841 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:14.073856  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.072461  3845 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 12: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:14.019142  9862 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.073007  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.072962  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.076673  3993 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:14.033125  9773 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:13.891219  9832 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.092154  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.090003  3999 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:14.094031  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.045955  9811 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:14.030320  9747 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.026857  9812 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.112039  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.112394  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.112891  3843 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:14.052723  9698 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.101379  9811 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.104398  9628 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:14.139678  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.140516  3998 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:14.146229  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.129333  9628 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:14.156544  3888 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.161405  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.147850  9778 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:14.128446  9398 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.163976  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.165834  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.162130  9628 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:14.177806  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.164615  9810 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:14.179704  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.164389  9776 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.185496  9874 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:14.186785  9865 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:23:14.183012  3999 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:14.191001  9461 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.193624  9781 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.206878  9832 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.207957  9840 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:14.209481  9698 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.210842  9747 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.211834  9735 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:14.212338  9868 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:23:14.217581  3846 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:14.227981  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:14.189509  9869 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:23:14.230928  9865 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:14.232060  9873 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.003s
W20260709 12:23:14.233402  9875 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:14.233564  3992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:23:14.234577  9874 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.237499  9398 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:14.238557  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 344623us
I20260709 12:23:14.239507  9729 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:14.239883  3995 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:14.239719  9810 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:14.240106  9848 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:14.304298  9848 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:14.304944  9810 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.305362  9848 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.306638  9848 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:14.240464  9776 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.307667  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:14.308007  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.238581  9852 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:14.244905  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.315135  3924 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:14.246109  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.247681  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.316442  3923 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:14.316534  3916 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:14.247748  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.248679  9692 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:14.250912  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.252483  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.255268  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.259716  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.319077  3922 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:14.285178  3992 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.279968  9865 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:14.294880  3846 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:14.307737  9776 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.241644  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:14.312160  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.312865  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.212383  9811 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.314002  9727 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:14.328452  9727 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:14.299902  9729 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.329214  9729 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.329947  9847 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.329524  9727 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.330926  9727 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.317449  3925 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:14.319518  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 59953.2us
I20260709 12:23:14.321084  3992 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.333590  9865 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.268064  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.325012  9714 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:14.326690  9776 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:14.327296  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 85727us
I20260709 12:23:14.319689  9747 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:14.326720  9874 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:14.348134  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 80185.2us
I20260709 12:23:14.327343  9828 raft_consensus.cc:2764] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:14.337808  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.338864  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.352072  3919 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:14.318039  9692 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:14.344630  3925 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:14.335278  9865 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.348970  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.353128  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.338912  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:14.384491  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45679.1us
I20260709 12:23:14.382814  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.385584  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:14.352824  3992 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.390430  3815 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.391131  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.317764  9672 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.392463  9772 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:14.397436  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.397948  9772 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.398372  9772 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.395308  9776 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:14.398891  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.403617  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.404395  3842 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:14.404314  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.399631  9545 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:14.351666  9832 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:14.406059  3842 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:14.408495  3964 leader_election.cc:400] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:14.408887  3964 leader_election.cc:403] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:14.374245  9747 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:14.393019  9872 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:14.420289  9852 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:14.420630  9672 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.420779  9852 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:14.428458  9812 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:14.430810  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.434320  9628 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.407658  9874 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:14.409760  9735 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:14.472247  9735 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:14.472707  9735 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.473138  3997 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:14.477190  9628 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:14.382884  9781 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:14.417032  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67925.7us
I20260709 12:23:14.491035  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.496546  3919 raft_consensus.cc:2368] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:23:14.397432  9844 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:14.435487  9840 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:14.498730  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.436868  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.437093  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.507895  3843 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:14.437366  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.509088  3850 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:14.438055  3844 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:14.438426  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.438568  3842 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.442116  9729 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.444150  9747 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:14.445940  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.410646  3925 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:14.456467  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.457526  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.466173  9835 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:14.469202  9811 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.346016  9831 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.470392  9692 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.395241  9794 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:14.479332  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.481603  9735 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.484489  9772 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.477839  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.492288  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.492477  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.494041  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.495128  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.417357  9461 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:14.497225  3845 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:14.499925  3919 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:14.500903  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.499146  3992 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.522171  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.523231  3841 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:14.524323  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.525590  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.538339  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:14.573124  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 47617.1us
I20260709 12:23:14.574271  3923 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:14.574522  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:14.533502  4548 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:14.551257  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:14.537143  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 100356us
I20260709 12:23:14.566650  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:23:14.567378  3916 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
W20260709 12:23:14.579830  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46415.6us
I20260709 12:23:14.579927  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.576200  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.529029  3888 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:14.581398  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52456us
W20260709 12:23:14.581463  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 103753us
I20260709 12:23:14.582510  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.583917  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:14.584056  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.584077  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.584975  9776 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:14.585317  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.588792  3991 raft_consensus.cc:2393] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 11: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:14.585433  9811 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:14.586977  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.536674  9692 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.592761  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.593412  3923 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:14.594234  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.594530  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.594887  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.595623  4581 raft_consensus.cc:2393] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 9: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:14.590040  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.596200  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.596365  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.596805  3998 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 8.
I20260709 12:23:14.530174  9831 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.587468  9714 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:14.597508  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.599086  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.599329  3998 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:14.600518  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:14.648903  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52612.6us
I20260709 12:23:14.649901  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.649354  3991 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:14.582845  9847 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:14.651676  3992 raft_consensus.cc:2410] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:23:14.603497  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.656283  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.581911  9878 raft_consensus.cc:2804] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:14.591831  9776 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.573961  9844 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:14.653252  3925 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:14.594888  3995 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:14.655110  3916 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:14.583477  9461 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:14.657194  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.595573  9811 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.659024  3923 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:14.656935  3999 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:14.649288  9794 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:14.662034  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.590577  9874 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:14.675989  9874 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.668675  9878 raft_consensus.cc:697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:14.677531  9461 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.664105  9776 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:14.682346  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:14.683669  9833 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.672699  9794 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:14.685812  9794 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.689503  9781 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:14.689955  9781 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:14.587615  9727 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:23:14.663040  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.693053  3842 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.697279  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.698450  9833 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:14.698982  9833 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.699404  9833 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.690867  9781 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.705657  9781 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.708221  3815 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:14.709614  9623 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.530639  9747 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.652650  9714 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:14.609767  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.597818  9835 raft_consensus.cc:2764] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:23:14.668126  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.661092  3845 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:14.598706  9628 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:14.659391  9847 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.714856  9628 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.715718  9847 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:14.670475  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.716686  3997 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.651115  9831 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:14.672130  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.673056  3921 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:14.672998  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.718394  3993 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.655905  9669 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:14.719645  9669 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.720036  9669 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:14.720438  9729 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.657773  3996 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:14.587095  9637 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:14.721612  9735 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.654273  9398 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:23:14.666191  9786 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:23:14.722028  9637 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:14.722635  9637 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:14.725845  4581 raft_consensus.cc:2368] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:14.727865  9874 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:14.728843  9628 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:14.730079  9772 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.734145  3843 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:14.735595  9828 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:14.737301  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.689860  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.714856  3995 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:14.739164  3993 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:14.712945  9714 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:14.739293  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:14.751921  4582 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.741509  3997 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:14.743206  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.753571  3991 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.754640  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.755221  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:14.755259  3993 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:14.755265  3997 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:14.759657  3842 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:14.737545  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:14.747682  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.760739  4579 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:14.760901  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:14.761274  4581 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:14.761667  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:14.757920  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:14.762573  3964 leader_election.cc:400] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:23:14.766407  3964 leader_election.cc:403] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:14.778643  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:14.779956  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:14.779261  3993 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.781569  9747 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.782055  9878 consensus_queue.cc:237] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.737339  9828 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.787801  9828 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:14.788149  4583 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:14.789908  9833 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.777642  4579 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:14.805194  4582 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
W20260709 12:23:14.807713  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61739.1us
I20260709 12:23:14.808365  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:14.808508  3962 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.808919  4575 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:14.809672  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:14.809890  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:14.810252  4581 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.810662  9832 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:14.811125  9832 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:14.812006  9832 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.767186  9558 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:23:14.813234  9870 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:14.813781  9870 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:14.813891  9727 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:14.814270  9727 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:23:14.817411  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 62286.3us
I20260709 12:23:14.818312  4581 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:14.806763  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:14.819051  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58355.1us
W20260709 12:23:14.824308  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 73447.5us
I20260709 12:23:14.670720  9811 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.820300  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:14.833824  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71398.5us
I20260709 12:23:14.834785  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:14.836105  3993 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:14.838096  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.839079  9669 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.839288  9727 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.839749  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.838783  3995 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:14.835167  3991 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:14.851639  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.830370  9848 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:14.856731  3964 leader_election.cc:400] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:14.857555  9874 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.840873  9545 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 9. Current term is 10.
I20260709 12:23:14.859647  9819 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:14.843863  9797 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.846238  9814 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:14.885766  3890 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:14.857743  9778 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:14.847148  9727 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.848172  9786 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:23:14.899875  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.847947  9729 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:14.883519  3964 leader_election.cc:403] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:14.876338  9833 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:14.877281  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 54460.1us
W20260709 12:23:14.904592  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48047.8us
I20260709 12:23:14.907330  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:14.909446  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.912439  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:14.915199  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.916586  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:14.889148  9848 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:14.844954  9870 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.897142  9853 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:14.931849  9637 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:14.939725  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.940732  3921 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:14.934026  9852 consensus_meta.cc:287] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 12:23:14.897523  9747 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:23:14.908743  9778 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:14.938737  3846 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:14.889429  9797 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.932677  9776 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:14.954092  3925 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:14.891669  9398 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:23:14.906394  9786 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:14.901088  9669 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:14.924104  9545 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:14.974665  4574 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:14.950376  9579 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:14.923830  9866 consensus_queue.cc:1059] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 12:23:15.021682  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:14.967406  9853 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:15.022346  3923 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:15.036939  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.038549  3921 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:14.968990  9852 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.042950  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.020319  9831 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.065346  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.067843  3925 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.075284  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.045950  9866 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:15.033222  9848 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.055251  9810 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.075397  9579 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:15.106709  9865 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:15.121939  9865 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:15.122524  9865 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:15.176786  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 101580us
I20260709 12:23:15.177772  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:15.179747  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 147305us
I20260709 12:23:15.188131  3925 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:15.198436  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.203367  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.207114  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.058089  9786 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.087633  9853 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.107240  9810 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.209365  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.223845  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:15.225059  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.210736  9637 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.213687  9866 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:15.246471  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.214062  9735 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:23:15.258334  9692 consensus_meta.cc:287] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.007s
I20260709 12:23:15.262976  3923 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:15.218814  9776 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.228883  9829 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:15.228762  9628 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:15.255847  9735 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:15.300002  9891 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:23:15.308230  9897 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:15.277408  9840 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:15.317235  9828 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.004s
I20260709 12:23:15.277871  9798 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:23:15.275581  9902 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:15.319094  9545 raft_consensus.cc:3055] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:15.322283  9831 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.323985  9810 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.324368  3921 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:15.297863  9904 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:15.348508  9848 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:15.268431  9558 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:23:15.336540  9794 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.007s
W20260709 12:23:15.337643  9714 consensus_meta.cc:287] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.534s	user 0.017s	sys 0.005s
I20260709 12:23:15.338733  9852 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.254340  9797 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.340426  4576 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:23:15.343703  9822 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.343995  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:15.393483  9870 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:15.376855  9672 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:23:15.358495  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.365382  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:15.344803  9778 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
W20260709 12:23:15.377126  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 152102us
I20260709 12:23:15.292543  9628 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:15.348907  9735 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:15.354642  9772 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:15.331589  9811 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:15.326503  9847 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.004s
I20260709 12:23:15.397063  9835 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:15.379479  9545 raft_consensus.cc:740] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:15.415133  4574 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:15.352365  3847 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:15.352836  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 149588us
I20260709 12:23:15.377338  9828 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.400338  9904 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:15.421619  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:15.425992  3964 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.453809  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.460788  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.461548  3992 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:15.408259  9848 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.425263  9628 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:15.467331  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:15.468043  3993 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:15.420882  9840 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.415688  9714 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.471705  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:15.476249  3997 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:23:15.476706  3997 pending_rounds.cc:85] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 8
I20260709 12:23:15.477032  3997 pending_rounds.cc:107] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:23:15.477303  3997 raft_consensus.cc:2889] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:15.482019  3992 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:15.483459  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.484098  3999 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.411990  9794 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.484885  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.485513  3990 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.486745  9909 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:15.487772  9714 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.489265  3995 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:15.489463  3814 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:15.490950  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.491860  3992 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:15.491966  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.452134  9904 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:15.419075  9822 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.498104  3999 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:15.501040  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.502071  9786 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:15.502580  9786 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.502728  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.503041  9786 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:15.504699  9898 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:15.506589  3990 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
W20260709 12:23:15.507704  9915 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:23:15.512132  9913 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:15.463732  9797 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:15.517479  4574 raft_consensus.cc:1240] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:15.523469  9874 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:15.524191  9874 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.525331  9811 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:15.526471  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 67074.8us
I20260709 12:23:15.451843  9835 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.528352  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.528960  3847 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:15.529888  9747 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:15.527340  9797 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:15.530776  9747 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:23:15.531654  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 60051.8us
I20260709 12:23:15.531754  9797 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.533211  9908 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:15.533699  9908 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.534179  9908 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.537434  9828 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:15.538326  9890 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:15.539062  9723 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:15.539619  9723 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:15.497943  9865 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.443050  9847 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.540804  9723 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.541797  9865 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.542492  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3469) took 1099 ms. Trace:
I20260709 12:23:15.531186  9747 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:15.542905  3849 rpcz_store.cc:276] 0709 12:23:14.443529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.447105 (+  3576us) service_pool.cc:224] Handling call
0709 12:23:14.447642 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.600753 (+153111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.600782 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.654494 (+ 53712us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.085833 (+431339us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:15.085897 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.472059 (+386162us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003444d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:15.472105 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.542142 (+ 70037us) raft_consensus.cc:1685] finished
0709 12:23:15.542166 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.542417 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11324,"raft.queue_time_us":59375,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4764,"spinlock_wait_cycles":325181184,"thread_start_us":410637,"threads_started":1,"wal-append.queue_time_us":743687}
I20260709 12:23:15.544181  9747 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.545534  9747 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:15.548363  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:15.551183  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.553829  9848 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.554350  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.555181  9545 consensus_queue.cc:260] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.563484  9545 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:15.421833  9870 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.565290  3843 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:15.567217  9870 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.569048  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:15.556790  9822 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.557327  9398 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:15.571600  9398 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:15.572746  9398 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.558274  9847 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.577931  3841 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:15.485225  9840 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.530072  9835 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.587651  9874 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.594122  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:15.597216  9840 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.598789  3847 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:15.600186  9794 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.603360  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:15.604372  3842 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:15.609355  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:15.611892  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:15.616056  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:15.616848  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.617695  3841 raft_consensus.cc:2368] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:15.619654  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:15.620155  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 129656us
I20260709 12:23:15.621667  3843 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:15.458801  9772 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.626951  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:15.641812  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:15.642624  3997 raft_consensus.cc:1275] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:15.644717  4547 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.617821  9723 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:15.648481  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 194757us
I20260709 12:23:15.653553  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.649461  3962 leader_election.cc:400] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:15.654636  3962 leader_election.cc:403] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:15.650827  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:15.656021  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 62429.3us
I20260709 12:23:15.652372  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:15.658893  3845 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
W20260709 12:23:15.659138  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.656185  9798 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:23:15.672399  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52848.2us
I20260709 12:23:15.655262  9847 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:15.676290  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.678411  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.681334  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.682868  3922 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:15.683686  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:15.698575  3998 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:15.683833  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.699743  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.700416  3990 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:15.653004  9865 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:15.703837  9865 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.706486  9865 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.686241  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.709151  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.709733  3999 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:15.686841  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.710721  3920 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:15.687112  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.710714  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:15.712348  3917 raft_consensus.cc:2410] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:15.654839  9558 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:15.688762  9903 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:15.689683  3997 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:15.661237  9670 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:15.717391  3997 pending_rounds.cc:85] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 10
I20260709 12:23:15.717764  3997 pending_rounds.cc:107] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:15.718088  3997 raft_consensus.cc:2889] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:15.660992  9909 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:15.643337  9729 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:23:15.690239  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:15.640509  9835 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:23:15.690230  9904 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.662665  9812 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.720875  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:15.724562  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53884.8us
I20260709 12:23:15.773952  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.727253  9772 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:15.664119  9669 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:15.672832  9778 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:15.727689  9798 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:15.666563  9852 consensus_queue.cc:1059] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:23:15.728160  9847 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:15.737195  9672 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.731717  9865 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:15.684931  9776 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:23:15.647190  9844 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:23:15.716609  9558 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.770678  9727 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.776404  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.794848  3919 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:15.776417  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.778182  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.778692  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.779002  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:15.777451  3990 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:15.780573  3923 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:15.780440  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:15.782701  3841 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:15.748031  9835 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:15.686311  9819 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:23:15.718195  9829 consensus_queue.cc:1059] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:23:15.747047  9735 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.756896  9903 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:15.757449  9874 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:15.789942  3921 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:15.792392  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:15.723672  9908 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:15.770534  9812 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.798717  3925 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:15.840975  3920 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:15.820278  9735 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.841768  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.800674  4574 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:15.800257  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.747433  9628 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.801846  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.803561  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:15.806479  3990 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:15.808389  3841 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:23:15.803376  9727 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.797797  9558 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:15.811713  9781 consensus_queue.cc:1048] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:15.816293  3997 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:15.820794  9904 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.783255  9822 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:15.795787  3917 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 12.
I20260709 12:23:15.825212  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:15.856936  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.800560  9669 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:15.798442  9835 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:15.834206  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:15.860174  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:15.835496  9903 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.794365  9672 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.845304  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:15.849888  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46451.9us
I20260709 12:23:15.861334  3923 raft_consensus.cc:2368] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14.
I20260709 12:23:15.857820  3999 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:15.858289  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 43589.9us
I20260709 12:23:15.822019  9729 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:15.804888  9917 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.835269  9798 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.862525  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.840181  9812 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:15.864033  3995 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:23:15.864734  9727 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.869724  3920 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:15.881644  3918 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:15.862541  3919 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:15.877594  3993 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:15.879739  3995 pending_rounds.cc:85] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 8
I20260709 12:23:15.880764  3964 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:15.861114  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:15.855525  9852 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:15.885540  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:15.881181  9917 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:15.926230  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45594.5us
I20260709 12:23:15.883868  9865 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
W20260709 12:23:15.938951  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 77926.1us
I20260709 12:23:15.939185  3995 pending_rounds.cc:107] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:23:15.866557  9669 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.883805  9844 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:15.959117  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 76628.4us
I20260709 12:23:15.969497  3995 raft_consensus.cc:2889] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:15.942660  9890 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:23:15.935750  9727 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:15.960732  4576 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:15.949324  9910 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:15.958308  9923 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:23:15.992489  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:16.058490  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 57677.3us
I20260709 12:23:16.487985  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:16.490017  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:16.311110  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 354037us
W20260709 12:23:16.316370  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 228660us
I20260709 12:23:16.560848  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:16.462889  3846 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:16.457981  3814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.021s	sys 0.026s
W20260709 12:23:16.080273  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 86581.3us
I20260709 12:23:16.264425  9558 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.314312  9545 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.272442  9461 raft_consensus.cc:3055] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:16.572154  9461 raft_consensus.cc:740] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:16.215888  9672 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:16.112677  9628 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:15.994717  9776 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:23:16.575357  9545 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.227804  9778 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:23:16.578250  9558 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:16.245048  9786 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.000s
I20260709 12:23:15.935724  9794 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:23:16.579614  9545 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:16.581808  9786 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:15.876022  9822 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.315873  9832 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.864027  9835 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.087760  9842 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:23:16.584231  3847 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:15.882416  9847 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.585172  9832 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.585928  9822 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:16.587023  9461 consensus_queue.cc:260] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.588433  9461 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:16.056020  9909 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:23:16.409372  9870 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:16.369518  9854 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.311941  9914 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:16.195611  9908 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.056600  9910 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.602216  9910 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:16.122607  9917 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:16.106163  9919 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:23:16.107929  9925 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:23:16.106940  9928 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 12:23:16.543402  9949 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.220s	user 0.016s	sys 0.014s
I20260709 12:23:16.545586  9669 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:16.549687  9948 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 12:23:16.627148  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:16.628226  4576 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.628443  3847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34162 (request call id 2762) took 1022 ms. Trace:
I20260709 12:23:16.628860  3847 rpcz_store.cc:276] 0709 12:23:15.605965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.609014 (+  3049us) service_pool.cc:224] Handling call
0709 12:23:16.628164 (+1019150us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400409a54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:16.628361 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233996032}
I20260709 12:23:16.550040  9840 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:16.550040  9747 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:16.551187  9945 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:16.555179  9952 log.cc:927] Time spent T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 12:23:16.555078  9903 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:16.556206  9943 log.cc:927] Time spent T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.177s	user 0.002s	sys 0.002s
I20260709 12:23:16.635356  9747 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:16.636359  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 643872us
I20260709 12:23:16.637243  9903 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.637724  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:16.638608  9747 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.639293  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.638660  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.642455  9835 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:16.642947  3844 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:16.619383  9832 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:16.647531  9909 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:16.567180  3814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.024s	sys 0.033s
I20260709 12:23:16.287187  9579 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:16.594651  3849 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:16.598297  3848 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:16.600685  9870 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:16.613925  9908 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:16.598126  9714 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.599687  9854 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.657765  9917 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:16.659061  9854 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:16.616662  9951 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.181s	user 0.000s	sys 0.003s
I20260709 12:23:16.661664  9945 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.617188  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:16.617750  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.664927  9945 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:16.670765  9908 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.618767  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 959) took 1275 ms. Trace:
I20260709 12:23:16.624296  9669 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.671727  9908 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.671887  4581 rpcz_store.cc:276] 0709 12:23:15.343145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.344556 (+  1411us) service_pool.cc:224] Handling call
0709 12:23:15.344890 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.406062 (+ 61172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.406092 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.408449 (+  2357us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.673430 (+264981us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:15.673474 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.673548 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.618072 (+944524us) raft_consensus.cc:1685] finished
0709 12:23:16.618118 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.618460 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10748,"raft.queue_time_us":29649,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":14967,"thread_start_us":323589,"threads_started":2,"wal-append.queue_time_us":530608}
I20260709 12:23:16.674252  9669 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:16.607587  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47238.2us
I20260709 12:23:16.655962  9579 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:16.676919  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:16.677256  9579 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:16.679028  9938 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.262s	user 0.000s	sys 0.013s
I20260709 12:23:16.684608  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.687772  9840 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.674317  9908 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.680266  9903 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:16.680987  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:16.679071  9714 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:16.672263  9844 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.681456  9786 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:16.649742  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:16.706522  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.696645  9714 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:16.694842  9840 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.712364  3846 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:16.695885  9909 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:16.716202  9714 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:16.719331  9828 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.735316  9828 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:16.736193  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 55398.7us
I20260709 12:23:16.740688  4574 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:16.726130  9545 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:16.747684  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:16.752620  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 75242.6us
I20260709 12:23:16.756000  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:16.706629  9844 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.764228  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.770888  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.754978  9870 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.777815  9870 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:16.778429  3848 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:16.779311  3992 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:16.787823  9579 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:16.792510  9832 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.793051  9828 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.793694  9832 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:16.798064  3845 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:16.618238  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:16.810884  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 106142us
I20260709 12:23:16.813795  9844 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:16.814842  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.828922  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:16.829277  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:16.832449  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68334.5us
W20260709 12:23:16.834380  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 96700.3us
I20260709 12:23:16.835062  9828 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:16.837735  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.838951  9832 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.841825  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.860473  3842 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:16.880894  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:16.874956  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:16.884126  4576 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:16.899362  9842 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.899587  9847 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:16.870012  9844 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:16.911903  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 2520) took 1190 ms. Trace:
I20260709 12:23:16.912400  3992 rpcz_store.cc:276] 0709 12:23:15.682654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.708867 (+ 26213us) service_pool.cc:224] Handling call
0709 12:23:16.849381 (+1140514us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540016f8d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:16.873282 (+ 23901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000386432}
I20260709 12:23:16.765215  9909 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.931851  3850 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:16.937755  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:16.949342  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:16.950974  3815 leader_election.cc:400] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14.
I20260709 12:23:16.951370  3815 leader_election.cc:403] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:16.951640  9461 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:16.952267  9917 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:16.953022  9917 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:16.953500  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:16.954286  9461 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14.
I20260709 12:23:16.954768  9669 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:16.955435  9669 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:16.955947  9853 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:16.956635  9853 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:16.957201  9853 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:16.957103  9669 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:16.951689  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.954288  9917 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:16.959496  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.960522  4582 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:16.911725  9847 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.967671  9545 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:16.968394  9545 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:16.967056  9874 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:16.974359  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:16.974861  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:16.975176  4582 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 9.
I20260709 12:23:16.979959  4580 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:16.980906  3745 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:16.984105  9832 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:16.995985  9832 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.000093  9832 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:16.931049  9842 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.003957  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:17.009980  9773 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.010619  9773 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.013118  9773 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.013862  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.013998  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:17.017385  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 109517us
W20260709 12:23:17.027745  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.020381  3745 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 15, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 15 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:17.033421  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.029903  9461 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.049417  9904 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.049594  9461 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.050277  9904 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.050983  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.052327  9461 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.052459  9778 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.052796  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.053006  9840 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:17.053632  9840 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.053172  9778 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.054155  9840 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:17.055099  9794 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:17.057422  9628 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:17.057977  9628 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.058379  9628 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:17.055907  9778 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.031809  9842 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.066782  9842 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:17.055181  9910 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.071906  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.081605  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:17.071976  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:17.079970  9776 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:17.075204  9747 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:17.086301  3848 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:17.052731  9904 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.098076  4576 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:23:17.100690  3920 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:17.101202  9910 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.101769  9811 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:17.083221  9847 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.031147  9874 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.091212  9747 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.059582  9714 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.105892  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:17.137945  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.120518  9747 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:17.145151  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:17.148509  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 56373.5us
I20260709 12:23:17.103217  9786 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 12:23:17.163693  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 110979us
I20260709 12:23:17.151243  9847 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:17.151613  9461 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:23:17.171800  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 106751us
I20260709 12:23:17.157378  9669 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:17.153188  9870 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:17.169273  9847 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.188081  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:17.185688  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.168180  9908 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:17.171777  9461 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.201654  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:17.187222  9545 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.211915  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:17.212926  3921 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:17.195693  9847 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.226213  4582 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:17.231801  3919 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:17.199541  9461 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.242240  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.203890  9908 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:17.251128  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.257306  9714 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.258093  9714 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:17.258720  9714 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.259516  3923 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:23:17.261052  9908 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.267776  9963 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.268667  9963 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:17.272099  9957 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:23:17.230983  9628 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.283879  9844 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:17.286171  9844 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:17.275995  9955 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:23:17.293553  9967 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:17.299224  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.271425  9963 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.242812  9870 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.239845  9832 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:17.242532  9828 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:23:17.318320  9967 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.296254  9776 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.320441  9776 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.321201  9967 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.323632  9811 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:17.309414  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 219415us
I20260709 12:23:17.324510  9811 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.328079  9917 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:17.343698  3923 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:17.286935  9844 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.350663  9811 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.351239  3998 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:17.351434  9822 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.329417  9937 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:23:17.352201  9822 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.353236  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:17.354017  4574 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:17.354724  9822 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.329409  9776 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.350669  9902 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.351174  9903 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.356472  9902 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.356662  9903 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.357971  9853 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.358862  9903 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.358930  9902 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.360564  9714 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:17.352197  9960 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:23:17.373193  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:17.373528  9956 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.270s	user 0.004s	sys 0.000s
I20260709 12:23:17.350771  9914 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:17.381234  9874 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.381726  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.399255  3924 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:17.410955  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:17.414924  4574 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 22: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:17.392931  9714 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:17.379168  9832 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.452806  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.455341  3998 raft_consensus.cc:1240] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 19. Current term is 20. Ops: []
W20260709 12:23:17.454038  9835 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.811s	user 0.014s	sys 0.004s
I20260709 12:23:17.471664  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.457278  9714 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.478209  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:17.479348  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:17.480727  3918 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:17.486167  9874 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.486356  9628 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.487072  9874 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.455255  9778 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:17.488300  9747 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.488811  9778 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.489440  9874 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.490702  9747 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.492326  3993 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:17.497231  3997 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:17.497468  9853 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.497709  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.498478  3996 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:17.499210  9714 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.446681  9914 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.502151  9914 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.502449  9828 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:17.509470  3997 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:17.502988  9828 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:17.486258  9461 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.511998  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:17.513419  9870 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.507709  9916 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.520162  9916 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.528786  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.529284  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.530807  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.531482  3925 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:17.532097  3923 raft_consensus.cc:1240] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:23:17.537221  9778 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:17.516654  9579 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.009s
W20260709 12:23:17.549238  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.552538  3918 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:23:17.565235  9461 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.566061  9461 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.566628  9461 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.568907  9828 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.582499  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.583312  3992 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:23:17.585582  9974 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:23:17.592953  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.600757  9828 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:17.602334  9832 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.552057  9840 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.604507  3994 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:17.604609  9840 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.611266  9786 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:17.611720  9786 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:17.612699  9786 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.613417  9916 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.614202  9461 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.617687  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:17.617969  9937 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:17.618444  4574 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.621667  9794 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:17.623705  9844 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:17.624056  9984 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:23:17.624385  9844 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:17.624189  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.625813  9579 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:17.624979  9844 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.642844  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.645596  3745 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:17.653826  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.658418  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.658519  3843 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:17.665609  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.665674  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.662642  9461 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:17.675067  9461 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.675634  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.672269  9840 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:17.677596  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.677182  9840 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.678267  3844 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:17.677886  9844 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.677147  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.681684  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.675724  9461 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:17.688009  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.688072  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.689373  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.692788  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.693493  3846 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:17.701056  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.706907  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.707093  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.708366  3844 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:17.641458  9669 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:23:17.710649  9981 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:23:17.711323  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.712492  3849 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:17.645313  9832 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:17.713372  9832 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.713656  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.651559  9579 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.724368  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:17.719831  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44933.4us
I20260709 12:23:17.696746  9914 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:17.743976  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.765084  3996 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:23:17.767486  9980 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:23:17.768599  9914 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.702404  9847 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.772835  3991 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:17.773454  9847 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.723030  9908 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.774611  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:17.752295  9840 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:17.774731  9908 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.741720  9870 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:23:17.779062  9870 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:17.779553  9870 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:17.780731  9870 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.782524  9870 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:17.785378  9579 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.786947  9908 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:17.787609  9832 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.757879  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.790006  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.790406  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:17.791584  3995 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:17.800595  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.800239  3993 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:17.807708  3846 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:17.811723  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:17.812649  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.817447  3997 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:17.821569  3998 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 18: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:17.810834  9840 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:17.844946  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.846091  3997 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:17.847224  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:17.847844  3920 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:17.852102  3925 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:17.852972  3918 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:17.856940  3921 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:23:17.857620  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:17.850559  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:17.859388  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.861830  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.861335  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:17.872238  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.877887  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:17.842679  9840 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.837996  9914 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:17.880131  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.883558  9847 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.883838  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.892656  4574 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:17.886848  9840 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:17.907222  3850 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:17.909308  3845 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:17.889756  9811 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:17.911265  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.913256  3994 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:17.887105  9979 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:23:17.903057  9778 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:17.908711  3889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.699s (SENT) [suppressed 17 similar messages]
W20260709 12:23:17.936970  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 266463us
I20260709 12:23:17.921890  9778 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.941325  9669 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:17.941828  9669 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:17.943104  9672 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:17.943553  9985 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.307s	user 0.001s	sys 0.004s
I20260709 12:23:17.944167  9908 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:17.944640  9908 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:17.945607  9908 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.949724  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.960232  9937 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:17.963742  9937 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:17.964747  9937 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:17.956154  9747 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:23:17.970408  3846 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:17.947836  9908 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.917693  9811 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:17.974973  3850 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:17.976140  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.979102  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:17.992193  3842 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:17.983634  3962 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:17.985612  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:17.986452  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.991600  3849 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
W20260709 12:23:17.989486  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.942806  9669 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:17.987433  9991 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:17.995428  3994 raft_consensus.cc:2368] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:17.994556  3888 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:18.000399  3923 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:17.998071  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:17.997387  3745 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.002677  3844 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:18.004626  3998 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 17: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:18.005532  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.017113  3991 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:18.005002  9870 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:18.022933  3996 raft_consensus.cc:2468] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:18.006357  9747 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:18.008627  9669 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:17.999256  9461 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.056252  9461 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.058230  3847 raft_consensus.cc:2368] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:18.060580  9747 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:18.061188  3888 leader_election.cc:400] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:18.061576  3888 leader_election.cc:403] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:23:18.061687  9747 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.062546  9909 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:18.027225  9844 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:18.068352  9844 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.030670  9786 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:18.036077  9853 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:18.070685  9844 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:18.036512  9672 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:18.037483  9811 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.038309  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:18.039208  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:18.083931  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 44806.9us
I20260709 12:23:18.086436  9637 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:18.086886  9637 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.087229  9637 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:18.087862  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:18.088713  3990 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 13: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:18.089614  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:18.090167  3990 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:18.091838  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.092533  3995 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:18.093533  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:18.044202  9976 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
I20260709 12:23:18.051183  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:18.071867  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 163187us
I20260709 12:23:18.073210  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.094740  3998 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:18.118302  9811 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.118818  9811 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.119967  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:18.027243  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 89027.5us
I20260709 12:23:18.131899  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.137820  3994 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:18.139684  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:18.140426  3995 raft_consensus.cc:2368] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
W20260709 12:23:18.155701  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 135570us
I20260709 12:23:18.164666  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:18.121110  9811 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.172196  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.164739  3962 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:18.187944  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:18.198124  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.186685  9870 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:18.207777  3745 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:18.204900  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:18.213363  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.224258  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.207870  9914 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:18.242383  3745 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 9 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 10 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:18.262262  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.269533  9909 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:18.291972  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.293190  3998 raft_consensus.cc:2393] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 19: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:18.287832  3990 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:18.244706  9844 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.251034  9914 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:18.307247  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.313228  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.255690  9998 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.279377  9902 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.325940  3745 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:18.312531  9914 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:18.340927  9637 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:18.333551  9870 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:18.351213  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:18.351997  3997 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 18.
W20260709 12:23:18.409962  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.415671  3745 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 18 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:18.423975  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.443758  9778 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:18.445829  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:18.446529  3847 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:18.448247 10003 log.cc:927] Time spent T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:23:18.449476  3744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 265) took 18445 ms (client timeout 15000 ms). Trace:
I20260709 12:23:18.449596  9786 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:18.452026  9981 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:23:18.449962  3744 rpcz_store.cc:269] 0709 12:22:59.908265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.908544 (+   279us) service_pool.cc:224] Handling call
0709 12:23:18.332941 (+18424397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:13.719960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:13.720608 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:13.720668 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:23:13.720689 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:13.722675 (+  1986us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:13.722767 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:13.722797 (+    30us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:23:14.113944 (+391147us) tablet.cc:701] Row locks acquired
0709 12:23:14.118075 (+  4131us) write_op.cc:260] PREPARE: finished
0709 12:23:14.130181 (+ 12106us) write_op.cc:270] Start()
0709 12:23:14.147552 (+ 17371us) write_op.cc:276] Timestamp: P: 1783599794126111 usec, L: 0
0709 12:23:14.150091 (+  2539us) op_driver.cc:348] REPLICATION: starting
0709 12:23:14.213048 (+ 62957us) log.cc:844] Serialized 9469 byte log entry
0709 12:23:14.671166 (+458118us) op_driver.cc:464] REPLICATION: finished
0709 12:23:15.219679 (+548513us) write_op.cc:301] APPLY: starting
0709 12:23:15.222010 (+  2331us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:15.703192 (+481182us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:15.703289 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:16.237302 (+534013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:16.237846 (+   544us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:23:16.237918 (+    72us) write_op.cc:312] APPLY: finished
0709 12:23:16.238665 (+   747us) log.cc:844] Serialized 212 byte log entry
0709 12:23:16.380962 (+142297us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:16.381240 (+   278us) write_op.cc:454] Released schema lock
0709 12:23:16.381325 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:16.381871 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:16.381924 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29262,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":482848,"apply.run_cpu_time_us":41117,"apply.run_wall_time_us":1167579,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104303,"num_ops":24,"prepare.queue_time_us":439228,"prepare.run_cpu_time_us":53649,"prepare.run_wall_time_us":580636,"raft.queue_time_us":237535,"raft.run_cpu_time_us":28846,"raft.run_wall_time_us":460167,"replication_time_us":510566,"thread_start_us":962096,"threads_started":5,"wal-append.queue_time_us":147185,"wal-append.run_cpu_time_us":70206,"wal-append.run_wall_time_us":2265555}]]}
I20260709 12:23:18.454542  9937 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:18.324034  9844 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.351032  9902 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.348007  9998 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:18.510322  9840 consensus_meta.cc:287] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.005s
I20260709 12:23:18.423668  9832 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.540180  3999 raft_consensus.cc:2410] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:23:18.540966  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.546880  3745 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:18.573081  9637 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.592422  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:18.620932 10005 log.cc:927] Time spent T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:23:18.596429  3745 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 15 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:18.636281  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61450.7us
W20260709 12:23:18.645799  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.647091  3924 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:18.649005  3847 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
W20260709 12:23:18.650224  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51091.4us
I20260709 12:23:18.650748  3745 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:18.639830  9669 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.002s
I20260709 12:23:18.545578  9840 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:18.619258 10000 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.656699  3991 raft_consensus.cc:2393] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 23: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:18.658569  9840 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:18.660059  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 249166us
W20260709 12:23:18.665197  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.665891  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:18.666527  3847 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:23:18.586874  9811 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.659340  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:18.678578  3842 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:18.679684  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:18.702148  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:18.708328  9669 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:18.708976  9669 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.577227  9832 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.713044  3745 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:23:18.722335  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60066.3us
I20260709 12:23:18.723371  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:18.700766  9811 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.728580  9811 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.704109  9844 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:18.730163  9844 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:18.731019  9844 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:18.713718  3847 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23.
I20260709 12:23:18.679067 10000 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.717731  9840 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:18.746930  3962 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:18.752270  3745 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 12, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 12 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:18.746701  9840 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.758075  3745 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:23:18.761195  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 241768us
I20260709 12:23:18.749476  9853 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:18.757180  9870 raft_consensus.cc:2804] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:23:18.810350  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.762709  9840 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:18.824115  3745 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:18.851240  3745 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:18.781651  9914 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:18.888757  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 165545us
I20260709 12:23:18.893885  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:18.875171  3745 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.896852  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:18.864656  9870 raft_consensus.cc:697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:18.905830  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:18.897150  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 205403us
W20260709 12:23:18.912735  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 213253us
I20260709 12:23:18.887102  9998 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:18.811762  9853 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.926769  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:18.929991  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:18.937368  9778 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:18.947817 10000 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:18.926826 10026 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:18.936502  9998 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:18.966645  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.967264  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.968016  9870 consensus_queue.cc:237] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:18.970851  9914 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:18.972580  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 79327.7us
W20260709 12:23:18.975814  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 207467us
I20260709 12:23:18.984719  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:18.985002  4575 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:18.985634  4582 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16.
I20260709 12:23:18.962801  9847 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:18.979252  9669 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:18.960681  9778 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:18.989843  9778 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:18.992439  9778 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:18.997816  9908 consensus_meta.cc:287] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 1.007s	user 0.014s	sys 0.000s
I20260709 12:23:18.997946  3814 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:18.999714  9847 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:19.000250 10018 raft_consensus.cc:2764] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:23:19.003283  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.004248  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.004662  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:19.005239  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.004557  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.003485  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.005240  4576 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:19.004283  4575 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
I20260709 12:23:19.026692  9853 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:19.037382  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.038435  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.038511  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:19.036791  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 52142.3us
I20260709 12:23:19.044040  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.044752  3848 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:19.045899  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.046623 10022 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:19.052970  3888 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.054392  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.055809  9908 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:19.056279  9908 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:19.056710  9908 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:19.058310  9916 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:19.058914  9916 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:19.059465 10030 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:19.059954 10030 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.060380 10030 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:19.067672  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84202.4us
I20260709 12:23:19.068544  3815 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.073206  9981 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:19.092625  9847 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:19.092757 10021 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:19.095670  4576 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:19.097707  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:19.099946 10018 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:19.100380 10018 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.100760 10018 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:19.097744  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.102663  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.103782  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.108362  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.089748  9981 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:19.059842  9916 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:19.136626  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57342.2us
I20260709 12:23:19.113055  9847 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 12:23:19.144702  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45519.7us
I20260709 12:23:19.144943  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.141770  9870 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:19.148418  3964 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16.
I20260709 12:23:19.148790  3964 leader_election.cc:403] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:19.155174  9637 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.148317  9778 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:19.150797 10000 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:23:19.178143  9637 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:19.180307 10034 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:23:19.182085  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.182893  3847 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:19.150395  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.181555  9637 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.184063  9914 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:19.168828  9870 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.186271  9870 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.186311  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.173262  4577 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
W20260709 12:23:19.190667 10008 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.534s	user 0.003s	sys 0.000s
W20260709 12:23:19.175524 10035 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:23:19.204527  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.208009  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:19.208799  3849 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:19.210831  3844 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:19.206532  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.216449  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.217705  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.219913  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.174662  9840 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.300380  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.254108  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.300136  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:19.274077  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.259071  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3458) took 1092 ms. Trace:
I20260709 12:23:19.308044  3920 raft_consensus.cc:2393] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:19.316414  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 111972us
I20260709 12:23:19.318730  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.246589  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.327575  3849 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:19.331821  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:19.287212 10006 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.652s	user 0.000s	sys 0.006s
I20260709 12:23:19.214720  9870 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:19.306303  3921 rpcz_store.cc:276] 0709 12:23:18.166623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.166752 (+   129us) service_pool.cc:224] Handling call
0709 12:23:18.167180 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.172573 (+  5393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.172602 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.183324 (+ 10722us) log.cc:844] Serialized 26 byte log entry
0709 12:23:18.509258 (+325934us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:18.509318 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.509407 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:19.189992 (+680585us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:19.258602 (+ 68610us) raft_consensus.cc:1685] finished
0709 12:23:19.258636 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.258960 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4886,"raft.queue_time_us":5574,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":18377,"spinlock_wait_cycles":7580032,"thread_start_us":302195,"threads_started":1,"wal-append.queue_time_us":449314}
I20260709 12:23:19.340516  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.215250  9937 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.346294  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.221428 10024 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:19.273213 10040 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.273219  9998 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.286721  9832 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.349164  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.331272  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.348516  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.242415  9979 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.331161  9579 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:19.355703  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.330173 10026 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:19.364144  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 148623us
I20260709 12:23:19.232210  9908 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.366151  3994 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:19.250890  9778 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 12:23:19.223865 10041 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.135s
I20260709 12:23:19.351508 10024 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:19.371757  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.368670  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.298851 10018 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.262565 10030 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.372596  3990 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:19.210842  9981 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.389242  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.386708  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.394646  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.395861  3998 raft_consensus.cc:2368] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17.
I20260709 12:23:19.397535  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.372424  3962 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.359273 10022 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.372788  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.365197  9870 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:19.391147  3997 raft_consensus.cc:2376] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13. Re-sending same reply.
I20260709 12:23:19.398425  3992 raft_consensus.cc:2376] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19. Re-sending same reply.
I20260709 12:23:19.353746  9937 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.372257 10024 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:19.410531  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.414194  3994 raft_consensus.cc:2376] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13. Re-sending same reply.
I20260709 12:23:19.415145  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.411361  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.412427  3995 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:23:19.421787 10018 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.423728  3999 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:19.424178  3999 pending_rounds.cc:85] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 10
I20260709 12:23:19.424404  3999 pending_rounds.cc:107] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:19.424682  3999 raft_consensus.cc:2889] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:19.425931  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.426608  3999 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:19.427712  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.429006  9844 raft_consensus.cc:2804] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:19.429593  9844 raft_consensus.cc:697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:19.430603  9844 consensus_queue.cc:237] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.403579  9945 raft_consensus.cc:3060] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:19.432425  9840 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.434615  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.435426  3999 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 18: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:19.363862  9979 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.439838  3846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 2810) took 1368 ms. Trace:
I20260709 12:23:19.440260  3846 rpcz_store.cc:276] 0709 12:23:18.071528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.071878 (+   350us) service_pool.cc:224] Handling call
0709 12:23:18.115777 (+ 43899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.116241 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.116267 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.150357 (+ 34090us) log.cc:844] Serialized 26 byte log entry
0709 12:23:18.353273 (+202916us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:18.353340 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.353451 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:19.286540 (+933089us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:19.439486 (+152946us) raft_consensus.cc:1685] finished
0709 12:23:19.439508 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.439737 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6528,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":34682,"spinlock_wait_cycles":14327552,"thread_start_us":153817,"threads_started":1,"wal-append.queue_time_us":355446}
I20260709 12:23:19.429049  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.448231  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.449138  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.360895  9998 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.462618  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:19.464164  3916 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:19.466308 10018 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.467010  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.456108 10030 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.470963  3850 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:19.359185 10040 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.482419  3814 leader_election.cc:400] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17.
I20260709 12:23:19.484659  3991 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:19.484783  3814 leader_election.cc:403] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:19.485642  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:19.486230  3846 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:23:19.483578  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.492148  3814 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:19.469684  9916 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.507205  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.412065 10022 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.467059 10018 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.523289  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.505275  9786 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:19.500505 10040 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.524348  3916 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:19.531972  9979 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.535729  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.536434  3992 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:19.547084  3992 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:19.550192  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.551239  3849 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:23:19.519225 10000 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16.
I20260709 12:23:19.573130  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.577023  3992 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:19.572647  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.512687 10030 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:23:19.501736  9916 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.584038  9979 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:19.587832  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.588886 10022 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:19.589084  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:19.590044 10057 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:23:19.591004  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.592691  9998 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.593163  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.594796  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.595930  3923 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:19.574946  9778 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:19.597232  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.597625  9778 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:19.598151  9778 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:19.600241  9937 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.603868  9916 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.582580  9579 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 12:23:19.590466  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.592723  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:19.612277  3924 raft_consensus.cc:3060] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:19.590065  3917 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:19.631301  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:19.632368  3917 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:19.640090  3846 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:19.643043  3992 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:19.575428  9908 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.573702  9786 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:19.649598  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.645534  3814 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.670480  3924 raft_consensus.cc:2468] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:19.656610  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.672219  3992 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:19.622766  9979 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:19.643854 10051 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17.
I20260709 12:23:19.660240  9937 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:19.697968  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.698997  3997 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:19.673143 10058 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.707047  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.743837 10019 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:19.776115  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.776918  3924 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:23:19.797888  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.713306  9937 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:19.805389  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 151316us
I20260709 12:23:19.816130  9902 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.816200  9901 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.817634  9901 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.797216  9786 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.806983  9835 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:19.806749 10030 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:19.829239 10030 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.831012  9945 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:19.758718 10058 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.828172  9835 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.845860  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.847289  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.848258  3995 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:19.850196  3847 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:19.863221  3917 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:19.838871 10018 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.871637 10038 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:19.871937  9835 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.874933 10058 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:19.876698  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.878432  9832 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:19.878979  9832 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:19.879810  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.880275  9901 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:19.886127 10059 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 12:23:19.893046  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.894337  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.894855  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:19.895007  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.812407  9979 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.904955  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:19.905980  3848 raft_consensus.cc:606] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:19.906330  3848 raft_consensus.cc:614] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:19.901454  9937 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:19.908915 10067 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:23:19.909610 10063 log.cc:927] Time spent T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:23:19.914173 10024 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.914836  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:19.915663  3841 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:19.879840  9832 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:19.919580  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:19.904968 10071 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:19.920457  3846 raft_consensus.cc:2368] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 20. Current term is 21.
I20260709 12:23:19.921490 10056 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:19.922169 10056 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.923650  4575 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:19.924185  9840 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:19.924773  9840 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.904990  9902 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:19.925629  9902 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:19.926005  9902 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:19.931483 10030 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:19.933741  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.937402 10024 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:19.896857  4548 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.940001  3917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:23:19.940809  3917 raft_consensus.cc:606] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:19.940886  3999 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:19.943324  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:19.945742  3841 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:19.948028  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:19.901356  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:19.949790  4577 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:19.955765  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:19.956562  4577 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 9.
I20260709 12:23:19.959512  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.959666  9909 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:19.960260  3997 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:23:19.960320  9909 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:19.961335  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:19.962623  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:19.962960  9909 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.066268 10026 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.066123 10058 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:19.953461 10059 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.063s	user 0.004s	sys 0.000s
I20260709 12:23:20.067044  9773 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:20.075613  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 174317us
W20260709 12:23:20.076189  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 97345us
W20260709 12:23:20.076922  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 180145us
I20260709 12:23:20.081496  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.084740  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.083760  4581 raft_consensus.cc:2468] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23.
I20260709 12:23:20.072211  9909 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:20.088150  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:19.968412 10056 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.094447  3888 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:20.099737 10018 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:20.098258  3814 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:20.097239  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.110531  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.072501 10070 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:20.113667  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:20.085155  9773 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.118608  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.118544  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.103770 10018 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.112895 10039 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:20.086287  9844 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:23:20.130844  3889 leader_election.cc:400] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:20.132464  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.134554  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.112936 10040 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:20.112702  9811 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:20.071615 10026 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.182312 10026 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:20.182767 10069 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 12:23:20.184845 10068 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:23:20.188611  9840 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.190393  3843 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:20.194546 10002 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:20.196483  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.199348 10030 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:20.202696 10030 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:20.085875 10058 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.145262 10071 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:20.147549 10051 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:20.149632  9778 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.006s
I20260709 12:23:20.138693 10022 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:20.139005 10018 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:20.140117 10070 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.136842  9910 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:23:20.109575  9909 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.142169 10040 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.162246  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:20.119307  9773 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.140259 10010 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.119508 10015 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:20.127815 10019 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:20.117756  9669 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
W20260709 12:23:20.177767  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43861us
I20260709 12:23:20.250633  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.179632 10043 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:20.144183 10072 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:20.203337 10030 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:20.254504 10030 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.255877 10030 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:20.221117 10022 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.244709  9902 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.278614  3841 raft_consensus.cc:606] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:20.279194  3841 raft_consensus.cc:614] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:20.290818  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 161774us
I20260709 12:23:20.228242  9778 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.291200  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.242439 10040 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:20.244606 10015 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.263775 10070 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.281340 10022 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.291152  9902 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.326226  3994 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:20.271159  9773 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.295776  9908 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.330195  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:20.305150 10015 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:20.336836  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.345485 10058 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.348713  9909 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.351305  9778 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:20.358230  9747 raft_consensus.cc:993] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:20.358911  9747 raft_consensus.cc:1081] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:20.365511  9773 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:20.369547  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.370162  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:20.371675  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70657.4us
I20260709 12:23:20.372440  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.373611  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.374441 10020 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:20.374854 10020 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.375221 10020 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:20.379879 10019 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.382047  3845 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:20.387710 10019 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.388517 10019 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.390954 10019 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.392323  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.379606  3841 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:20.400610  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:20.404798  9914 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:20.405392  9914 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:20.406389  9914 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.407629 10056 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:20.418331 10018 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.431495  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:20.432451  3850 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 10: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:20.434178  9916 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.434834  9916 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:20.454353  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 360000us
W20260709 12:23:20.461119  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 168872us
I20260709 12:23:20.483984  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.490644  3888 leader_election.cc:400] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 20. Current term is 21.
I20260709 12:23:20.491040  3888 leader_election.cc:403] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:23:20.498080  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:20.499814  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:20.459018  9747 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:20.514341  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.514983  9909 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:20.515815  9909 consensus_queue.cc:1243] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:20.516328  9909 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:20.516654  9909 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:20.517272  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.517478  9909 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.523561 10070 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 20. Current term is 21.
W20260709 12:23:20.527663  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.531672 10043 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:20.506969  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 114733us
I20260709 12:23:20.423097 10015 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:20.543651  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 423530us
I20260709 12:23:20.512838  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.512975  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:20.492738  9461 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.541669  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.572531  9811 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:20.537241  9945 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:20.548605  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.573704  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.574640  3919 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 18.
I20260709 12:23:20.546953  9909 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:20.544317  9916 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.595564  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:20.573365  9945 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.544941 10039 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:23:20.612251  9945 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.587990  9461 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:20.628790 10054 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.392s	user 0.005s	sys 0.000s
I20260709 12:23:20.625546 10040 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.666891  9747 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.670320  9747 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.670747  9669 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:20.671341  9669 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.671803  9669 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:20.672753  9747 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.645622 10022 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.668864 10018 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:20.677279  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 229619us
I20260709 12:23:20.677714  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.672747  9461 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.683053  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:20.679965  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 84514.5us
W20260709 12:23:20.690943  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 91245.6us
I20260709 12:23:20.691416  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.692127  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.691816  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.692844  3924 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:20.686508  3923 raft_consensus.cc:2368] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:23:20.683611 10058 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.694401  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.693301  3921 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:20.697190  3920 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:20.703470  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.704135  3917 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:20.704815  3916 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:20.706593  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.707592  3924 raft_consensus.cc:2410] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:23:20.692909 10015 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.714998  9945 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.720789  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.721763  3922 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:20.722616  9945 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:20.730053  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 187313us
I20260709 12:23:20.733174  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.736146  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:20.730115  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 212900us
I20260709 12:23:20.741289  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:20.743894 10082 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:23:20.744244  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.747571  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.749363  3920 raft_consensus.cc:1275] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:23:20.753271  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.754235  3920 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:20.755077  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:20.756057 10103 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:20.757797 10103 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:20.759521  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.759768  9747 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.760294  9747 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.761147 10103 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:20.762773  9747 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.761300  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.763315  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.766842  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.769693  9914 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:20.742029 10089 log.cc:927] Time spent T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:23:20.735946  9916 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:20.782167  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.710638 10058 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.766058  9778 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.793217  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.796245  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.799887  4575 raft_consensus.cc:1275] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:23:20.800488  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.800673  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.801324  3923 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:20.779970  9811 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.803018  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:20.803337  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:20.803601  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.802984  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:20.785810  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:20.783463  9832 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:20.805325  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.807848  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.784718  9945 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.805989  3848 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.786309  9914 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.811069  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:20.815151  9840 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.815793  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:20.816597 10022 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:20.811547  9998 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:20.820756  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:20.820785  9945 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:20.819523  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.822635  9902 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:20.821437  4574 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.825906  9945 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.827953  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.828127  3920 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:20.840770 10025 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:20.841476 10025 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.847262  3890 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.810163  9811 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.862497  9811 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.864315  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.867278 10040 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.872468 10020 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.875094 10020 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.875826  9908 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:20.879560 10058 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:20.880920  9669 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:20.883029 10025 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:20.886466  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.901500  4548 leader_election.cc:400] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:23:20.898355  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.901908  4548 leader_election.cc:403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:20.905009  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:20.906213  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:20.914710  9669 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:20.918143 10088 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:23:20.910826 10058 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:20.924204  4574 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:20.925540  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.928553  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.931489  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:20.933949  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.940694  3848 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:20.925545  9901 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11.
I20260709 12:23:20.930682 10103 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:20.955755  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.932720  9832 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:20.945354  9747 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:20.940740  9778 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:20.967408  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.976094  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:20.984820  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.986714  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:20.974347 10103 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.008474 10103 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:20.989826 10058 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:20.972043 10117 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:20.986387  9747 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:21.023530 10116 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:21.024469 10116 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:21.024737 10117 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.038178  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:21.038872  3924 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.040189  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:21.040808  3918 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.040215  3923 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:21.044222  3920 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:21.042294  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.046154  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:21.051333  3925 raft_consensus.cc:3055] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:21.051795  3925 raft_consensus.cc:740] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:21.069392  3924 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:21.071947  3815 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:21.059648  3925 consensus_queue.cc:260] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:21.081406  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 94761.3us
I20260709 12:23:21.056450 10040 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:21.084218  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.088809  9747 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.090744  3842 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:21.094126 10120 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:21.082420 10085 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:21.095074 10120 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:21.096029 10120 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:23:21.151693  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 67543.4us
I20260709 12:23:21.152565  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.153539 10058 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:21.159937  3919 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:21.165477  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.064383 10102 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:23:21.151978 10116 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.154031 10058 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.079515 10051 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:23:21.158522 10085 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:21.167744 10040 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:21.184896 10058 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:21.218889  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54125.2us
I20260709 12:23:21.224640  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:21.226202 10117 consensus_queue.cc:1048] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:21.227785 10117 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:21.226588 10111 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:23:21.242211  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.243491  3994 raft_consensus.cc:2410] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:23:21.248867  9461 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:21.249523  9461 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:21.256176  9937 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:21.256680  9937 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:21.257499  9937 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.258715  9937 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.260011  3845 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:21.266613  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 181384us
I20260709 12:23:21.267830  3918 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:21.235981 10121 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:21.279577  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.279827  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.280556  3993 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:21.288621  3815 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:21.291685  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.294394  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.295593  3992 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 17: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:21.299408  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.300107  3997 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:21.181828 10120 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.312356  3996 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:21.309265  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.313710  3998 raft_consensus.cc:2368] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
I20260709 12:23:21.313714  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.315814  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.316524  3991 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:21.316646  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.315701  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.320062  3998 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:21.325376  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.317853  3995 raft_consensus.cc:2376] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18. Re-sending same reply.
I20260709 12:23:21.329945  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.330598  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:21.332103  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:21.336021  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.336882  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.326262  3993 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:21.331301  4582 raft_consensus.cc:2376] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23. Re-sending same reply.
I20260709 12:23:21.341282  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.342566  3996 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.345515  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.350657  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.350930  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.351680  3994 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:21.337002  3992 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:21.354847  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:21.310747 10118 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:21.318823 10103 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:21.357631  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:21.364626  3991 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:21.368247  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:21.372416  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.356770  9902 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.353133  3993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:23:21.358026 10022 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:21.360157 10120 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:21.357059 10117 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:21.410452  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65027us
I20260709 12:23:21.357450 10020 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:23:21.358637 10127 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.373013  9914 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:21.311435 10040 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.411921  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.360579  9998 consensus_queue.cc:1048] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.049s
W20260709 12:23:21.437458  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 81005.4us
I20260709 12:23:21.409157 10103 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:21.514995  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:21.518944  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 107093us
I20260709 12:23:21.409152 10121 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:21.567607  4582 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:21.308761 10085 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.357250  9461 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.364826 10118 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.570240  3997 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:21.572089 10118 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:21.531213  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:21.565656  3993 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.573158  3993 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:21.515718 10127 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.528045  9811 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:21.531296  9778 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:21.580732  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49659.7us
W20260709 12:23:21.569299  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.412621 10117 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.564705  9832 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.599077  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.599381  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:21.577692  9914 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.601435  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.605353 10116 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.606040  3917 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:21.610630  3991 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:21.612812  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:21.575341 10121 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.583576 10127 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.655697  4582 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:21.625439  3889 leader_election.cc:400] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20.
W20260709 12:23:21.668901  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43602.3us
W20260709 12:23:21.665177  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.621505  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.616302  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.595270  9840 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:21.735359  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.687767  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.706833  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.692538  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.673372  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 18.
I20260709 12:23:21.776873  3993 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.723533  3921 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:23:21.631873 10131 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:23:21.632674 10133 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:23:21.630739 10135 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:23:21.629516 10130 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:23:21.614187 10020 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:21.619946  9902 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:21.799366  3922 raft_consensus.cc:2410] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:23:21.637813 10137 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.596542  9778 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.793604  3923 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:21.784368  9937 consensus_meta.cc:287] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:23:21.625168  9747 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.648212  9909 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:21.834053  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.656213 10145 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.805940  9981 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.611093  9832 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.882864 10121 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:21.613436 10022 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.220s
I20260709 12:23:21.658403 10146 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:21.667390 10116 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:21.855702  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 219032us
I20260709 12:23:21.620752  9811 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.217s
I20260709 12:23:21.619184 10117 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:21.883347  9832 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:21.850883  9747 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:21.891793  9747 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.892753 10116 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:21.884832  9778 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:21.885933 10058 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.012s
I20260709 12:23:21.893709 10058 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.894764  3995 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:21.885496  9981 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.886709 10145 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.897012 10058 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:21.897994 10145 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:21.898313  9981 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:21.886579 10136 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:21.858781  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.821841  9982 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:21.833204  3997 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:21.914508  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.833768  9902 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:21.889443 10127 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:21.667162 10103 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.854180 10104 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:21.850383 10137 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.831748 10021 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:21.872404  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3486) took 1166 ms. Trace:
W20260709 12:23:21.873807 10132 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:23:21.780655 10070 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:23:21.615410  9914 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.916230  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.938395  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.939195  3997 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:21.863628  9909 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.919840  3998 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:21.927651  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:21.902025 10154 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:21.923318  3917 rpcz_store.cc:276] 0709 12:23:20.705809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:20.705962 (+   153us) service_pool.cc:224] Handling call
0709 12:23:21.605793 (+899831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.612405 (+  6612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.872115 (+259710us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540024e350. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:21.872322 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068744448}
I20260709 12:23:21.953539  4547 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:21.949542  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:21.970791  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.974148  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.977415  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:21.978245  3918 raft_consensus.cc:2376] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14. Re-sending same reply.
I20260709 12:23:21.900815 10146 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:21.985430  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:21.985957  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:21.987236  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:21.989116  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:21.992132  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.992529  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.993759  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:21.994417  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:21.944322 10154 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:21.994107  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.993772  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:21.993585  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.027721  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:21.980098  9916 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.944043 10108 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:22.050982  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61879.5us
I20260709 12:23:22.058621  3997 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:22.063242  3922 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 18: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:21.991204 10121 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:21.921393  9982 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.086944  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.091785  3997 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:22.100507  3997 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:22.092911  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:21.938185 10104 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:21.937603 10021 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.116037  3997 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:22.118160  9982 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:22.119074  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 66733.2us
I20260709 12:23:22.125387 10025 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:22.118064  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 130894us
W20260709 12:23:22.120551 10120 consensus_meta.cc:287] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.000s
I20260709 12:23:21.991358 10051 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:23:22.050349  9847 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 12:23:22.067768 10018 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:22.160895  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.163486  3990 raft_consensus.cc:2368] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:22.164080  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:22.164130  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 176946us
I20260709 12:23:21.994590  9902 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:22.178710  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.190227  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:22.197432  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:22.208779  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 215274us
W20260709 12:23:22.205431  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.232018  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.159224  9937 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.161212 10025 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.225066  9982 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:22.256155  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.261768  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.269603 10137 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:22.255411 10071 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:22.271982  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.276194  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:22.263787  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.253319  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.264613  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.278330  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.264375 10087 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:22.282642 10087 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.285239 10087 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:22.300354  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.204427 10102 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:23:22.426187  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 148438us
I20260709 12:23:22.090180 10108 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:22.434801  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 277260us
W20260709 12:23:22.438055 10161 log.cc:927] Time spent T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:23:22.266248 10025 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:22.491788  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 239639us
I20260709 12:23:22.490288  3993 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.190331 10154 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.507090  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.252300  9937 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:22.532471  9747 consensus_meta.cc:287] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 12:23:22.533113  9747 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.534298  3922 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:22.539602 10169 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:23:22.510169 10070 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:22.576304 10070 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.576922 10070 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:22.581504 10154 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.543555 10171 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:22.584609 10171 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.591986 10101 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.592736 10101 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.595032 10101 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.563058  9902 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:22.564306 10146 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:22.566901 10021 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.569366  9937 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.571018 10108 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.571892  9909 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.638928  9835 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:22.641681  3843 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:22.641821  9835 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.572749 10104 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.527630 10087 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:22.646723 10087 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.596655  9747 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.647327  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 899) took 1050 ms. Trace:
I20260709 12:23:22.510541  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52870 (request call id 2582) took 1204 ms. Trace:
I20260709 12:23:22.647816  3992 rpcz_store.cc:276] 0709 12:23:21.596983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.597110 (+   127us) service_pool.cc:224] Handling call
0709 12:23:21.597765 (+   655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:21.806694 (+208929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.806742 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:21.829265 (+ 22523us) log.cc:844] Serialized 26 byte log entry
0709 12:23:21.986202 (+156937us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:21.986241 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.646874 (+660633us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540002ec54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:22.646923 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.646967 (+    44us) raft_consensus.cc:1685] finished
0709 12:23:22.647027 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.647241 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5712,"raft.queue_time_us":5848,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":17912,"spinlock_wait_cycles":466226944,"thread_start_us":118374,"threads_started":1,"wal-append.queue_time_us":280510}
I20260709 12:23:22.649240  3993 rpcz_store.cc:276] 0709 12:23:21.309720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.352979 (+ 43259us) service_pool.cc:224] Handling call
0709 12:23:22.472323 (+1119344us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540002f154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529eaa3d 00007fdc579bacd0 00007fdc50f3f254 00007fdc50f3f1e2 00007fdc50f3f111 00007fdc50f3f08c 00007fdc50f3e342 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:22.504939 (+ 32616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395819904}
I20260709 12:23:22.607160  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.611547  3848 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:22.651679  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 662580us
I20260709 12:23:22.652233  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.652578  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:22.654356  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.615312  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 106639us
I20260709 12:23:22.612414  3846 raft_consensus.cc:1240] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:22.655936  3889 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:22.633598 10125 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.256s	user 0.005s	sys 0.000s
I20260709 12:23:22.657128  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.615788 10010 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.658612  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3497) took 1619 ms. Trace:
I20260709 12:23:22.659647 10121 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:22.660413 10121 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.660895 10121 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.661634 10160 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:22.661674 10141 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:22.662271 10160 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:22.662474 10141 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:22.663640 10141 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.664719 10117 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:22.641072  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.663133 10121 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:22.659013 10010 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.669834 10010 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.670751 10160 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.654268  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.671322 10183 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:22.671988  9747 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:22.681445  4547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.034s
W20260709 12:23:22.681931  4547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.034s
W20260709 12:23:22.682227  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 566898us
I20260709 12:23:22.682840  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:22.672293  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.636946  3998 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 12:23:22.673522  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:22.683686  3998 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:22.647267 10087 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:22.674197  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.685006  4575 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:22.675618  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.675889  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.676560  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.658999  3916 rpcz_store.cc:276] 0709 12:23:21.038815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.039258 (+   443us) service_pool.cc:224] Handling call
0709 12:23:21.039598 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:21.039953 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.039980 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:21.040457 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:23:21.188064 (+147607us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:21.188106 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.188173 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.632911 (+1444738us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:22.658317 (+ 25406us) raft_consensus.cc:1685] finished
0709 12:23:22.658341 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.658544 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"spinlock_wait_cycles":446895488,"thread_start_us":107285,"threads_started":1,"wal-append.queue_time_us":257020}
I20260709 12:23:22.678620  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.678874  9835 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.679816  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:22.652663 10110 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:22.702713 10110 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.680631  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.613327 10171 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:22.672106  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52870 (request call id 2566) took 1381 ms. Trace:
I20260709 12:23:22.689637  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.707633 10127 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:22.707959  9835 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:22.706538 10183 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.710556 10157 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:22.711869 10039 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.712291 10039 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:22.712543  4547 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:22.699159  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44976.6us
I20260709 12:23:22.713176 10039 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.714707 10039 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.717237 10127 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:22.717571  9908 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:22.718096  9908 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.718636 10071 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.718883  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.719800  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.720222  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.722287  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.707729  3990 rpcz_store.cc:276] 0709 12:23:21.290304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.309197 (+ 18893us) service_pool.cc:224] Handling call
0709 12:23:22.671903 (+1362706us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400002154. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:22.672044 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951660288}
I20260709 12:23:22.701465 10070 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.711127 10183 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.728845 10070 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.734037  3919 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:22.752931  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.766759  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.701912 10104 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:22.778537  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.772852  3746 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 9 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.783829  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.759194 10127 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:22.779207  3962 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:22.719262 10071 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.764086 10011 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:22.768957 10118 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:22.798199  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:22.721936  9747 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:22.798743  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 293872us
I20260709 12:23:22.812866  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.814709  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:22.824461  3917 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:22.824822  3917 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:22.825570  3917 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.826610  3917 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.815825  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:22.817801  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.819806  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:22.781713 10137 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:22.783967 10103 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:22.827394  3889 leader_election.cc:400] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:22.828039  4581 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:22.790048  9840 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:22.787032 10120 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:22.830299  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.833333  3889 leader_election.cc:403] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:23:22.836444  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.842106  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.798687 10011 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.807096 10117 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:22.783587  9937 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:23:22.846836 10011 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:22.863080  9747 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:22.843879 10187 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:23:22.864449 10164 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:22.864980 10108 consensus_queue.cc:1059] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:22.866056 10108 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:22.866612 10108 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.869602  3917 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:22.834121  9945 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.877367  4581 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:22.837906 10127 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:22.878317  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80565.6us
I20260709 12:23:22.841215 10118 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:22.852499 10166 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:22.842711 10103 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.875627  9747 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.881487  9945 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.948719  9747 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:22.950520  9945 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:22.951047  9747 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:22.954103  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.903699  9461 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:22.953662  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:22.905046 10184 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:23:22.884261 10127 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:22.945956  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 222002us
I20260709 12:23:22.911535 10108 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:22.954121 10186 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
I20260709 12:23:22.981771  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.992067  3845 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:22.986903  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.001392  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.001751  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.004542  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.010095  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:22.962939  9998 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:22.967516 10193 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.015961  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.995721  9840 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.006702 10137 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.954612 10118 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:22.972831 10025 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.034087  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:22.979722  9747 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:23.031970  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.023960 10030 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.056202  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3555) took 1178 ms. Trace:
I20260709 12:23:23.069167 10127 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.071991 10103 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.023684  9998 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.074869  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.045790  9840 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.027174 10193 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.055474 10071 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.183198  3925 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.050120 10137 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.194053 10137 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:23.081103  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.084795 10118 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.086997 10025 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.092690  9981 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.093641  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.242769  3846 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:23.047848 10195 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.094959 10117 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:23.095016 10120 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:23.125886 10108 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:23.126591  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 122136us
I20260709 12:23:23.252545  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.134877 10181 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.145133 10030 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.135280  3999 rpcz_store.cc:276] 0709 12:23:21.877659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.028684 (+151025us) service_pool.cc:224] Handling call
0709 12:23:22.029081 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.656282 (+627201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.656314 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.656771 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.782161 (+125390us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:22.831559 (+ 49398us) log.cc:844] Serialized 14 byte log entry
0709 12:23:23.018304 (+186745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.018435 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:23.055954 (+ 37519us) raft_consensus.cc:1685] finished
0709 12:23:23.055977 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.056132 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626739,"prepare.queue_time_us":73718,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":650629,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":10351,"spinlock_wait_cycles":28468480,"thread_start_us":335948,"threads_started":3,"wal-append.queue_time_us":142948}
I20260709 12:23:23.168124  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:23.177177  9995 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.178532  9840 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.180606 10193 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.158761 10087 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.245440  3925 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:23.258955  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.258322  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.261026  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:23.273835  3845 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:23.275161  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3495) took 2227 ms. Trace:
I20260709 12:23:23.295717  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:23.296271  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 43846.8us
I20260709 12:23:23.296183  4575 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:23.297160  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.299696  3924 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:23.275632  3925 rpcz_store.cc:276] 0709 12:23:21.038200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.038320 (+   120us) service_pool.cc:224] Handling call
0709 12:23:21.051208 (+ 12888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.633317 (+582109us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b18001f16a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52a2e646 00007fdc5296858e 00007fdc529e9f9e 00007fdc529eb7de 00007fdc529f5b49 00007fdc529f6416 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4
0709 12:23:23.182537 (+1549220us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5800a06dd0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5294f0aa 00007fdc529d1447 00007fdc529e9fe7 00007fdc529eb7de 00007fdc529f5b49 00007fdc529f6416 00007fdc529f2d8f 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4
0709 12:23:23.265398 (+ 82861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.265617 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464150144}
I20260709 12:23:23.251243  9981 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.268364  9909 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.263134 10108 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:23.308816  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.304170  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:23.275401 10118 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:23.275378 10196 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.295924 10127 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.308591 10202 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:23.264402  9995 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.329519 10200 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:23.331465  9995 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.330394 10200 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.321905  3890 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.353475  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.354394 10201 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:23.355403  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.357054  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.361291  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.323974  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:23.335616 10117 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:23.375190  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.340816 10137 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:23.341640  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.375885  3992 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:23.342228  9981 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.342686 10121 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.343326  9998 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.315047 10154 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:23.385195  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.385907  3992 raft_consensus.cc:2376] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19. Re-sending same reply.
I20260709 12:23:23.344029 10202 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:23.345485  3841 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:23.346029  3996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3542) took 1731 ms. Trace:
I20260709 12:23:23.389030  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.346690 10108 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.261852 10181 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.347316 10118 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.253091 10195 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.311075  9909 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.349651 10087 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.305779 10193 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:23.400995  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.401105  3993 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:23.401960  3846 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:23.365844  3918 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:23.366590  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.403375  3990 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:23.404814  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.405639  3990 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:23.369115  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.335726 10127 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:23.377777  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.389681  3992 raft_consensus.cc:2376] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18. Re-sending same reply.
W20260709 12:23:23.390946  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74949us
I20260709 12:23:23.435290  3918 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:23.389163  3996 rpcz_store.cc:276] 0709 12:23:21.614467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.614681 (+   214us) service_pool.cc:224] Handling call
0709 12:23:21.615673 (+   992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.670722 (+1055049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.670755 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.671199 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.782640 (+111441us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:23:22.782687 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.345651 (+562964us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54001982d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:23.345702 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:23.345749 (+    47us) raft_consensus.cc:1685] finished
0709 12:23:23.345760 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.345970 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387151,"raft.queue_time_us":384233,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1544060160,"thread_start_us":111116,"threads_started":1,"wal-append.queue_time_us":103752}
I20260709 12:23:23.446709  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.447480  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.452409  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.451923  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:23.457018  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.362208 10011 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.457672  3992 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:23.464748  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.465866  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.466176 10011 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.469012 10195 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.470985 10118 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.458027 10127 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.472747 10110 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.474160 10127 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.474769  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.475361  3998 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.475564  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.476153  9914 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.476686  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.478922  3996 raft_consensus.cc:1240] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:23.396946 10154 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.480733  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:23.481379 10154 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.407523 10193 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:23.481873  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.482125 10193 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:23.483033  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.483741 10030 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.485474  9669 raft_consensus.cc:3055] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:23.485834  9669 raft_consensus.cc:740] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:23.486280  3998 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:23.486689  9669 consensus_queue.cc:260] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.382782 10117 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.487636  3998 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:23.489285 10011 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:23.388860 10137 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:23.489842 10011 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.490415 10137 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.492942 10200 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.493167  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.495507 10025 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:23.496337 10138 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:23.496884 10138 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.497443  3998 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:23.497963 10011 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.499096 10138 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.429455  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.493054  3962 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:23.462641  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.384812 10121 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.496080 10025 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.459389  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.453191  3991 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:23.405486 10202 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.374611 10196 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.500638  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:23.501439  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46552us
I20260709 12:23:23.503490  3918 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:23.460162  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:23.503510  3990 raft_consensus.cc:2410] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:23:23.544368  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 84318.6us
I20260709 12:23:23.545274 10108 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:23.545732 10108 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.546111 10108 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.545779  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:23.514658  4547 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:23.489311 10117 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.520499  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.536285  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.541211  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.590011  3846 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:23.547652  9979 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:23.577955  3814 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:23.587114 10196 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.516182  9669 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.592634  3814 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:23.593806 10171 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:23.594292 10171 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:23.594731 10171 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:23.596199  9981 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:23.597891 10121 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.601306  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.602075  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.602276 10011 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:23.602507  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 87962.1us
I20260709 12:23:23.602859  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.603796  3922 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:23.604617  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.604861  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.605587  4581 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 19: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:23.607335  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.609354  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.610055 10202 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.515365  9998 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:23.610884  9998 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.611330  9998 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:23.611900  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:23.612507  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:23.540226 10209 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:23.615784 10108 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.616277  9908 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.616943 10181 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.618249 10181 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:23.618336 10108 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.618737 10181 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.580137  3815 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:23.584910  3842 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:23.619729  3992 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:23.619907  3814 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:23.616940  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.623982  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:23.624271  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44228.5us
I20260709 12:23:23.613436  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.625093  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.625859  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.627205  3814 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:23.629204  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.630000  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.637497  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.653728  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.641543  9847 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:23.616328 10209 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.620698 10165 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:23.636196 10020 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:23.619306 10181 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:23.682400  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.647403  9908 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:23.648887 10180 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:23.658085  3814 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:23.619122 10193 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.660370  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.637447  9979 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:23.680501  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.694705  3996 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:23.680600  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:23.685103  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:23.658771  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.698421  3992 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:23.683092  3991 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:23.701773  3889 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:23.702340  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.656368 10183 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:23.705266  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:23.706398  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:23.708068  4582 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:23.708278  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.708576 10201 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:23.709659 10105 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:23.711362  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:23.715457  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:23.716325  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.717336 10117 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:23.740962  9461 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:23.721711 10020 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.723718 10209 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.699852  9981 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:23.699323  9979 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.661839 10108 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:23.736476  4578 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:23.684139 10087 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:23.737473  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.705330  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:23.746783  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.749096  9981 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.762559  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.748652  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:23.741391 10208 log.cc:927] Time spent T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:23.731458  9747 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:23.775619  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.758334  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.761492  4580 raft_consensus.cc:2393] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 11: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:23.739876 10117 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.777590 10117 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.777882 10193 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.755918  9979 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:23.735002 10171 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.784924  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.785631 10171 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:23.750610 10201 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:23.749681 10020 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.786054  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.769629  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.776108 10025 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.785868  3916 raft_consensus.cc:2393] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 15: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:23.791297  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.764012  3992 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:23:23.801597  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:23.808079  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59513us
I20260709 12:23:23.802956 10020 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:23.809031  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.809988  3919 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:23.810935  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.832383  3923 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
I20260709 12:23:23.746965  4579 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:23.853127  3991 raft_consensus.cc:1240] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:23.853269  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63478.7us
I20260709 12:23:23.854761  4546 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.855792  3844 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:23.857750  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.859606  4578 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:23.860987  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:23.789820  9981 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.866581  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:23.869942  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61007us
I20260709 12:23:23.871209  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.799934 10170 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:23.898463  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.802959 10165 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.901258  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:23.918385  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:23.920248  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.922881  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:23.918404  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.925773  9914 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:23.900151 10170 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:23.955902 10170 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:23.786880 10201 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.900648 10200 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:23.902396 10011 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:23.966408  9998 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:23.968191  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:23.968622  9998 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:23.924584 10165 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:23.906893  9901 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.974316 10181 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:23.969204  3844 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20.
I20260709 12:23:23.978116 10118 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:23.979637  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 56874.5us
I20260709 12:23:23.980437  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.987541  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.991575  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:23.981818 10196 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:23.982913  9914 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.006143  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:23.959158 10117 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.011863  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:23.911972 10044 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 12:23:24.011399 10202 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:24.016601  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.007159  9914 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:24.040809  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.008314 10118 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:24.011493 10117 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:24.039358  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.014289 10202 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:24.046167 10206 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:24.047657  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.048298  3992 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:24.049583  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.051353  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.037750  9998 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:24.013936  3962 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20.
I20260709 12:23:24.072366  3962 leader_election.cc:403] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:23:24.073166  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61157.3us
W20260709 12:23:24.075505  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 366353us
I20260709 12:23:24.078229  3814 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:24.012324  9979 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.039547 10200 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:24.094606  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.095324  3996 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:24.046455 10202 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:24.102681  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 373831us
I20260709 12:23:24.103596  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:24.014640 10170 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.117321  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.095050 10117 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:24.126794  3992 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:24.122435  3995 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:24.124485  9979 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.115653 10051 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:24.127255  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.134958  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.138379  4581 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:24.139325  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:24.141585  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.146672 10210 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.094126 10102 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:23:24.151176  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.125411 10105 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:24.157783 10105 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.158243 10105 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.132484 10051 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:24.159099 10051 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:24.110450 10137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.014s	sys 0.006s
I20260709 12:23:24.155973  3999 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:24.140694 10206 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:24.157259  3995 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:24.162197  3996 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:24.162500  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.173130  9909 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.180751 10170 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.147835 10200 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:24.183295  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.184990  3995 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:23:24.185488  3995 pending_rounds.cc:85] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 10
I20260709 12:23:24.185760  3995 pending_rounds.cc:107] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:23:24.186064  3995 raft_consensus.cc:2889] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:24.197070  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.197960  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.199851  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.199980  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.201808  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:24.208597  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.209779  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.211279  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.156867 10181 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:24.167145 10137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.006s
I20260709 12:23:24.213738  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.178846 10165 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.222704  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.222707  3815 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:24.221441 10025 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:24.231055  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 326032us
I20260709 12:23:24.213409 10087 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:24.234503  3993 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:24.221062 10214 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:24.221359 10021 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:24.221570  9979 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:24.266170  9979 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.268525  9979 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:24.265013  9981 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.272492 10086 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:24.272967 10086 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:24.243369 10224 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.237414 10214 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:24.228148  9902 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:24.243851 10171 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:23:24.259413 10021 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.263981 10118 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.264415  9461 consensus_queue.cc:1059] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:24.229916 10108 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:23:24.274809  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52218.6us
I20260709 12:23:24.288617  3889 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.274061  9981 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.292518 10021 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:24.294075  3999 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:24.298758  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.241767 10071 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:24.302376  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.274503 10154 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.274233 10214 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:24.310482  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.274273  9902 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:24.310545  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.323567  3850 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:23:24.300813  9908 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.277298 10025 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:23:24.326706  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.280131  9669 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:23:24.273892 10086 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.332780  3850 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:24.332623  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:24.313344  9979 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:24.337060  3889 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:24.278124 10226 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:23:24.344952  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.315181 10118 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:24.319732  9902 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:24.319252  9909 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:24.325742 10170 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.366740  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:24.346560  9979 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:24.350246 10203 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:24.316390 10071 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.358590  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.321066 10171 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:23:24.331285 10070 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:23:24.360653 10087 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:24.416013  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 136894us
I20260709 12:23:24.396656  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.397852  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.403785  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:24.404431 10171 raft_consensus.cc:3055] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:24.347939 10154 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:23:24.410027  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51572.3us
I20260709 12:23:24.376775 10117 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20.
I20260709 12:23:20.598796  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:24.424455  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 148445us
I20260709 12:23:24.485947  3888 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.360328  9908 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:23:24.473595  3998 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:24.474947 10102 consensus_queue.cc:1059] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:24.476095  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:24.489276  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:24.491647 10103 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.362538 10170 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.492518 10103 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:24.360361 10118 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.493129 10103 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:24.494580 10170 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.478237 10110 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.415571 10087 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.480651 10165 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.415272 10152 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:24.494122 10103 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.515753  3888 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.497699  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.476724 10071 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:24.499594  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57169.2us
W20260709 12:23:24.478307  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81778us
I20260709 12:23:24.508150  3843 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 21. Current term is 22. Ops: []
W20260709 12:23:24.508718  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 171742us
I20260709 12:23:24.512909  3996 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:24.520941  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:24.429463 10171 raft_consensus.cc:740] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:24.553658  3889 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.510097 10087 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:24.558874 10203 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.494612 10118 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:24.562773  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 47538.2us
I20260709 12:23:24.521067 10139 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:24.560844 10230 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:24.570739 10230 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.509686 10105 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.573014 10230 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.573879 10171 consensus_queue.cc:260] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.578085 10105 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.579748  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:24.581813  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:24.585333  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:24.551579 10102 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:23:24.588447  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:24.589232  4578 raft_consensus.cc:2368] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20.
W20260709 12:23:24.589267  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.590586 10171 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:24.590770 10051 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.593088 10051 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.597257  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:24.563877 10201 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:24.599537  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.607919  4578 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:24.609047  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 48442.8us
I20260709 12:23:24.560271 10071 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:24.633679  9747 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:24.633842  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:24.633889  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 80322.3us
I20260709 12:23:24.634280  9747 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:24.635310  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.635689  3964 leader_election.cc:400] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20.
I20260709 12:23:24.635304  9747 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.636718  9909 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.639824  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.644842  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.654181  3964 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.662681  3890 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.666190  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.599560 10201 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:24.676681 10201 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:24.677850 10201 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.633081 10214 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.681264 10214 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:24.674973 10020 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:24.666883 10120 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:24.679298 10201 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:24.687433  3994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3573) took 1320 ms. Trace:
I20260709 12:23:24.715282  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:24.716837  3846 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:24.718207  3999 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:24.706933  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:24.719558  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:24.719725  3920 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:24.696022  3842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1519) took 1034 ms. Trace:
W20260709 12:23:24.709198  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 145658us
I20260709 12:23:24.726588  4548 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:24.709198  3746 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 9 to 11, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:24.713503  3994 rpcz_store.cc:276] 0709 12:23:23.366762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.366878 (+   116us) service_pool.cc:224] Handling call
0709 12:23:23.385018 (+ 18140us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:23.655884 (+270866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.655948 (+    64us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:23.687112 (+ 31164us) log.cc:844] Serialized 52 byte log entry
0709 12:23:24.045247 (+358135us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:24.686478 (+641231us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18002ad4e0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc563eb3c7 00007fdc529fd9a7 00007fdc52a0d0bf
0709 12:23:24.686665 (+   187us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.686931 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.687020 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:24.687067 (+    47us) raft_consensus.cc:1685] finished
0709 12:23:24.687168 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.687348 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1698,"prepare.queue_time_us":241632,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":29559,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":12976,"spinlock_wait_cycles":7270144,"thread_start_us":828647,"threads_started":3,"wal-append.queue_time_us":503929}
I20260709 12:23:24.762979  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:24.700489 10025 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.697173 10020 raft_consensus.cc:3055] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:24.764464  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 91938.6us
W20260709 12:23:24.696076 10219 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.343s	user 0.005s	sys 0.000s
I20260709 12:23:24.724237  3842 rpcz_store.cc:276] 0709 12:23:23.662006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.687199 (+ 25193us) service_pool.cc:224] Handling call
0709 12:23:23.730456 (+ 43257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.780065 (+ 49609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.780102 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.780160 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:23.780195 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.695777 (+915582us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b5400118fd4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:24.695827 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.695949 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113451776}
I20260709 12:23:24.670552 10239 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:24.774463  3846 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:23:24.687597 10138 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:24.702373 10193 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.783154  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.783492  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:24.765076  9773 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:24.770042 10202 consensus_meta.cc:287] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.003s
I20260709 12:23:24.785831  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.765064  9747 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.787729  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:24.771494 10020 raft_consensus.cc:740] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:24.807268  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.774551 10025 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.789188  3917 raft_consensus.cc:1240] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:24.789623  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.781816 10150 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.698346 10237 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:23:24.786762  3843 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:24.691215  9902 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.720692  9908 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:23:24.768342 10146 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:24.811609  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.812579  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:24.798694  9773 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.786715 10021 consensus_queue.cc:1059] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:23:24.809278  9747 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.819420  9902 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.819631  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:24.821964 10025 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:24.826421  3843 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:24.865638  3994 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:24.838380  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:24.865897  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 97959us
I20260709 12:23:24.867743  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:24.855964  3921 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:24.857925  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:24.859201  3998 raft_consensus.cc:1240] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:24.855687  9773 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:24.869758  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:24.806617 10202 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:24.814692 10150 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:24.880127 10051 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:24.913690  3993 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:24.887804 10171 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:24.891796  9908 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:23:24.979611 10202 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:24.984651 10071 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:24.985252 10071 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:24.989348 10245 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:23:24.990506  9979 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:24.993808 10246 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:23:24.994514  9902 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:25.001843 10146 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:24.918365 10154 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:23:25.005079  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 148186us
W20260709 12:23:25.009146 10240 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.360s	user 0.004s	sys 0.000s
I20260709 12:23:25.012178 10227 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:24.931486 10025 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:23:25.005905  9902 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.011217 10146 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.029886 10154 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:25.031636  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:25.030710 10146 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:25.032927  9908 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:25.033381  9908 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.034317  9908 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:25.030747 10242 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.371s	user 0.005s	sys 0.000s
W20260709 12:23:25.021086  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 142107us
W20260709 12:23:25.053042  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 166295us
I20260709 12:23:25.023247  9979 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:25.021397 10227 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:25.075356  4581 raft_consensus.cc:1240] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:25.080569  9747 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:25.064669 10224 raft_consensus.cc:3055] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:25.081350 10224 raft_consensus.cc:740] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:25.082300 10224 consensus_queue.cc:260] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.083635  9902 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.085057  9902 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:25.086993 10071 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:25.088593 10071 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:25.059605 10087 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.092391 10087 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:25.094151  3918 raft_consensus.cc:2410] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:23:25.096628  3919 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:25.098681 10150 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:25.100252 10227 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.101631 10224 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:25.102043  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.117859 10183 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:25.118418 10183 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.138230  4582 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:25.138916  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:25.186007  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 158449us
I20260709 12:23:25.119382 10183 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:25.195649  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.195796  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.196435  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59005.9us
I20260709 12:23:25.198789  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:25.199014  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:25.199812  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:25.208716  3999 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:25.200800  3997 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
W20260709 12:23:25.197481  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.211820  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:25.373399  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:25.374065  3847 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:25.218884  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.268437  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 346544us
I20260709 12:23:25.304618  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3598) took 1114 ms. Trace:
I20260709 12:23:25.394007  3847 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:25.347862  4576 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:25.355105  9811 raft_consensus.cc:3055] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:26.119520  9811 raft_consensus.cc:740] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.270215  9773 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:25.359156 10070 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:26.124300 10070 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.266481 10086 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:25.213161 10146 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.131718 10146 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.134256 10146 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:25.306315 10127 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.135697 10127 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.220007 10167 consensus_queue.cc:1059] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:23:25.300870 10244 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.653s	user 0.002s	sys 0.000s
I20260709 12:23:25.248742 10214 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:25.242331 10183 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:25.221225 10262 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:25.761610  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.180576 10262 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:25.867128  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.184370 10087 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.185160 10086 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.185710 10086 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.186452 10154 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:26.186661  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.188542 10154 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:26.188717 10086 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.184893 10087 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.191128 10087 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.192304 10154 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:25.867296  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.193526 10262 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.194046 10154 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.196357  9811 consensus_queue.cc:260] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.197733  9811 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:25.889011 10071 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.199792 10071 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.202948 10071 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:25.892230  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.897221 10193 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.909571 10273 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.204278 10193 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:25.911595 10274 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.207769 10274 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.210369 10274 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:25.922262 10237 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.211222 10237 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.213837 10237 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:25.931627 10230 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.214529 10230 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.216936 10230 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:25.936277 10201 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:25.940004  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:25.946079  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:26.220885 10201 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:25.957401 10275 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.225502 10275 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.227818 10275 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.228317 10275 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.228775 10275 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.204317 10273 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.230825 10275 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:25.958189 10020 consensus_queue.cc:260] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:25.966145 10205 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.235766 10270 consensus_queue.cc:1059] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:25.971740 10276 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.236164 10205 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.236961 10276 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.238845 10205 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:25.981319  9998 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.239741  9998 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:25.985801 10269 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.243713 10269 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.246165 10269 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:25.987267 10277 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.231353 10275 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.246927 10277 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.249444 10277 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:25.988380  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.250236  3921 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:25.989427 10025 consensus_queue.cc:1059] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:26.001695  3917 raft_consensus.cc:1240] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:26.004431  3916 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:26.019423  3746 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:26.027956  3992 rpcz_store.cc:276] 0709 12:23:24.190452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.214406 (+ 23954us) service_pool.cc:224] Handling call
0709 12:23:24.214723 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:24.219150 (+  4427us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:24.692389 (+473239us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800282220. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f8e8e07 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc563eb3c7 00007fdc529fd9a7 00007fdc52a0d0bf 00007fdc52a0d038
0709 12:23:24.870700 (+178311us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.006284 (+135584us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.021967 (+ 15683us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.022139 (+   172us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:25.022231 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.022326 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.303710 (+281384us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b24002c4428. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f78c9c4 00007fdc4f78aacb 00007fdc4f945dc9 00007fdc4f945a55 00007fdc4f944fb0 00007fdc525bb488 00007fdc525bbbe8 00007fdc52593398 00007fdc5258e76a 00007fdc5258dbb6
0709 12:23:25.304386 (+   676us) raft_consensus.cc:1685] finished
0709 12:23:25.304406 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.304534 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6609,"prepare.queue_time_us":73357,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6834,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":8241,"spinlock_wait_cycles":27542784,"thread_start_us":255793,"threads_started":2,"wal-append.queue_time_us":140993}
I20260709 12:23:26.035336 10117 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.253358 10117 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.254446  3924 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 11.
W20260709 12:23:26.047314  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.256166  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.078058 10227 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:26.091342  9908 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.268730  9669 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.269353  9669 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.271601 10150 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.272197 10150 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.274621 10150 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:26.105428  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 904655us
I20260709 12:23:25.931216  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:26.115994 10202 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.282351 10205 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:26.282539  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 351416us
I20260709 12:23:26.113729  9979 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.283062 10205 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.283787  9979 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.285478 10205 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.140278 10127 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.286899  9979 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.138677  4577 raft_consensus.cc:2368] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:23:26.141371  9773 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.149856 10152 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.153807 10038 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.288002 10152 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.157675 10253 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.158246 10247 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.289065 10253 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.289332 10247 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.289814  4577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 887) took 1151 ms. Trace:
I20260709 12:23:26.290284  4577 rpcz_store.cc:276] 0709 12:23:25.138519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.138661 (+   142us) service_pool.cc:224] Handling call
0709 12:23:26.289544 (+1150883us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54004b37d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:26.289716 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297208704}
I20260709 12:23:26.144433 10146 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.291265 10253 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.282186 10202 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.291802 10146 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.293876 10202 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.139187  3990 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:26.286070 10205 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.294443 10146 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.288053 10038 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.295135  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3619) took 1084 ms. Trace:
I20260709 12:23:26.295550  3990 rpcz_store.cc:276] 0709 12:23:25.211265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.211420 (+   155us) service_pool.cc:224] Handling call
0709 12:23:26.294949 (+1083529us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400350054. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:26.295064 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766670592}
I20260709 12:23:26.246989 10275 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.296694 10038 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.297065 10152 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.298009 10275 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.173092 10214 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:26.157248  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.319387 10275 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.324612 10275 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.327039 10275 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.328235  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:26.329530  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:26.331681 10281 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.332793 10281 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.335129 10281 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.345127  3964 leader_election.cc:400] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:26.345858  3964 leader_election.cc:403] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:23:26.336643  4575 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:26.337639  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.339828  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.347838  3843 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:23:26.349234  3842 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:26.350790  3746 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 10, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 10 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:26.353673  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.354302  3843 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:26.357288  9669 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.357966 10224 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:26.358428 10201 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.357277 10087 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.359686 10087 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.207429 10193 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.361953 10087 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.336624 10152 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.363677 10154 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.364169 10152 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.364512 10154 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.366577 10154 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.367880  3815 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:26.369267  3815 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:26.372135  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.374426  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.375864  3847 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:23:26.239288 10276 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.377022  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.359597 10146 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:26.379352  4577 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:26.380822  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:26.382357  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.400272  3843 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:26.343950 10273 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.390841  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.396368  3746 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:26.397773  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46342.8us
I20260709 12:23:26.403963  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:26.389866  9979 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:26.407909 10087 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.408500 10087 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:26.409950  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08002079c0 after lost signal to thread 2680
I20260709 12:23:26.410660 10087 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:26.402794  4575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35182 (request call id 976) took 1840 ms (client timeout 2127 ms). Trace:
I20260709 12:23:26.351016 10117 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.366612 10152 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.388360  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.343730 10150 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.390600 10214 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.421311  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:26.424219  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.413085  3842 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 22: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:26.411922  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.419972  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:26.454771  3990 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:26.422322  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.455935  3992 raft_consensus.cc:2410] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:23:26.397471 10193 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:26.457026  3889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.456408  3746 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 7 to 12, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 12 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.396313  9998 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.458534  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.422233  3999 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:26.461169  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:26.438663  4575 rpcz_store.cc:269] 0709 12:23:24.562901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.563035 (+   134us) service_pool.cc:224] Handling call
0709 12:23:26.402611 (+1839576us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540012b1d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:26.402728 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3935334272}
I20260709 12:23:26.470176  3842 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:26.444146  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.471299  3847 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:26.445182  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.471782  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.461737 10071 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.389706 10275 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.446329  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.475530  3997 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:26.390069 10051 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:26.411139  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08000f7020 after lost signal to thread 3782
I20260709 12:23:26.450768  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.494848  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:26.495115  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08000bcde0 after lost signal to thread 3874
I20260709 12:23:26.496030  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:26.496389  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ec0 after lost signal to thread 3949
W20260709 12:23:26.496712  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ee0 after lost signal to thread 3950
I20260709 12:23:26.496738  3841 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:26.418484  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.402964 10224 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:26.404208 10269 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.461374  3746 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.461647 10251 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.441533 10127 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:26.468550 10247 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.467666  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.468402  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.508390  3849 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:26.508791  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:26.443545 10202 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:26.469053  3745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 288) took 16210 ms (client timeout 15000 ms). Trace:
I20260709 12:23:26.404882  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.447305  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.449010 10183 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:26.473099  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61356.4us
I20260709 12:23:26.454097 10167 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.453812  9902 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.475775  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.520056  3842 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:26.475396 10071 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:26.521683  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 127055us
I20260709 12:23:26.487828 10249 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.526507 10249 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.488602 10139 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.491987 10070 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.411201 10087 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.411908  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:26.498234  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9720 after lost signal to thread 4023
I20260709 12:23:26.465902 10193 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.498476  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:26.541523  3871 debug-util.cc:398] Leaking SignalData structure 0x7b0800399820 after lost signal to thread 4608
I20260709 12:23:26.541837  3999 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
W20260709 12:23:26.541836  3871 debug-util.cc:398] Leaking SignalData structure 0x7b08002875c0 after lost signal to thread 4609
I20260709 12:23:26.542871  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:26.459158  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.502490  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:26.543488  3871 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa20 after lost signal to thread 10231
I20260709 12:23:26.503693  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.544389  3993 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:26.465945  3992 raft_consensus.cc:1240] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:26.512560  3848 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:26.513003  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.519915  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.457823 10150 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.547887  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.550544  3921 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 18.
I20260709 12:23:26.482533  3990 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:26.483698 10275 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.525236  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.464632  9979 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:23:26.555416  9979 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:26.555809  9979 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:26.556648  9979 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.557000  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:26.557821  9979 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:26.558972  3815 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.535120  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.562009 10150 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.511361 10269 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.538560  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:26.563086  3916 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.563599 10071 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.564127 10269 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.532553  9902 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.549633  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.566251  9902 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.566761 10087 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.568753  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.569021 10087 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.537318 10167 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.570026  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.546833  3999 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:26.549386 10239 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.549002 10025 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.571354  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.572501 10239 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.559630 10283 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:26.511936 10251 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.574667 10239 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.574757  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.575982 10251 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.576081  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.572932  3843 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:26.577065 10025 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.579206 10025 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.561563 10275 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.549166  9908 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.580068  9908 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.581969 10281 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:26.582317  9908 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.534358  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:26.583904  3994 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:26.583101  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:26.539598 10249 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.584584  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.571817  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.586239  3847 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:26.587246  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.552569  3849 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:26.591162 10281 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:26.592204 10281 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:26.593750  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.594455  3850 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:26.595685 10283 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:26.597249 10276 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.597924 10283 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.597800 10276 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.598372 10283 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:26.593258 10281 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.599836  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.602484  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.537058 10202 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:26.550232 10139 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.571981  9811 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:26.603422  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.587484  3845 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
W20260709 12:23:26.509626  3745 rpcz_store.cc:269] 0709 12:23:10.245272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.245584 (+   312us) service_pool.cc:224] Handling call
0709 12:23:10.686226 (+440642us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295d090 00007fdc529fbf3a 00007fdc587b1e9c 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:26.455500 (+15769274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:19.110071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:19.110823 (+   752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:19.110871 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:23:19.110889 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:19.294908 (+184019us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:19.295049 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:19.295081 (+    32us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:23:19.296636 (+  1555us) tablet.cc:701] Row locks acquired
0709 12:23:19.296694 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:23:19.296896 (+   202us) write_op.cc:270] Start()
0709 12:23:19.297090 (+   194us) write_op.cc:276] Timestamp: P: 1783599799296826 usec, L: 0
0709 12:23:19.297132 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:23:19.297979 (+   847us) log.cc:844] Serialized 6717 byte log entry
0709 12:23:19.807848 (+509869us) op_driver.cc:464] REPLICATION: finished
0709 12:23:20.249677 (+441829us) write_op.cc:301] APPLY: starting
0709 12:23:20.249821 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:20.347197 (+ 97376us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:20.347401 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:20.384783 (+ 37382us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:20.385361 (+   578us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:23:20.385456 (+    95us) write_op.cc:312] APPLY: finished
0709 12:23:20.386095 (+   639us) log.cc:844] Serialized 156 byte log entry
0709 12:23:20.397082 (+ 10987us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:20.399099 (+  2017us) write_op.cc:454] Released schema lock
0709 12:23:20.399212 (+   113us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:20.402875 (+  3663us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:20.402921 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1380596,"reported_tablets":47,"spinlock_wait_cycles":234571520,"child_traces":[["op",{"apply.queue_time_us":439743,"apply.run_cpu_time_us":27512,"apply.run_wall_time_us":150243,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75085,"num_ops":17,"prepare.queue_time_us":117796,"prepare.run_cpu_time_us":20691,"prepare.run_wall_time_us":259293,"raft.queue_time_us":203155,"raft.run_cpu_time_us":63465,"raft.run_wall_time_us":397481,"replication_time_us":412245,"thread_start_us":494646,"threads_started":4,"wal-append.queue_time_us":115492,"wal-append.run_cpu_time_us":13335,"wal-append.run_wall_time_us":1944917}]]}
I20260709 12:23:26.621888  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:26.608479  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71400.6us
I20260709 12:23:26.573741 10193 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.623787  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.611799  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.605983  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.632513  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.619326  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.633765  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.616967 10070 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:26.636175  4576 raft_consensus.cc:2393] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 15: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:26.636216  4581 raft_consensus.cc:2393] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:26.628477  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.631104  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.619130  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.638566  4579 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:26.614789  9811 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.640563  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.642328  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.646795  3924 raft_consensus.cc:2410] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:23:26.644400  3962 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.605029 10020 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:26.657119  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.613632  3916 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:26.660265  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.662209  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.662837  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.663672  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.665199  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.665670  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.666447  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.619593 10224 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.611747 10139 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.660965  3922 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:26.669643  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.691172  3925 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:26.668040  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.571471 10167 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.532591 10183 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.698376  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:26.699870  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 65274.8us
I20260709 12:23:26.700640  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:26.702755  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.703861  3925 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:26.703420  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.705987  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.668370 10275 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:26.709822  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.706848  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.711782  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.712598  3845 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 21.
I20260709 12:23:26.711871  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.714794  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.713827  3922 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:26.715875  3888 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.717303  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.714794  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.718001  3922 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
I20260709 12:23:26.723606  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.725982  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.728660  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.730487  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.609258 10202 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.707640 10139 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:26.737018  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.710822 10167 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:26.740115  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 102493us
I20260709 12:23:26.690264  9902 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:23:26.743862  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.745503  4546 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.746057 10167 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.718711  3925 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:26.712754 10127 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.712924 10275 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.747121  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:26.723567 10274 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:26.747202  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 88595.3us
I20260709 12:23:26.700217 10224 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.742486  3888 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:26.724097  9908 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:26.719872  9998 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:26.751729  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.743805  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.735709 10277 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.756553 10152 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:26.756311  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.762996  3925 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:26.742090 10269 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:26.787109  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.748483 10167 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.788926  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:26.790434  4546 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.790835 10205 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:26.791239 10205 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.791646 10205 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:26.795950 10264 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:26.796478 10264 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.796820 10264 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:26.800637  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.757766 10275 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:26.812690  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 75748us
I20260709 12:23:26.768530  9908 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.758020 10276 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.769523 10152 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.787171 10139 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:26.787982 10269 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.815797  4548 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:26.799911 10230 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.768803  9998 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:26.758785 10127 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.812743 10086 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:26.833580  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:26.824955 10276 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.832144 10295 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:26.818789  9908 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:26.786816 10277 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.836634 10276 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.769970 10274 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.824944 10152 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:26.842743 10203 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.819701 10183 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.827980 10269 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.863408 10203 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.865846 10203 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.843642 10296 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:26.842084 10295 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:26.846751 10283 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.848081 10224 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.848789 10146 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:26.853724 10264 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.857090 10276 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.857609 10277 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:26.857131 10286 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:26.869196 10296 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:26.876819 10298 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:23:26.876755 10295 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.880080 10296 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.810165  3919 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:26.827821  9998 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:26.943775 10274 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.949978 10264 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.832346 10086 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.849103  9811 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:26.912269 10127 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.858203 10193 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.920744  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.918504  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:26.955396  3922 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:26.928388 10275 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.831550 10214 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.959964 10224 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.960196 10183 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:26.961179 10224 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.955493 10193 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.963254 10275 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.960547 10214 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:26.970274  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.972815 10288 log.cc:927] Time spent T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:23:26.974886 10205 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.929972 10276 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.978739 10205 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:26.979166 10276 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:26.982519 10276 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.982396 10167 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:26.961010 10183 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.985363 10183 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:26.934034 10146 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.935160 10277 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:26.952757 10086 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:26.925556  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:26.995692 10277 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.002293 10277 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:27.009701 10193 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:26.993402 10224 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.031421 10146 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.035077 10167 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.036372 10214 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:27.010965  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51706.7us
I20260709 12:23:27.035111 10146 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:27.057979  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.059355 10167 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:27.073804 10283 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.081597  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:27.083535 10307 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:23:27.094879  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.095633  3991 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:27.095930  3994 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
W20260709 12:23:27.096093  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.097781  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:27.098369 10313 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:23:27.098440  3991 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:27.100445  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.100885  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.105973  3999 raft_consensus.cc:2468] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:27.129073  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:27.130311  4577 raft_consensus.cc:2393] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:27.157012 10301 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:27.159766  3841 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:27.159909  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:27.161767  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.140538 10146 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.167605  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.167910 10146 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.179762  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.171295 10146 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:27.158133 10301 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.197960  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.198988  3849 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:27.202963  3998 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:27.204058  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:27.204907  3920 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:27.207324  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.219208  3848 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:27.242864  3849 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:27.235666  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.221444  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.228284  9908 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.239909  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.233124 10301 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:27.235191 10152 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:27.224901 10312 log.cc:927] Time spent T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 12:23:27.244551  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:27.253567  3994 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:27.253435  3999 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:27.259617  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.277915  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.262379 10086 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.281636 10086 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:27.282449  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71482.3us
I20260709 12:23:27.283710  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:27.285758 10283 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:27.286607 10283 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.297937  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.216109  9998 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.301450  9998 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:27.285279  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:27.304317  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.304772 10247 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:27.305390  3843 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:27.311628  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:27.318271 10070 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.017s
I20260709 12:23:27.268599 10183 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.323004 10183 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.333772  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.330128 10152 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.340273  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:27.341137  3996 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.342231  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.344178  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.345034  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.347128  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.356097  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.351208  3996 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:27.362308  9908 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.363073  3964 leader_election.cc:400] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 11 election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12.
I20260709 12:23:27.365437  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.369195 10283 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:27.373380  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.379611  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:27.380535  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.381256  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:27.392185 10269 consensus_meta.cc:287] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.009s
W20260709 12:23:27.410881  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 45691.4us
W20260709 12:23:27.420966  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 48071us
W20260709 12:23:27.423352  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 162560us
I20260709 12:23:27.425019  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.420872 10269 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.416890  9998 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:27.441558  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.442404  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.450309  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:27.469403  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.446542  3888 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.472059  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.445250  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.433578 10264 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:27.475958  3844 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.465627  9998 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.485009  3841 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.473593 10183 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:27.481699 10264 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.483819  9998 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.427078  9908 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:23:27.486687 10070 raft_consensus.cc:2804] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:27.481222 10214 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:27.498602 10264 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.504637 10276 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:27.523240 10087 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:23:27.523475  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59364.1us
I20260709 12:23:27.525115  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.527377 10309 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:27.528265 10309 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.532027  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.520376 10214 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.538559 10214 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:27.531159 10309 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:27.549767  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.523993 10087 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.553592  4578 raft_consensus.cc:1240] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:27.557732 10310 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:27.558619  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 108544us
W20260709 12:23:27.564493  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 135896us
I20260709 12:23:27.560914 10310 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.554006 10087 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.567525 10274 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.591497  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.599252  3841 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:23:27.575776 10310 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.600773  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.602448 10087 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:27.572220 10269 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:27.613660  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 100052us
I20260709 12:23:27.628226  3843 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
I20260709 12:23:27.630460  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.634109  3841 raft_consensus.cc:2368] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:27.638288  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.603302 10087 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:23:27.633538 10205 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:27.638026 10287 consensus_queue.cc:1059] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 12:23:27.612242 10274 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.613090 10070 raft_consensus.cc:697] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:27.652383  3888 leader_election.cc:400] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:27.654083  3888 leader_election.cc:403] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:23:27.656225  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:27.663728  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 90689.7us
I20260709 12:23:27.664909 10070 consensus_queue.cc:237] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.667704  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:27.672745  3844 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:27.680495  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:27.680496  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.682037  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.682540  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.682717  3991 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:23:27.687911  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.688618  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.689483  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:27.690321  3918 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:27.690781 10274 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:27.692422  3922 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:27.693799 10167 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.688728  3993 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:27.703305  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:27.715668 10325 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:27.722487  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:27.724663 10167 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:27.728448  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:27.728889  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61323.6us
I20260709 12:23:27.731338  9979 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:27.735953  9811 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:27.739245  3920 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:27.755079 10276 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:27.755633  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.752453  9979 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:27.756346  3998 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:27.758060  9979 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.759641 10253 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:27.760141 10253 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:27.760524 10253 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:27.743603  9998 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.763800  3994 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:27.766654  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:27.750134  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 105938us
I20260709 12:23:27.740512  3922 raft_consensus.cc:2468] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:27.755139  9811 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.744129  3888 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.756397 10264 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.774993  9998 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:27.775871  3962 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.776157 10324 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:27.776454 10183 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:27.777122 10183 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:27.750021 10325 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:27.778208 10183 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.779140  3918 raft_consensus.cc:3060] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:27.779819  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.781225  9811 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.788585  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:27.789752 10277 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:27.790544  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.791345  3843 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:27.797641  3918 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:23:27.769923  9979 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:27.803841  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.805222  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:27.805573  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.806286  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.807054  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:27.814121  3993 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.806313  9811 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:27.805269  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.816152  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.807816  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.803349  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:27.818078  3994 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:27.794106 10277 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:27.808959 10310 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.809628  3992 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:27.794440 10264 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:27.810313  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.811146  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:27.892923  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 80748.8us
I20260709 12:23:27.925968  4548 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.926355 10264 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:27.927634  4548 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:27.927891 10264 raft_consensus.cc:2804] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:27.890726  3997 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:27.928560 10264 raft_consensus.cc:697] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:27.905764  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.906545  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.908288  3996 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:27.929759 10264 consensus_queue.cc:237] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.908931  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.909684  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.907272  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:27.911055  3993 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:27.890815 10277 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.889669 10310 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:27.915503  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 110370us
I20260709 12:23:27.915815 10087 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.934187 10309 raft_consensus.cc:2804] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:27.934126  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.935307 10087 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:27.935779 10087 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:27.936203 10087 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:27.936151  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:27.938256 10324 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:27.938655 10324 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:27.939060 10324 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:27.934906 10309 raft_consensus.cc:697] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:27.920298  9811 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:27.940522  9811 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:27.948575  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:27.949221  3922 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:27.951891  3992 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:27.952780  3992 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.953780  3992 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:27.940538 10309 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:27.961663 10183 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:27.965215  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.968655  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:27.971777  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:27.996032  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:27.996753  3847 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.012010  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.013744  3922 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:28.025094  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.027561  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.029217  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.034142  3814 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.009534  9908 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.035727  9908 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.036562 10283 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:28.035863 10287 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:28.038025  9908 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:28.038514  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.035724 10087 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.041080 10087 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.041613 10324 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.043642 10325 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.043843 10324 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.044281 10325 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.046692 10325 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.055961  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:28.056824  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:28.057811  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.059626  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.059893  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.060299  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.060876  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.061236  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.061594  3916 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:28.061949  3925 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:28.060905  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.063090  3923 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:28.060343  3921 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:28.059803  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.072736  3992 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:23:28.073220  3992 pending_rounds.cc:85] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 10
I20260709 12:23:28.073441  3992 pending_rounds.cc:107] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:23:28.073704  3992 raft_consensus.cc:2889] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:28.074282  4547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.902s (SENT) [suppressed 24 similar messages]
I20260709 12:23:28.074625  3847 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:28.069092  4548 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:27.962420 10183 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.056581  3748 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.079594  3748 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.075724  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.084512  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.089323  3922 raft_consensus.cc:2393] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 22: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:28.091562  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.093988  9998 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:28.084939 10264 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:28.093878  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:28.095283  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.095666 10310 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.096027  3924 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:28.097222  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.098165 10310 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.100026 10183 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.100454  3748 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:28.101076  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:28.107208  3845 raft_consensus.cc:2393] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:28.107489  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.109227  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.110270  3748 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 11 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.112418  3923 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:28.113897  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.114646  3923 raft_consensus.cc:2393] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:28.115778  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.104676 10253 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.118161  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.102926 10264 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:28.111378  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.117515  3962 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.116360  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:28.104156  3746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 168) took 21025 ms (client timeout 15000 ms). Trace:
I20260709 12:23:28.120476  3925 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:28.114624  3748 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 13, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.127293  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.127990  3923 raft_consensus.cc:3060] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.136161  4578 raft_consensus.cc:1240] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:28.137301  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.138698  3925 raft_consensus.cc:1240] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:28.133816 10276 raft_consensus.cc:2804] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:28.142091 10276 raft_consensus.cc:697] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:28.143034 10276 consensus_queue.cc:237] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.145262  3916 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:28.152016  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 75217.5us
W20260709 12:23:28.167212  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 93074.3us
I20260709 12:23:28.134078 10214 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:28.173100  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.184818 10253 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.186668 10264 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:28.190806  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 156881us
I20260709 12:23:28.192847  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.194340 10283 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:28.195423  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79166.7us
I20260709 12:23:28.200070  3923 raft_consensus.cc:2468] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:28.203845  3748 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.205673  3748 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 15, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:28.200731  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.198688  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.224398  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.224910 10253 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:28.225245 10329 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:28.225399 10253 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.225732 10329 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.225912 10253 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:28.226137  9998 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:28.226186 10329 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.231487  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.232605 10293 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.234750  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.238890 10086 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:28.120028  3746 rpcz_store.cc:269] 0709 12:23:07.078674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.078917 (+   243us) service_pool.cc:224] Handling call
0709 12:23:28.103920 (+21025003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:26.752888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:26.753638 (+   750us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:26.753698 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:23:26.753727 (+    29us) tablet.cc:662] Decoding operations
0709 12:23:26.831322 (+ 77595us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:26.839698 (+  8376us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:26.843089 (+  3391us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:26.873877 (+ 30788us) tablet.cc:701] Row locks acquired
0709 12:23:26.873900 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:23:26.874065 (+   165us) write_op.cc:270] Start()
0709 12:23:26.874185 (+   120us) write_op.cc:276] Timestamp: P: 1783599806874015 usec, L: 0
0709 12:23:26.874207 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:26.874909 (+   702us) log.cc:844] Serialized 2814 byte log entry
0709 12:23:27.580365 (+705456us) op_driver.cc:464] REPLICATION: finished
0709 12:23:27.710071 (+129706us) write_op.cc:301] APPLY: starting
0709 12:23:27.710203 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:27.787950 (+ 77747us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:27.788096 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:27.807415 (+ 19319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:27.807797 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:23:27.807861 (+    64us) write_op.cc:312] APPLY: finished
0709 12:23:27.808301 (+   440us) log.cc:844] Serialized 73 byte log entry
0709 12:23:27.808507 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:27.808693 (+   186us) write_op.cc:454] Released schema lock
0709 12:23:27.808767 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:27.821715 (+ 12948us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:27.821755 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4405021,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":125846,"apply.run_cpu_time_us":13719,"apply.run_wall_time_us":111582,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":221027,"prepare.run_cpu_time_us":13313,"prepare.run_wall_time_us":299875,"raft.queue_time_us":284630,"raft.run_cpu_time_us":36816,"raft.run_wall_time_us":137726,"replication_time_us":681487,"thread_start_us":582622,"threads_started":4,"wal-append.queue_time_us":153533}]]}
W20260709 12:23:28.223040  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.198267  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.241055 10283 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:28.225770  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.242285  9998 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:28.243814  3814 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.251870 10338 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:28.252429 10338 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.252815 10338 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:28.257513  3924 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:28.258030 10340 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:28.257544  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.258687 10340 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.260365 10086 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:28.260973 10224 consensus_queue.cc:1059] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:28.260972 10086 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.262256 10224 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:28.262627 10224 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.263413 10086 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.265923 10340 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.269836  3845 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:28.271706  9811 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:28.271802 10224 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.273355 10224 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.280903  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.291628  9998 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:28.292050  9998 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.292438  9998 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:28.301800  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.302551  3923 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:28.301630  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.306928 10329 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.309069  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.309432 10329 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.309989 10214 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.310513  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.311491  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:28.288642  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 53979.8us
I20260709 12:23:28.289448  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.315948  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:28.284631  3814 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.323727 10214 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:28.324889  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.326635  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.324739 10086 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:28.331532 10086 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:28.328640 10340 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:28.332002 10086 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.325466 10214 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.332731 10214 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:28.323971 10283 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:28.326256 10224 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:28.363196 10351 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.364007 10351 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.365075  3964 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.346066 10283 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.375638  3845 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:28.379091 10253 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.371147 10329 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:28.366021 10247 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:23:28.378495  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61036.5us
W20260709 12:23:28.399680  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43723.3us
I20260709 12:23:28.379556 10287 consensus_queue.cc:1059] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:23:28.377254 10283 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:28.403385  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 74162.6us
I20260709 12:23:28.404834 10247 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:28.405068 10338 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.405784  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.406003 10253 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.407130  4578 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:28.409164  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:28.410957  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54655.5us
I20260709 12:23:28.400792 10329 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.415432  3964 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.426335  3845 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:28.437600  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.437809  3845 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:28.408202 10224 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.416544 10087 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.408496 10247 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.441270  9811 consensus_queue.cc:1059] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:28.430823 10086 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.415797 10329 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:28.448089  9908 raft_consensus.cc:3055] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:28.448280  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.448729  9908 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:28.448884 10224 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.449489  9811 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:28.449952  9908 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.451360  9908 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:28.441267 10276 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.443656 10324 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:23:28.448107 10183 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:23:28.459281  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 51547.9us
I20260709 12:23:28.460996  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.463029 10264 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:28.463078  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.464666  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:28.451262  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.467386  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:28.479074  9998 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.479622  9979 raft_consensus.cc:3055] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:28.480103  9979 raft_consensus.cc:740] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.480449 10247 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.482028  9998 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.480108  4580 consensus_queue.cc:237] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.484902 10086 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.485631  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.489166  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:28.476198  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 64445us
I20260709 12:23:28.492126  3916 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.489687 10329 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.493870 10310 raft_consensus.cc:2764] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:28.494261 10070 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.499151  3849 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:28.499915  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.482064 10247 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.503351 10338 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.507091 10276 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:28.510111 10283 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.511219  3916 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:28.511528  3844 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 22. Current term is 23.
I20260709 12:23:28.511693  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.513674  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:28.516376  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65190.5us
I20260709 12:23:28.516530 10276 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:28.518159 10253 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:28.518729 10253 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:23:28.520098  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.519631 10253 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:28.530591  4578 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:28.534085 10355 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.539775  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.541478  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.542516 10329 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.544742 10283 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 23 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.548389  3923 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:28.548862  3841 raft_consensus.cc:3060] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:28.541527 10355 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.549957  3921 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:28.550990 10355 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.551406  3962 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 22. Current term is 23.
I20260709 12:23:28.552793 10293 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:28.558285  3962 leader_election.cc:403] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.556032  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.561220  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.566865  3841 raft_consensus.cc:1275] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:28.571856 10357 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.562836 10329 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:28.572592 10357 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.575073 10357 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.578908 10310 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:28.516942  9979 consensus_queue.cc:260] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.601503  9979 raft_consensus.cc:3060] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:28.602929 10329 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 22. Current term is 23.
I20260709 12:23:28.579836 10351 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:28.603699  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.581207 10359 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.604506 10359 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.574326 10214 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.593452  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.606832 10310 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.607064 10359 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.607300 10310 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.609503 10310 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.609535 10214 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.614539  3842 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:28.607911  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.616204 10276 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:28.616614 10276 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.617004 10276 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:28.618016 10214 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:28.619118  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:28.619872  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.620110  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.621930 10214 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:28.622565 10214 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.622495  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.620936  3844 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:28.619979  3842 raft_consensus.cc:2393] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:28.640632 10214 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.649298  9998 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:28.667054  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:28.674077  3844 raft_consensus.cc:606] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:28.672271  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.676787  3842 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:28.676167  3815 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.681349  3924 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:28.681713  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:28.683991  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.645195 10355 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:23:28.687194  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.687795  3924 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:28.691514  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:28.692241  3916 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:28.687194  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:28.699656  3923 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:28.701084  3925 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:28.652690 10309 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:23:28.675279  9998 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.683365 10359 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:28.703411 10310 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.705826  9998 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:28.723268 10310 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.725046  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.706871  3923 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:28.713009  9908 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:23:28.715333 10359 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.728850 10350 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:28.728525 10359 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:28.730782  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.717604 10230 consensus_queue.cc:1048] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:23:28.704833 10264 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:23:28.705678 10329 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:28.739379  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:23:28.740381  3925 raft_consensus.cc:606] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:28.740888  3925 raft_consensus.cc:614] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:28.742591  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.744194  3844 raft_consensus.cc:1275] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:23:28.759092  3916 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 23.
I20260709 12:23:28.762480 10247 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:28.763170 10247 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.763746 10247 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:28.776643  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.796408  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.795715 10070 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.800100 10070 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:28.801074  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.803895 10070 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:28.798362 10283 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:28.768033 10276 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.816927  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:28.826059  3848 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:28.821182 10351 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:28.824227 10356 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:28.820789 10293 consensus_queue.cc:1048] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:28.829279  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:28.841385  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:28.842108  3848 raft_consensus.cc:606] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:28.842269 10329 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:28.842574  3848 raft_consensus.cc:614] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:28.842868 10329 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.829855 10351 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.828686 10356 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:28.844292  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:28.825600 10283 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:28.832414 10276 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.849162  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.864867  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:28.842135 10324 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:23:28.985417  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 303739us
I20260709 12:23:28.852200 10283 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:28.995466  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.016690  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.024871  3925 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:29.010715 10329 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:28.994438 10324 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.050490 10355 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:29.053560 10351 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:28.857864 10214 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.053704 10367 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:29.061492 10324 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:29.095163  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79508.9us
I20260709 12:23:29.096060  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.100203  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.108765  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.048522 10356 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:29.122458  3999 raft_consensus.cc:1240] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:29.125341  3993 raft_consensus.cc:1240] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:29.131302  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:29.105384 10369 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 12:23:29.135717  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.124228 10310 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:29.145670  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:29.134244  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 130918us
I20260709 12:23:29.138269  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.149392  3998 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:29.150044  3994 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:23:29.135193  9979 consensus_meta.cc:287] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.003s
I20260709 12:23:29.107153 10276 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:29.158136  3748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 269) took 24174 ms (client timeout 15000 ms). Trace:
I20260709 12:23:29.165143  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.152370  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.165871  3995 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:29.163247 10356 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:29.204923  3847 raft_consensus.cc:2468] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
W20260709 12:23:29.158749  3748 rpcz_store.cc:269] 0709 12:23:05.008330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.029594 (+ 21264us) service_pool.cc:224] Handling call
0709 12:23:29.158027 (+24128433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:28.347823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:28.348826 (+  1003us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:28.348907 (+    81us) write_op.cc:435] Acquired schema lock
0709 12:23:28.348938 (+    31us) tablet.cc:662] Decoding operations
0709 12:23:28.350327 (+  1389us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:28.350477 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:28.350535 (+    58us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:23:28.351491 (+   956us) tablet.cc:701] Row locks acquired
0709 12:23:28.351555 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:23:28.351822 (+   267us) write_op.cc:270] Start()
0709 12:23:28.352032 (+   210us) write_op.cc:276] Timestamp: P: 1783599808351727 usec, L: 0
0709 12:23:28.352071 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:23:28.352909 (+   838us) log.cc:844] Serialized 2839 byte log entry
0709 12:23:28.438177 (+ 85268us) op_driver.cc:464] REPLICATION: finished
0709 12:23:28.535298 (+ 97121us) write_op.cc:301] APPLY: starting
0709 12:23:28.536852 (+  1554us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:28.580844 (+ 43992us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:28.580976 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:28.587415 (+  6439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:28.622678 (+ 35263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:23:28.622725 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:28.623021 (+   296us) log.cc:844] Serialized 73 byte log entry
0709 12:23:28.640098 (+ 17077us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:28.647033 (+  6935us) write_op.cc:454] Released schema lock
0709 12:23:28.647105 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:28.653265 (+  6160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:28.653300 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":761150,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":93774,"apply.run_cpu_time_us":11324,"apply.run_wall_time_us":113858,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":108620,"prepare.run_cpu_time_us":5617,"prepare.run_wall_time_us":9928,"replication_time_us":57761,"thread_start_us":156613,"threads_started":2}]]}
I20260709 12:23:29.216147  3998 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
W20260709 12:23:29.217803  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.195482  3993 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 23.
I20260709 12:23:29.197310  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.221514  3916 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:29.225739  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.221518  3994 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:29.232108  3990 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:23:29.232823  3995 raft_consensus.cc:1240] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:29.237450  3999 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:29.220072 10368 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:23:29.320811 10373 log.cc:927] Time spent T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:23:29.264956 10224 consensus_queue.cc:1059] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:23:29.330962  9979 raft_consensus.cc:993] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:23:29.345505 10372 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:23:29.260465 10359 consensus_queue.cc:1059] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:23:29.272336 10380 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:29.363801  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:29.363013  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.319088 10214 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:29.386680  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.394060  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.398085  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 134714us
W20260709 12:23:29.377808  9998 consensus_meta.cc:287] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.001s
I20260709 12:23:29.432206  9979 raft_consensus.cc:1081] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:23:29.448529 10247 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.682s	user 0.014s	sys 0.000s
I20260709 12:23:29.375583 10380 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:29.444188 10264 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:23:29.471068 10247 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.482344 10247 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:29.448591 10214 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:29.446756  9998 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.477550 10283 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.492295  3996 raft_consensus.cc:2368] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18.
W20260709 12:23:29.488479  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 114566us
W20260709 12:23:29.487172  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 198710us
W20260709 12:23:29.494849 10374 log.cc:927] Time spent T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:23:29.489871 10214 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:29.509392 10214 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:29.513597  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 78344us
I20260709 12:23:29.515259  3916 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:23:29.515808  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.516748  3918 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 22. Current term is 23.
I20260709 12:23:29.491905  9998 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:29.535674  3921 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:29.538002  3921 raft_consensus.cc:1275] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:29.539569  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.540452  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.540767 10380 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:29.539671  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.543025  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.546356  3918 raft_consensus.cc:2393] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 19: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:29.533320  3962 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:29.549417  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:29.557659  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 117116us
W20260709 12:23:29.559405  4547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.011s
W20260709 12:23:29.559875  4547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.000s	sys 0.011s
I20260709 12:23:29.559796  3923 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
W20260709 12:23:29.559481  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.562763  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:29.565886  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:29.570636  3842 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:29.563692 10384 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 11 to 14, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:29.579022  4580 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:29.564339  9998 raft_consensus.cc:2804] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:23:29.585482  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115152us
I20260709 12:23:29.584453  3842 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:29.570571 10283 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:29.591154 10381 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:23:29.597975 10387 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:29.591619  9908 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:29.608821  9908 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.611339  9908 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:29.624266 10324 consensus_meta.cc:287] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.523s	user 0.013s	sys 0.000s
I20260709 12:23:29.624795 10324 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.625954  3916 raft_consensus.cc:2368] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:29.632805  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.633507  3922 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:29.632679  3843 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:29.642688  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.649158  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54402.2us
I20260709 12:23:29.651845  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:29.640618  9998 raft_consensus.cc:697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:29.656466  9998 consensus_queue.cc:237] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.661826  3922 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:29.640992 10224 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.666865 10351 raft_consensus.cc:3055] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:29.666553 10224 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:29.665529  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:29.675797  3920 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:29.676271  3962 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:29.683363 10367 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.684006 10367 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.686230 10367 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:29.693960 10395 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:29.693792  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:29.694360  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:29.694962 10356 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:29.695488 10407 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.695775 10356 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:29.696064 10407 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:29.696827 10356 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.698374 10407 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:29.694559 10395 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:23:29.704945  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 306116us
I20260709 12:23:29.706115  3919 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:29.668637 10355 raft_consensus.cc:3055] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:29.667346 10351 raft_consensus.cc:740] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
W20260709 12:23:29.724287  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 129218us
I20260709 12:23:29.728274  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.729799  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.735204  3996 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:29.737728  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.738447  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.738696  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.726001 10355 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:29.746747 10407 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.747342 10407 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.749563 10407 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:29.749655 10224 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:29.750171 10380 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:29.750771 10380 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.752934 10380 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:29.752780 10351 consensus_queue.cc:260] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.756086  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:29.746013 10355 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.727254  3815 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:29.771106  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:29.777058  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 69753.1us
W20260709 12:23:29.778352  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51195.1us
I20260709 12:23:29.704365 10395 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:29.781273  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:29.782027  3919 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:29.783347  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:29.784328  4575 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:29.783480  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:29.787384  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:29.755239 10351 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:29.810166  3994 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:29.810427  3990 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:29.810668  3994 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:29.811528  3994 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:29.812520  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.794342  3925 raft_consensus.cc:2955] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:29.820786  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.821849  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50888us
I20260709 12:23:29.792063 10356 raft_consensus.cc:2764] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:23:29.827071  3994 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:29.830828  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.836782  3991 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:29.830050  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:29.840662  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.842062  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.822949  9998 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.813526 10402 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:29.857184  3994 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:29.819691 10253 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:23:29.863289 10367 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:29.866904 10355 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:29.845268 10395 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:29.840720 10400 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:29.886668  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44679.8us
I20260709 12:23:29.889678  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.854797 10357 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.854480 10402 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.899837  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:29.903405  3920 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:29.891836 10324 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:29.926193  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.902091 10402 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:29.929924  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.932972  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.933388  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.934537  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.935781  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.929504  3996 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:29.930652  3995 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:29.927934  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.941502  3994 raft_consensus.cc:3060] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:29.942579  3916 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:23:29.928848  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.900585 10407 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:29.936296 10419 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:29.934197  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.946549  3991 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:29.930045 10359 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:23:29.928424  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.947865  3993 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:23:29.955583 10359 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:29.923298  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:29.962596  3999 raft_consensus.cc:2368] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:29.924178  3992 raft_consensus.cc:1240] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 12:23:30.047494  3889 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.503s (SENT)
I20260709 12:23:30.048024  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.053166  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.054553  3996 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:23:30.054826  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:29.907995  9998 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:30.054168  3995 raft_consensus.cc:2376] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17. Re-sending same reply.
I20260709 12:23:30.057436  3994 raft_consensus.cc:2468] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:30.065260  3990 raft_consensus.cc:1275] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:30.061370  3993 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:30.067101 10405 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.086087  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:30.092339  3889 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.518s (SENT)
I20260709 12:23:30.092895  3889 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.068253  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.093255  3991 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:30.093791  3998 raft_consensus.cc:2393] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 17: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:29.946399  3743 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 14, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.077251 10416 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:30.077992 10411 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:29.901517 10357 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.088506  3992 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:30.048336 10384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49860 (request call id 0) took 1577 ms. Trace:
I20260709 12:23:30.080132 10367 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.100628  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.104540  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:30.113098 10420 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:30.094872  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:30.133983  3843 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.141748  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:30.143654  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 60864.6us
W20260709 12:23:30.147953  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55658.5us
I20260709 12:23:30.149384  3843 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:30.153553  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.219739  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:30.219892  3889 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.596s (SENT)
I20260709 12:23:30.220479  3996 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:30.222630  3995 raft_consensus.cc:2393] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 21: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:30.138302 10399 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:30.225284  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.227685  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.232998 10357 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:30.233866  3743 catalog_manager.cc:5697] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 6 to 8, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 8 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:30.235590  3743 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.237300  3743 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:30.137853 10367 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.115569 10416 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.241322 10367 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:30.130153 10384 rpcz_store.cc:276] 0709 12:23:28.464654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.473378 (+  8724us) service_pool.cc:224] Handling call
0709 12:23:28.504930 (+ 31552us) log.cc:844] Serialized 494 byte log entry
0709 12:23:28.704249 (+199319us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b54008e4f20. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52973b26 00007fdc5296d49a 00007fdc5296c714 00007fdc5294ceaa 00007fdc52953d53 00007fdc52953cd9 00007fdc52953c69 00007fdc52953c31 00007fdc52952dfd 0000000000388634
0709 12:23:28.713026 (+  8777us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b54008e4f20. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296c142 00007fdc5294ceaa 00007fdc52953d53 00007fdc52953cd9 00007fdc52953c69 00007fdc52953c31 00007fdc52952dfd 0000000000388634 0000000000388479 00007fdc4f906475
0709 12:23:30.041805 (+1328779us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3491,"raft.run_cpu_time_us":4951,"raft.run_wall_time_us":127067,"spinlock_wait_cycles":11164672,"thread_start_us":136335,"threads_started":1,"wal-append.queue_time_us":136323,"wal-append.run_cpu_time_us":1907,"wal-append.run_wall_time_us":1001930}
I20260709 12:23:30.257581 10402 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:30.261795 10426 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 12:23:30.239106  3743 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 20, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 20 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.270043  3743 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.275369  3743 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 17, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 17 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:30.276741 10427 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:23:30.280246 10423 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:23:30.283299  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:30.285394  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.286139  4578 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:30.111302 10405 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.273999 10416 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:30.295095  3889 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.658s (SENT)
I20260709 12:23:30.308125  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.299521  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:30.313694  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:30.314388  3921 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:30.277280 10402 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:30.305768  3842 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:30.316737  3923 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:30.317323  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:30.333777  4575 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:30.307623 10355 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.318966 10405 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:30.315640  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 92514.7us
I20260709 12:23:30.327826  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:30.337946  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:30.340965  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.341640  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:30.349577  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 138787us
I20260709 12:23:30.326615  9979 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:30.362426  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.367762  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.368865  3992 raft_consensus.cc:2368] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:30.375558  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.376495  3992 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:30.387792  3921 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
W20260709 12:23:30.421752  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.422734  3815 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:30.282234  3743 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 8 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 11 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.422914  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.370716  9979 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:30.427417 10426 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:23:30.431396  3997 raft_consensus.cc:2376] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20. Re-sending same reply.
I20260709 12:23:30.465289  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.342207 10355 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.443027  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:30.479661 10399 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:30.466883  9979 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:30.486845 10432 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:23:30.496805  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.497468  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.498219  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.498831  3990 raft_consensus.cc:2376] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14. Re-sending same reply.
I20260709 12:23:30.499363  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:30.499795  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.500044  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.500592  3998 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:30.498493  9979 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.501940  3841 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:30.506377 10429 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:30.506843  9979 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:30.507673 10433 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 12:23:30.532418 10395 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:30.536294  3743 catalog_manager.cc:5697] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 11, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 11 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:30.430892 10402 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:23:30.476234  3889 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.892s (SENT)
I20260709 12:23:30.360605 10357 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 12:23:30.550168  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50883.9us
I20260709 12:23:30.556676  3962 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:30.557731  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.560633  3962 leader_election.cc:403] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:30.558122  9979 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:30.562216 10402 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:30.475401  3992 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:30.580049  3814 leader_election.cc:400] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18.
W20260709 12:23:30.593134  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 116934us
I20260709 12:23:30.571022 10395 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:23:30.569871 10422 consensus_queue.cc:1059] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:23:30.570199 10391 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 12:23:30.602466  3889 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.789s (SENT)
I20260709 12:23:30.603469  3842 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:30.538662  3743 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 13 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.606961  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:30.604475  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 124687us
I20260709 12:23:30.612150  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.614674  3992 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.637411  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:30.635860  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:30.639061  3923 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:30.640241  3997 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:30.643622  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.648857  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.651732  3998 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:23:30.654480  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.655314  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.656198  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.657038  3998 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:30.660251  3992 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:30.661473  3993 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:30.666145  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.669401  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.671056  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.576849 10402 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.674243  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.632871 10399 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:30.616984 10411 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:30.684094  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:30.684602  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71823.4us
I20260709 12:23:30.688753  3922 raft_consensus.cc:1275] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:23:30.661909 10436 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:23:30.690289  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.694253  4575 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:30.634974  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:23:30.694334  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:30.692859 10247 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.698354 10247 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.700917 10247 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:30.701836 10442 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:30.697293  3924 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:30.703965  3923 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
W20260709 12:23:30.701004 10441 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:23:30.706664  3919 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:23:30.712281  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 265172us
I20260709 12:23:30.691854  9998 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:30.716298  3965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.730283  4547 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.902s (SENT)
I20260709 12:23:30.712073 10405 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:30.737231  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 81989us
I20260709 12:23:30.739554  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:30.740062  3964 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 22. Current term is 23.
I20260709 12:23:30.740274  4575 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:30.749096 10443 log.cc:927] Time spent T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:30.744763 10405 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.751983 10405 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:30.762686 10394 raft_consensus.cc:3055] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:30.763222 10394 raft_consensus.cc:740] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:30.764205 10394 consensus_queue.cc:260] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.766109 10350 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:30.770341 10368 consensus_queue.cc:1048] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:30.771018  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.775018 10368 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:30.777671  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.780112 10392 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:30.785907 10400 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:30.785831  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.787153 10400 raft_consensus.cc:2764] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:23:30.716331 10380 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:23:30.735605 10355 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:30.787847  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.794373  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.793277  4575 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
W20260709 12:23:30.791525  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 93904.9us
I20260709 12:23:30.698392 10399 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.799521  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.800149  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.802847  4577 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:30.775887 10394 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.818178  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:30.808977  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.809881 10421 consensus_queue.cc:1059] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:23:30.811014  3964 leader_election.cc:400] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:30.810817 10447 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:23:30.811640 10453 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.813055 10449 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:30.832875 10449 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.813923 10452 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:30.814165  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.836849  4579 raft_consensus.cc:2368] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:30.814766 10324 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:30.814953 10407 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.838079 10407 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.815194  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.820574  3964 leader_election.cc:403] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:23:30.823799  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:30.844380 10400 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:30.788878  3743 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 14, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.851670  3743 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:30.853229  3743 catalog_manager.cc:5697] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 15, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:30.801354 10253 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:23:30.728832  9998 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:30.872812  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 61944.6us
I20260709 12:23:30.876860  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:30.885672  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.888068  3999 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:30.888612  3999 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:30.886816  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 180624us
I20260709 12:23:30.876533 10449 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:30.902561  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 87446.2us
I20260709 12:23:30.906203  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.908242 10405 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.924012  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:30.854847  3743 catalog_manager.cc:5697] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 21, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 21 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.925772  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.914516  3815 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:30.890125 10416 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:30.926024 10367 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:30.943190  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:30.943334  3815 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:30.935235 10380 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:30.960575  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.960788  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.961269  3991 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:30.962913 10351 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.963325 10416 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:30.963505 10351 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:30.965764 10351 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:30.946992 10402 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:30.949590 10355 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:30.966936 10421 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:23:30.969743 10355 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:30.970913 10355 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:30.973184  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:30.975757  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:30.990348  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:30.980536 10402 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.008347  3991 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 21.
I20260709 12:23:31.009536  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.007947 10402 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.009536  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:30.967990 10456 consensus_queue.cc:1048] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:23:31.006335 10367 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.143761  3993 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:30.981660 10400 consensus_queue.cc:1048] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 12:23:31.153059 10367 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.013840  3743 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.158290  3743 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
W20260709 12:23:31.160774  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.170145  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:31.181876  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 223511us
W20260709 12:23:31.186476  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 229036us
I20260709 12:23:31.187382  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.175468 10356 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.198275  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.175771 10448 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:31.178088 10351 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:23:31.232139  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:31.231211  3999 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.234225  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:31.209666 10293 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:31.217168 10392 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:31.233942  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.238547  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:31.233547  3743 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 11, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:31.209221 10356 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.235077 10405 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:31.257282  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70024.6us
I20260709 12:23:31.275076  3889 leader_election.cc:400] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:31.276386  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.217757 10448 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:31.258823 10460 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:23:31.258502 10395 consensus_meta.cc:287] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
I20260709 12:23:31.256074 10446 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:31.258280 10392 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:31.284034  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.282229 10405 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:31.277915 10429 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:31.302179 10447 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:31.304644 10448 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:31.305256 10448 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:31.298149 10405 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.310487 10405 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:31.318040 10367 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:31.319409  3999 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:31.321403 10392 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.322341  3743 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 20 to 21, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 21 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.344403  3743 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.285087 10395 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
I20260709 12:23:31.347319  3997 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:31.285400 10404 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:31.324935  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:31.346055  3743 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 18, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 18 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.351382  3743 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.353224  3743 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.354530  3743 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:31.328941 10356 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:31.291769 10465 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:31.338225 10411 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:31.340376  9998 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:31.401849  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 235002us
I20260709 12:23:31.382937 10411 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:31.423161  3814 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:31.424572  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 186107us
I20260709 12:23:31.424883  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:31.399590 10416 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:31.429052 10355 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:31.424698  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 241973us
I20260709 12:23:31.435170  3964 leader_election.cc:400] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19.
W20260709 12:23:31.435403  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 151436us
I20260709 12:23:31.436590  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.437785  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:31.439060  3889 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.426796 10391 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:31.450587  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.455286  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.426162 10351 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:23:31.470512 10411 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.473551 10482 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:31.474447 10465 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.454113 10391 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:31.475107 10465 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.475787 10391 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:31.454386 10456 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:31.453819 10416 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:23:31.458930 10429 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:31.483287  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:31.488420  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:31.499081  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:31.504772  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63776.5us
I20260709 12:23:31.504556  3846 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:31.505577  3846 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:31.510824  3843 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:31.510098  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:31.522831  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 85116.6us
I20260709 12:23:31.524637  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.527518  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.528512  3999 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:31.531939  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.532586  3991 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:31.531939  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.542551  3815 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:31.547204  3999 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:31.547921  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.548071  3814 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:31.507623 10411 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:31.558352  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.563699  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:31.520392  3846 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.560693  3995 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:31.520435 10416 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:31.542038 10456 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:31.520581 10429 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:31.570860  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:31.576416  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.579274  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:31.579998  3920 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:31.542443 10367 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.578076  3846 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:31.579923  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:31.542969 10368 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:31.564504 10473 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:31.559333 10394 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:31.586648  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 65682.9us
I20260709 12:23:31.559573  9979 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:31.582993  3916 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:31.590251  4582 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:31.586447  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:31.551189 10469 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:31.551870 10452 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:31.608949  3916 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:31.576972 10416 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:31.620029  3846 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:31.601382 10324 raft_consensus.cc:3055] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:31.600581  9979 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.601758 10394 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:31.660990  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 113150us
I20260709 12:23:31.603053 10395 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:31.605098 10471 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:31.608804 10407 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:31.633343 10416 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:31.471626  3743 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 16 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.588279 10367 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.687649  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.661131 10450 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:31.663589 10324 raft_consensus.cc:740] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:31.686676  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 116618us
I20260709 12:23:31.672947 10394 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:31.667088  9979 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:31.671841 10471 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:31.685173 10474 log.cc:927] Time spent T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:23:31.710294  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.712945  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.715512  3999 raft_consensus.cc:2376] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17. Re-sending same reply.
I20260709 12:23:31.716748  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.611876 10452 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.614104 10469 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.731350  3999 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:31.708757 10471 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:31.720377 10395 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:31.754237 10487 log.cc:927] Time spent T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:23:31.735201 10495 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:31.740480  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:31.709517 10407 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:23:31.708382 10450 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.762540  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 3669) took 1122 ms. Trace:
I20260709 12:23:31.713819 10429 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:31.763398 10469 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:31.818358  3997 rpcz_store.cc:276] 0709 12:23:30.648119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.648591 (+   472us) service_pool.cc:224] Handling call
0709 12:23:31.762283 (+1113692us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540002ec54. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:31.762436 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604586752}
I20260709 12:23:31.842046  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:31.767011 10402 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 12:23:31.785386 10324 consensus_queue.cc:260] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:31.786330 10498 log.cc:927] Time spent T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:23:31.840137  3999 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:31.789522  3995 raft_consensus.cc:1240] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:31.808984 10452 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:31.810042  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.812963 10367 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:31.815696  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 132072us
W20260709 12:23:31.786713 10485 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:23:31.865347  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:31.881597  3997 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 23.
I20260709 12:23:31.883316  3997 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:31.892576  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:31.898633  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 200308us
I20260709 12:23:31.869324 10469 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:31.898238 10495 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:31.863682 10402 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:31.895668 10357 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:31.921227  3962 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:31.933401  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:31.815306  3743 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:31.969129 10493 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:32.027163  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:31.970664 10351 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:31.992568 10355 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.028012 10479 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:32.101444  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76668.3us
I20260709 12:23:32.101387  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:31.935242 10495 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.106395  4577 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:32.108361  3814 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.115305  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:32.030879 10502 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:32.144681  4578 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:23:32.130831 10499 log.cc:927] Time spent T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:32.116503 10351 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.164923  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:32.167368  3990 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.112174 10355 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.210914 10519 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:23:32.212663 10500 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:32.213393 10500 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.220168 10471 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.222811 10471 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:32.223866 10394 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.005s
I20260709 12:23:32.225499 10402 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.204352  9979 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.230573 10465 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:32.229753 10488 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:32.231870  9979 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:32.236310 10355 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.237941 10500 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:32.238318  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.224375 10394 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.240376 10394 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:32.250725 10496 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:23:32.253353 10351 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.254840  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:32.255635  3994 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:32.256175  4577 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:32.174178 10416 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.178887 10450 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:32.180929 10505 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:23:32.181685 10497 log.cc:927] Time spent T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:23:32.184576 10524 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:32.184122  3743 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:32.162221 10380 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:32.185596 10411 consensus_meta.cc:287] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.003s
I20260709 12:23:32.162703 10502 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:32.186713 10495 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:32.190717 10391 consensus_meta.cc:287] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.002s
I20260709 12:23:32.117187 10479 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:32.261312  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 59100.8us
I20260709 12:23:32.268064  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.273375  3990 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:32.298702  3917 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:32.296931 10500 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:32.278409  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 74576us
I20260709 12:23:32.276098  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:32.281828  3916 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:32.294603  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.301327  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:32.304731  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.308287  3889 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:32.266618 10482 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:32.365960  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:32.319640  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:32.306041  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:32.376226  3925 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.012s	sys 0.016s
W20260709 12:23:32.411334  3925 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.019s	sys 0.021s
I20260709 12:23:32.411837  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:32.317251  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:32.413592  3991 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 21. Current term is 22. Ops: []
W20260709 12:23:32.380733  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 63075.4us
I20260709 12:23:32.378216  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:32.280224 10524 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.432049  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:32.316743  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:32.433563  3964 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:32.392061  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:32.441481  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 105743us
W20260709 12:23:32.375144 10505 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:23:32.304520 10470 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:32.381340 10421 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:32.280748 10455 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.155s
I20260709 12:23:32.293728 10380 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.438269 10448 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:32.459750  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:32.439824 10355 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:32.475487  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:32.454253 10415 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.477123  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:32.479815  3920 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.454483 10394 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.490638  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:32.454180 10519 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.488500  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:32.454975 10368 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.299461 10391 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.461037 10421 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:32.491529  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:32.494755  3925 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:32.501032  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:32.305125 10500 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.465768 10475 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:32.607533 10475 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.610172 10380 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:32.610406 10475 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.504258  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:32.611603  9979 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:32.611625  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 107474us
I20260709 12:23:32.456681 10293 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:23:32.614395 10293 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:32.614884 10293 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:32.615914 10293 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.617419 10293 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:32.431545 10482 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.620659 10482 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:32.556339  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47109.3us
I20260709 12:23:32.490087 10351 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.622575 10351 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.484126 10356 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:32.567607 10463 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:23:32.495563 10394 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.508096 10421 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:32.563385 10447 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.585999  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3683) took 1042 ms. Trace:
I20260709 12:23:32.586606 10454 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:32.586802 10391 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:32.493191 10415 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.301771  3743 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 13, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 13 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:32.588150 10479 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.502162 10368 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.593039 10416 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.503314 10519 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:32.596088 10505 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:23:32.497641 10355 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.596485 10395 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:32.597926  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3678) took 1067 ms. Trace:
I20260709 12:23:32.704818 10380 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.306051 10502 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.555212 10471 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:32.554230 10453 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.568279 10428 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.569180 10504 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.746359 10504 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.746928 10355 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:32.748190 10471 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.734082  3993 rpcz_store.cc:276] 0709 12:23:31.530583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.530747 (+   164us) service_pool.cc:224] Handling call
0709 12:23:31.531111 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:31.543428 (+ 12317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.543479 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:31.562095 (+ 18616us) log.cc:844] Serialized 52 byte log entry
0709 12:23:31.681791 (+119696us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:31.705340 (+ 23549us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.732741 (+ 27401us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.925306 (+192565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.925404 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.597559 (+672155us) raft_consensus.cc:1685] finished
0709 12:23:32.597592 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.597804 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57213,"prepare.queue_time_us":59572,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":60,"raft.queue_time_us":66196,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":20824,"spinlock_wait_cycles":8221952,"thread_start_us":274075,"threads_started":2,"wal-append.queue_time_us":301911}
I20260709 12:23:32.714687 10394 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:32.664788  3925 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:32.668497  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.669461  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.680160  3920 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:32.699896  3998 rpcz_store.cc:276] 0709 12:23:31.543674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.546188 (+  2514us) service_pool.cc:224] Handling call
0709 12:23:31.546487 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:31.927895 (+381408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.927930 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:31.948352 (+ 20422us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.449414 (+501062us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:32.449453 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.449517 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.585706 (+136189us) raft_consensus.cc:1685] finished
0709 12:23:32.585739 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.585919 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37003,"raft.queue_time_us":22496,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7911,"thread_start_us":801507,"threads_started":2,"wal-append.queue_time_us":596128}
I20260709 12:23:32.709715  3743 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 16, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:32.700544 10452 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.471395 10470 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.681231 10356 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.627385  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:32.761087  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.750510 10471 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:32.766129  3992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52870 (request call id 2703) took 1053 ms. Trace:
W20260709 12:23:32.770309  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 143778us
I20260709 12:23:32.702716 10447 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.773240 10523 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.774937  3992 rpcz_store.cc:276] 0709 12:23:31.712892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.714323 (+  1431us) service_pool.cc:224] Handling call
0709 12:23:31.714646 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:31.732586 (+ 17940us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:23:31.747632 (+ 15046us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.925853 (+178221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:31.931759 (+  5906us) log.cc:844] Serialized 26 byte log entry
0709 12:23:31.931928 (+   169us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:23:31.970712 (+ 38784us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.970938 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.971026 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.765832 (+794806us) raft_consensus.cc:1685] finished
0709 12:23:32.765862 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.766047 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87448,"prepare.queue_time_us":286286,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":106,"raft.queue_time_us":163687,"raft.run_cpu_time_us":565,"raft.run_wall_time_us":35409,"thread_start_us":173009,"threads_started":1,"wal-append.queue_time_us":248590}
I20260709 12:23:32.753345 10475 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:32.773564  3743 catalog_manager.cc:5697] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:32.782224  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 363708us
I20260709 12:23:32.742056 10395 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:32.786662  3813 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.013s
W20260709 12:23:32.787585  3813 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.008s	sys 0.013s
I20260709 12:23:32.751879 10380 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:32.790690  3921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.013s	sys 0.007s
I20260709 12:23:32.779593 10351 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.756223 10428 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:32.803381  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.810554  3921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.021s	sys 0.011s
I20260709 12:23:32.810904  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.811967  3921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3639) took 1239 ms. Trace:
I20260709 12:23:32.768445 10452 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.814497  3845 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:32.812377  3921 rpcz_store.cc:276] 0709 12:23:31.572870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.787351 (+214481us) service_pool.cc:224] Handling call
0709 12:23:31.787672 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.787905 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:23:32.132011 (+344106us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.811302 (+679291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.811424 (+   122us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:32.811491 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.811557 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.811898 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28004,"prepare.queue_time_us":379805,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":154,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":945500,"threads_started":2}
W20260709 12:23:32.820538  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 43721.8us
I20260709 12:23:32.823764  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.824461  3842 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:32.826717  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:32.827546  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:32.829005  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.814518 10411 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:32.838160 10368 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:32.843966  3846 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:32.845753  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:32.846439  3845 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:32.785812 10475 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:32.915562  3849 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.830875 10450 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:32.918568  3916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46046 (request call id 1804) took 1251 ms. Trace:
W20260709 12:23:32.925217  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 74039.6us
I20260709 12:23:32.932031 10415 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.833781 10511 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:32.928525  3916 rpcz_store.cc:276] 0709 12:23:31.599842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.610472 (+ 10630us) service_pool.cc:224] Handling call
0709 12:23:31.610837 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.308512 (+697675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.851323 (+542811us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000465d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:32.851656 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542696192}
I20260709 12:23:32.945052 10519 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.945931 10421 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:32.953809 10380 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:32.954959 10356 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.031642 10324 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:33.037050 10411 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.037624 10411 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:32.941622 10511 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.046492 10356 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:33.065346  4549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.058625 10380 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.067691 10380 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.058857 10400 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.069221 10400 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.076144 10428 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.056380 10356 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.057427 10511 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.071264 10400 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.111543  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 3685) took 1392 ms. Trace:
W20260709 12:23:33.142164  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 189316us
I20260709 12:23:33.120409  3999 rpcz_store.cc:276] 0709 12:23:31.719106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.881390 (+162284us) service_pool.cc:224] Handling call
0709 12:23:31.906867 (+ 25477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:31.907593 (+   726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.907644 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:31.928061 (+ 20417us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.151099 (+223038us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:32.277177 (+126078us) log.cc:844] Serialized 14 byte log entry
0709 12:23:32.277503 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.277617 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:32.277675 (+    58us) raft_consensus.cc:1685] finished
0709 12:23:32.277695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.816785 (+539090us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180010c9c0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:33.111252 (+294467us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54003b56d0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:33.111458 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109392,"prepare.queue_time_us":128165,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1777,"raft.queue_time_us":6410,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":6284,"spinlock_wait_cycles":85297280,"thread_start_us":177926,"threads_started":1,"wal-append.queue_time_us":260267}
I20260709 12:23:33.151777 10380 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.146327 10456 consensus_queue.cc:1059] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:23:33.153571 10456 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:33.154076 10456 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:33.084939 10500 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.169046 10421 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:33.161154  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46625.1us
I20260709 12:23:33.118438 10470 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.179478  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.181244  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.182201  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.182824  3996 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.183768  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.189792  3991 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:33.184387  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.194712  3995 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:33.196913  3814 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.67:35865 timed out after 1.934s (SENT) [suppressed 24 similar messages]
I20260709 12:23:33.189368  3888 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.214689  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.155119 10456 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.233875  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.245785  3999 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:33.246742  3991 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:33.247411  3996 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:33.243741  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40790
I20260709 12:23:33.284125  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.249114  4579 raft_consensus.cc:606] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:33.293915  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.239338 10535 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:33.298055  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.301514  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:33.240204 10456 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:33.302163  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:33.318370  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.240389 10454 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.295358 10356 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.243811 10482 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.287272 10524 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.306197 10535 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.240947 10386 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:23:33.241106 10463 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.375070  3995 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:33.297284 10428 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.223953 10504 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.244272 10421 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.297027 10429 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:33.380270  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 159241us
I20260709 12:23:33.339717 10500 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.387678 10463 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.291044 10399 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:23:33.389926  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.384176 10535 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:33.396899  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 202796us
W20260709 12:23:33.406078  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 206566us
I20260709 12:23:33.379930 10482 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.408998  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:33.401075 10472 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:33.416179  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.387351 10411 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.399047 10324 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.429307  3814 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:33.391768 10428 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.395829 10421 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.379518 10454 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.417227 10533 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:33.404361 10429 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.422850 10356 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:33.438692 10391 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:33.433624 10324 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.440585  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.406579 10500 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:33.458627  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47934.5us
I20260709 12:23:33.435952 10404 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.457984  3995 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:33.411828 10504 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
W20260709 12:23:33.457937  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48975.3us
I20260709 12:23:33.435261 10502 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.444790 10533 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:33.471484 10411 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 24 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.471608 10380 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.471740 10533 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.472229 10380 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.473205 10533 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:33.473275 10454 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.470412 10502 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.474335 10380 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.476243 10502 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.459916 10356 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:33.467188 10450 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.501542  3843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3789) took 1224 ms. Trace:
I20260709 12:23:33.502715  3843 rpcz_store.cc:276] 0709 12:23:32.275139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.275305 (+   166us) service_pool.cc:224] Handling call
0709 12:23:32.275730 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.275988 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:33.371076 (+1095088us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180048ae40. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5259b4bc 00007fdc4f8e948b 00007fdc587439a9 00007fdc4f90569b 00007fdc4f90393f 00007fdc4f903455 00007fdc563eb3c7 00007fdc529fd9a7 00007fdc52a0d0bf
0709 12:23:33.371256 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.499493 (+128237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:33.499559 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:33.499612 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.499696 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.499832 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143031,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3545,"raft.queue_time_us":5821,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4577,"spinlock_wait_cycles":24454528,"thread_start_us":252275,"threads_started":3,"wal-append.queue_time_us":122005}
I20260709 12:23:33.507412 10429 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.513067 10500 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.515873  4578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 1021) took 1193 ms. Trace:
I20260709 12:23:33.516373  4578 rpcz_store.cc:276] 0709 12:23:32.311179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.311308 (+   129us) service_pool.cc:224] Handling call
0709 12:23:32.415380 (+104072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:32.415876 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.415932 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.103856 (+687924us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b2c000127c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:23:33.104482 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:23:33.380883 (+276401us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:33.381050 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.381125 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.501833 (+120708us) raft_consensus.cc:1685] finished
0709 12:23:33.501854 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.504431 (+  2577us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":515,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17175,"spinlock_wait_cycles":4757888,"thread_start_us":275902,"threads_started":1,"wal-append.queue_time_us":294139}
W20260709 12:23:33.520038 10541 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:33.521427 10463 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.501953 10356 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.466549 10404 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.529522 10404 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.530902 10428 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.532315 10421 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.505532 10450 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.538380 10507 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:33.538884 10507 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:33.541298 10324 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.542225  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.542908  3995 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:33.543872  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.544531  3995 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:33.549593 10507 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.553406  3815 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.554702  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.555781  3995 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:33.556216  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 60000.7us
I20260709 12:23:33.555297  3815 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.560875 10475 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.557464 10507 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:33.565026  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.566133  3991 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:33.568365 10355 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:33.571115  3990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37296 (request call id 996) took 1158 ms. Trace:
W20260709 12:23:33.571501  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.571669  3990 rpcz_store.cc:276] 0709 12:23:32.412259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.414224 (+  1965us) service_pool.cc:224] Handling call
0709 12:23:32.414590 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.417331 (+  2741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.417377 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.417435 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:32.417483 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.570854 (+1153371us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b54003ec1d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:33.570900 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.571058 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5706112}
I20260709 12:23:33.574416  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.577049 10475 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.588063 10475 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.588691 10395 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.590893 10452 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.591094 10475 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:33.570139 10293 consensus_meta.cc:287] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.952s	user 0.016s	sys 0.001s
I20260709 12:23:33.593493  3917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40568 (request call id 2911) took 1716 ms. Trace:
I20260709 12:23:33.535037 10535 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.594084  3917 rpcz_store.cc:276] 0709 12:23:31.866935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.867097 (+   162us) service_pool.cc:224] Handling call
0709 12:23:33.583292 (+1716195us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54002440d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:33.583396 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930816896}
I20260709 12:23:33.598351  3814 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:33.581365  3964 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:33.573992 10504 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:33.612823  3995 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:33.572314 10355 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:33.615577 10355 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.617949  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.620042  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.621140  3999 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:33.621712  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.622597  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.619617  3814 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:33.547153 10511 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:33.626770  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 157133us
I20260709 12:23:33.632797  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.586552 10482 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.631042  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.634969  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.631573 10416 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.636106 10546 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.636821 10543 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.649046  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.648947 10416 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.649361 10543 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:33.636147  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 79270.9us
I20260709 12:23:33.651839  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.653311  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.654109  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.656404  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.658701  3964 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:33.659945 10394 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.660400  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.660511 10394 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.661738  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.661895  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.662894  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.664055  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:33.640193 10549 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:33.627578 10391 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:33.624742 10548 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:33.620783 10475 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:33.643360  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.644238 10450 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.631619 10504 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:33.664287 10394 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.651341 10416 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:33.665674  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.665844  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40568 (request call id 2918) took 1334 ms. Trace:
I20260709 12:23:33.667312  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.667536 10550 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.669327  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:33.642769 10535 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.680192  3842 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:33.680476  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:33.639011  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.716596  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.717296  3995 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:33.718149  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.718822  3995 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:33.631506 10519 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:33.721050  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.722422  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.723834  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.669049 10493 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:33.679807 10549 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.711212  3923 rpcz_store.cc:276] 0709 12:23:32.331402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.441579 (+110177us) service_pool.cc:224] Handling call
0709 12:23:32.441970 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.782450 (+340480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.782481 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:32.782524 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:32.782555 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.665628 (+883073us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003048d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:33.665674 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:33.665788 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782564736}
I20260709 12:23:33.728242  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:33.727391  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.740516  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:33.741946  3995 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:33.743853  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.745127  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.710115 10548 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:33.725318 10391 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.713966 10421 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:33.726601 10519 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.725330 10450 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:33.727393 10395 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.727941 10416 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.737286 10428 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.753942  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:33.766315  3891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.768352  3843 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:23:33.766258  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:33.738209 10551 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:33.749491 10535 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:33.649086 10546 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.776494  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.775254  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.782327  4578 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
W20260709 12:23:33.779815  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 51930.8us
I20260709 12:23:33.777065  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.778407  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.779139  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.772279  3996 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:33.745481 10549 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:33.781661  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.786574  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.786764  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:33.756789 10391 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:33.825491  3846 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:33.826632  3996 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:23:33.765017 10519 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:33.763659 10543 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.832229  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.827476  3916 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:33.829748  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:33.724823 10550 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.848526  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.776010 10500 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:33.785054  3918 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:33.805277  3995 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 24.
I20260709 12:23:33.853530  3846 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:33.848944  4583 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:33.780489 10429 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:33.863642  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:33.864408  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96213.7us
I20260709 12:23:33.865201  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:33.869588  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:33.878401  3924 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:33.767344 10395 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.880039  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:33.881428 10395 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.778791 10428 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.885215  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.824484 10535 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:33.777410 10421 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.878261 10429 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.851432 10356 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:33.834359 10544 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.774384 10416 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.857038 10500 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:33.903960  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:33.912716  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 55432.9us
I20260709 12:23:33.780632 10551 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.915067  3920 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:33.914997  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.915609  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.882282 10511 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:33.783638 10504 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.892148 10475 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:33.920912  3924 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:33.924226  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.904784 10384 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:33.912415 10500 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:33.909104 10557 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:33.937577  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.914739 10524 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:33.941607  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.930694 10456 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.982968 10456 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.984678 10429 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.985208 10456 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.869467 10548 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.986557 10416 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:33.990938  4581 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:33.995644  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:33.938341 10450 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:34.008492  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:33.914376 10356 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:33.941761 10524 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:34.009251  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 144170us
I20260709 12:23:33.917573 10544 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.980213 10509 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.016896  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.007774 10461 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:33.942646 10384 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:33.994679 10543 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:34.016733 10552 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:23:34.010632 10538 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.013654 10524 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:33.989964 10557 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.042757  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.017637 10450 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.048033 10450 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.027019 10567 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:34.052976 10421 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.053728 10471 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:33.989583 10535 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.062544  3921 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:34.021258 10509 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.082237 10384 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.082474 10551 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.022891 10461 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.083396 10471 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.051272 10567 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.084931 10544 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.085886  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.032025 10543 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.040925 10538 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.087848  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.128818  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.089566 10428 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.090996 10356 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.090858  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.130159  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.091878 10546 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.093109  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.095006 10447 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.096627 10519 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.097005 10557 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:34.099090 10530 log.cc:927] Time spent T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 1.688s	user 0.013s	sys 0.014s
I20260709 12:23:34.101032  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.139691  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:34.145159  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44232.8us
W20260709 12:23:34.108300 10533 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.005s
I20260709 12:23:34.154522  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.119215  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.155586  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.088619 10550 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.157570  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:34.132751  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.126219 10471 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.139657  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.140640  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.160079  3920 raft_consensus.cc:1240] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:34.140563  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.142592 10461 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:34.143761 10539 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.793s	user 0.006s	sys 0.000s
I20260709 12:23:34.129957  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:34.155716  3921 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:23:34.120935  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 214991us
I20260709 12:23:34.167691  3964 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.168892  3925 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:34.177416  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:34.178963  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 162129us
I20260709 12:23:34.180414  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.157545 10475 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:34.184880  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.166911 10395 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:34.171136 10400 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:34.190264 10495 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:34.190917 10495 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:34.137307 10456 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:23:34.205731 10567 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.181980 10447 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:34.207845 10450 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:34.208069 10447 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:34.209286 10447 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.210920  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.212927 10475 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.213403 10475 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:34.216770  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.216982  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.199283  4582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35182 (request call id 1022) took 1861 ms. Trace:
I20260709 12:23:34.203394  3919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40578 (request call id 3649) took 2049 ms. Trace:
W20260709 12:23:34.223489  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 141843us
I20260709 12:23:34.178879 10493 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:34.216696  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50500.5us
I20260709 12:23:34.256862  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.258081  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.221900  3815 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.218047  4582 rpcz_store.cc:276] 0709 12:23:32.337764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.337945 (+   181us) service_pool.cc:224] Handling call
0709 12:23:32.338452 (+   507us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:32.391363 (+ 52911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.391429 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:32.837978 (+446549us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b2c000127c8. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:23:32.838608 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 12:23:33.188844 (+350236us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:33.188890 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.188962 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:33.518398 (+329436us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b180018fc40. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f906522 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:34.109081 (+590683us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:34.198999 (+ 89918us) raft_consensus.cc:1685] finished
0709 12:23:34.199030 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.199206 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37609,"raft.queue_time_us":123,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":42980,"spinlock_wait_cycles":133979776,"thread_start_us":349809,"threads_started":1,"wal-append.queue_time_us":511240}
I20260709 12:23:34.203003  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40790 (request call id 0) took 1002 ms. Trace:
I20260709 12:23:34.262885  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.262509  4579 rpcz_store.cc:276] 0709 12:23:33.217973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.218417 (+   444us) service_pool.cc:224] Handling call
0709 12:23:33.736520 (+518103us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54005a0b20. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52970520 00007fdc529ed652 00007fdc579bb60a 00007fdc50f417d4 00007fdc50f41762 00007fdc50f41691 00007fdc50f4160c 00007fdc50f408c2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:34.202559 (+466039us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54005a0b20. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296e5e7 00007fdc529edc68 00007fdc529ed84a 00007fdc579bb60a 00007fdc50f417d4 00007fdc50f41762 00007fdc50f41691 00007fdc50f4160c 00007fdc50f408c2 00007fdc50d2e48c
0709 12:23:34.202781 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209370752}
I20260709 12:23:34.261868  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.196056 10522 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:34.198866 10538 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.195425 10509 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.257975 10493 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.275583 10493 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.219604 10452 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:34.255936 10500 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.281472 10500 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.282728  3924 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:34.268146 10394 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:34.283830 10394 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:34.284853 10394 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.204370 10456 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:34.267381  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:34.265805  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44040us
I20260709 12:23:34.191426 10495 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.197190 10471 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.271339 10503 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:34.264869 10400 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:34.197444 10519 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.267818 10522 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:34.316043  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.255141  3919 rpcz_store.cc:276] 0709 12:23:32.153517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.153726 (+   209us) service_pool.cc:224] Handling call
0709 12:23:32.168635 (+ 14909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:32.202161 (+ 33526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:32.202195 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:32.203268 (+  1073us) log.cc:844] Serialized 26 byte log entry
0709 12:23:32.411687 (+208419us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:23:32.411727 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.411798 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.098534 (+1686736us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:34.203071 (+104537us) raft_consensus.cc:1685] finished
0709 12:23:34.203100 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.203325 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23606,"raft.queue_time_us":36437,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":17289472,"thread_start_us":118250,"threads_started":1,"wal-append.queue_time_us":144224}
I20260709 12:23:34.322104  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.323323  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.324504  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.325026  4579 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:34.289475 10456 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:34.329612 10456 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.330904 10456 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:34.319816 10522 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:34.203389 10391 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.318105 10503 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:34.321499  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.340023 10503 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.348749 10568 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:34.349485 10568 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.353367  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.353513  3815 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.357214  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.358989  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.361100  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.361733  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.361999  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:34.362411  3990 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:34.362777 10452 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:34.363200 10400 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:34.363672 10400 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:34.290738 10549 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.365088 10475 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:34.365901 10566 log.cc:927] Time spent T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.372s	user 0.000s	sys 0.003s
I20260709 12:23:34.366058 10549 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.364066 10400 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:34.352246 10568 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.370602  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.370971  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.369271 10579 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:34.374200  4576 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:23:34.367949 10355 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:34.383489 10519 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:34.387607 10503 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.390136 10495 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.391872  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.367486 10475 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.392659  3992 raft_consensus.cc:2393] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:34.318833 10538 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:34.392709  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:34.394227  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.395066  3890 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.395713  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.397291  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.397884  3890 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.404047 10500 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:34.403281 10324 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:34.398814  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:34.407823 10524 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.409291 10522 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.427597  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.429065  4576 raft_consensus.cc:2410] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
W20260709 12:23:34.484326 10555 log.cc:927] Time spent T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.626s	user 0.002s	sys 0.000s
I20260709 12:23:34.414943  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:23:34.485433  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70609.7us
I20260709 12:23:34.488387  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.489269  3920 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:34.393352 10568 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:34.497634  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.498324  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.494218  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.504942  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.505650  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.505899  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:34.506423  3996 raft_consensus.cc:2368] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
I20260709 12:23:34.507814  4576 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:23:34.508177  4576 pending_rounds.cc:85] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting all ops after (but not including) 15
I20260709 12:23:34.508388  4576 pending_rounds.cc:107] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:23:34.508419  4582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.508716  4576 raft_consensus.cc:2889] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:34.510267  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.511343  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:34.512326  3999 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:23:34.512375  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.511277  3919 raft_consensus.cc:2393] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:34.513899  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.515390  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.515604  3920 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:34.515618  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.517179  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.518299  3998 raft_consensus.cc:1240] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:34.519567  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:34.521981  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:34.522653  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.524432  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.494215 10533 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:34.527593  3921 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:34.494436 10549 raft_consensus.cc:493] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:34.504046 10522 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.493434 10493 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.542176  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.517016 10524 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.499468 10355 consensus_queue.cc:1059] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:23:34.537216 10533 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.554800  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.556912  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.569802  3846 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:34.551132  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.519034 10471 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:23:34.579499  3888 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.580142 10428 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:34.580462  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.585107  3888 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.586215  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.589133  3993 raft_consensus.cc:2368] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16.
I20260709 12:23:34.568961 10421 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:34.590458 10429 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:34.586596 10447 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:34.577209 10533 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:34.551185 10568 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.542043 10549 raft_consensus.cc:515] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.592811 10400 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.591679 10503 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.569187 10572 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:34.590246  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:34.604431 10495 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.595224 10509 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 12:23:34.666597  3990 raft_consensus.cc:1240] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:34.668763 10400 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.676354 10571 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:34.678431 10549 leader_election.cc:290] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.663249 10568 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.686189 10558 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.690574 10574 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:23:34.690881  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 150982us
W20260709 12:23:34.692409  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 102483us
I20260709 12:23:34.699134 10503 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:34.712579  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:34.720245 10503 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:34.721266 10503 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.702745 10579 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:34.727187  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:34.706822 10549 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:34.709756 10519 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.702517 10571 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.729200 10471 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:34.701419 10572 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.739476  3845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:34.755273  3845 raft_consensus.cc:606] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.755748  3845 raft_consensus.cc:614] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:34.738775  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.706180 10558 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.754081  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:34.751919  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 93552.2us
W20260709 12:23:34.759764  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.765528  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.728518 10574 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.743762 10586 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:34.778486  3994 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:34.789594  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.753046 10493 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.797797  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.743031 10450 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:23:34.800294  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.782269  3814 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.762045 10573 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.772483 10447 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:34.752621 10471 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:34.737571 10549 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.842736 10471 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:34.844931 10549 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.802811 10570 raft_consensus.cc:993] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:34.845772 10570 raft_consensus.cc:1081] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:34.791538 10586 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.847329 10586 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:34.850337  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.851719  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.852823  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.853761  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67af26a7a42843f6855950af7a5b7781" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.854084  4581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35184 (request call id 1073) took 1202 ms. Trace:
I20260709 12:23:34.854439  4581 rpcz_store.cc:276] 0709 12:23:33.651607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.663827 (+ 12220us) service_pool.cc:224] Handling call
0709 12:23:34.853891 (+1190064us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400671954. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f72fa 00007fdc579b8b17 00007fdc50f336d4 00007fdc50f33662 00007fdc50f33591 00007fdc50f3350c 00007fdc50f327c2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:34.853992 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558547200}
I20260709 12:23:34.857224 10543 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:34.858108  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.858377  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.859017  3922 raft_consensus.cc:3060] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:34.862069 10564 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:34.862596 10564 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:34.748447 10519 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.865447  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.866489  4575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35180 (request call id 931) took 1232 ms. Trace:
I20260709 12:23:34.867326 10519 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.806593 10590 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.868089 10590 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.870428 10590 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.866866  4575 rpcz_store.cc:276] 0709 12:23:33.633660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.633766 (+   106us) service_pool.cc:224] Handling call
0709 12:23:34.865287 (+1231521us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b58001d5898. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f8ceb71 00007fdc4f8cea22 00007fdc587e78d9 00007fdc57941ee0 00007fdc57a0b0ab 00007fdc57a0b131 00007fdc579b90a0 00007fdc579b8984 00007fdc50f336d4 00007fdc50f33662
0709 12:23:34.866416 (+  1129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3659520}
I20260709 12:23:34.872675  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.803987  3847 raft_consensus.cc:1240] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:34.808146  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:34.813807 10391 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.895800  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:34.814316 10582 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:23:34.900341  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:34.815320 10568 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.817493 10558 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.908334  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.819114  3850 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:34.819852  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.820251 10574 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.736878 10579 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.821606 10588 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:34.822156 10571 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.822680  3814 leader_election.cc:400] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
I20260709 12:23:34.825094  3842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:34.840416  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.919025  3842 raft_consensus.cc:606] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.841588  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:34.841724  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.919224  3843 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 8.
I20260709 12:23:34.806938 10572 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:34.877416  3993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:23:34.923892  3993 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.924207  3993 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.882529  3964 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:34.882596  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:34.923053  3994 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 22.
I20260709 12:23:34.926433  3889 leader_election.cc:400] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16.
I20260709 12:23:34.882972  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.926863  3889 leader_election.cc:403] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:23:34.921597 10504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.012s
I20260709 12:23:34.873785  4580 raft_consensus.cc:2376] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16. Re-sending same reply.
I20260709 12:23:34.933863  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.904830  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.906337  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:34.907686  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.911419  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.911695  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.912120  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.910913  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:34.912875  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.913427  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.913569  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.914489  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:34.914510  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.921245  3814 leader_election.cc:403] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:34.875612  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.826077  4578 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.939417  3847 raft_consensus.cc:2368] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16.
I20260709 12:23:34.939548  3846 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
W20260709 12:23:34.930999  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 48108.9us
I20260709 12:23:34.932402  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:34.944056  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 121533us
I20260709 12:23:34.947810  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:34.951922  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.942620  3993 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.953405  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.894212  3922 raft_consensus.cc:2468] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:34.956667 10588 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:23:34.959594 10428 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16.
I20260709 12:23:34.909714 10471 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:34.872819 10564 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.967871  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
W20260709 12:23:34.934077 10504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.012s
I20260709 12:23:34.966619  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.960984  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.972972  3845 raft_consensus.cc:2393] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:34.968032  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.969486  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.970348  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.932662 10509 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:34.971942  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.937479 10572 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:34.977555  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:34.922453 10547 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:23:34.980695  3888 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.980943  3993 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.971616 10524 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:23:34.959748 10571 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:23:34.983588  3888 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:34.983903 10596 consensus_queue.cc:1059] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:34.985150 10596 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:34.969017 10574 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:34.985522 10596 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:34.986400 10596 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.987368 10579 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.988186 10596 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:34.988806  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.990051  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:34.990641  3846 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 10.
I20260709 12:23:34.991037 10471 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:34.993243  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:34.994686  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:34.995644 10562 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:34.996088 10562 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:34.996668 10562 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.997798 10533 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:34.999164  3918 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:34.967388 10503 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:34.999779 10503 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:35.000167 10503 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:34.981010 10558 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:35.004550 10558 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:34.965766 10447 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.007613 10447 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.008865 10504 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:35.010195 10447 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:35.012354  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.013922 10507 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:34.998819 10492 consensus_queue.cc:1059] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:35.015239 10492 raft_consensus.cc:3055] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:35.015654 10492 raft_consensus.cc:740] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:35.016139  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.016542 10492 consensus_queue.cc:260] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.019865 10564 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:35.022993  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.023628  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.023902  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.024299  3846 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:35.025386  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.025480  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.025978  3846 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:35.028075 10492 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.025986 10585 raft_consensus.cc:3055] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:35.028855  3964 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:35.029134 10585 raft_consensus.cc:740] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:35.029999 10472 raft_consensus.cc:2804] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:35.030122 10585 consensus_queue.cc:260] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.036036 10585 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:34.982035 10421 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.030754 10472 raft_consensus.cc:697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:35.031652 10522 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:35.029865 10588 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
I20260709 12:23:35.032214 10452 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.059535  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:35.060084 10452 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.054410 10429 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.062099 10589 consensus_queue.cc:1059] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:35.062450 10452 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:35.063258 10589 raft_consensus.cc:3055] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:35.063671 10589 raft_consensus.cc:740] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:35.034554  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:35.065948  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:35.017609  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:35.043637  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60200.9us
I20260709 12:23:35.069551  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.070948  3996 raft_consensus.cc:1240] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:35.072152  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.075336  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:35.076893  3888 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:35.047384  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 100096us
I20260709 12:23:35.045593  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.078452  3888 leader_election.cc:400] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16.
I20260709 12:23:35.055645  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:35.058058  3995 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:35.059367  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.068183  3990 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 23. Current term is 24. Ops: []
I20260709 12:23:35.080575  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.081131  3990 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:35.081384  3995 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:35.083319  4579 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:35.087764  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.088958  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.100085  3998 raft_consensus.cc:2393] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 19: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:35.091722 10543 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.091620 10586 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.092756 10573 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:35.092878 10472 consensus_queue.cc:237] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.094210  3842 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: [15.11-17.12]
W20260709 12:23:35.096601  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51154.2us
I20260709 12:23:35.097259  3814 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.098068  3845 raft_consensus.cc:1240] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 20. Current term is 21. Ops: [20.18-20.18]
W20260709 12:23:35.103149  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45770.5us
I20260709 12:23:35.104611  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.083802  4579 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:35.102635  3962 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.110538  3815 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.054822 10509 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:35.115581  3815 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.051335 10522 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.113786  3841 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:23:35.112787  3962 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.112645  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:35.068409 10447 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:35.117511  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:35.162374  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 46060.7us
I20260709 12:23:35.116902 10596 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
W20260709 12:23:35.125293  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.164551  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49074.9us
I20260709 12:23:35.114612  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:35.105706 10572 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:35.166967  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52463.8us
I20260709 12:23:35.166469  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.106068 10543 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:35.116463 10450 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.169632  3849 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 15: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:23:35.169739  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 92951.9us
I20260709 12:23:35.112229 10421 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.173296 10356 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:35.173764 10471 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:35.174244 10456 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:35.103727 10535 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.064476 10589 consensus_queue.cc:260] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.173151  3814 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:35.222785  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 56443.6us
I20260709 12:23:35.224321 10608 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:35.252043  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.111176 10573 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.255116 10573 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:35.116315 10428 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.166229 10587 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.231500 10543 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.161077 10590 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.166457 10447 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:35.234440 10394 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.239275 10533 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:35.243746  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 70689.9us
I20260709 12:23:35.254302 10608 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:35.240926  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 123470us
I20260709 12:23:35.260703  3815 leader_election.cc:304] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.119279  4579 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.173156 10567 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:23:35.241760 10456 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.260072 10471 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.285755  3814 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.285791  3888 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.235175 10475 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:35.175836 10355 consensus_queue.cc:1059] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 12:23:35.266276 10572 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.319664  3847 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:35.328171  3814 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.319494  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.276412 10447 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:35.362251  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.337776 10562 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.301497 10522 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:35.294862 10590 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:35.328226 10429 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:35.357101  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.295011 10509 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.378021 10562 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:35.302670 10589 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.286665 10608 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:35.401211  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 73114.3us
I20260709 12:23:35.361212 10596 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:35.388489  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.365145  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 45769.6us
I20260709 12:23:35.291810 10456 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.390568  3843 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 24.
W20260709 12:23:35.369745  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 257001us
W20260709 12:23:35.407855  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 147218us
W20260709 12:23:35.372332  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 135477us
I20260709 12:23:35.413141  3814 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.402930  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.373034 10590 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:35.417356  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.369386 10533 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:35.409113  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.417850  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.409391  3815 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.294390 10503 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.420713  3919 raft_consensus.cc:1240] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:35.422617  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 200695us
I20260709 12:23:35.408041 10564 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:35.428570  3916 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:35.432266  3994 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:35.436673  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:35.437613  3990 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:35.438966  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.412315 10587 raft_consensus.cc:2749] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.446928  3994 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:35.447359  3991 raft_consensus.cc:1240] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:35.453552  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:35.449756 10579 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:23:35.457590  3993 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:35.422318 10356 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:35.478766  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:35.451953 10504 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:35.454703 10501 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:35.488554  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:35.488921  3990 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:35.492090  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:35.492408  3924 raft_consensus.cc:2393] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 18: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:35.493245  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:35.473529 10590 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:35.509037 10599 consensus_queue.cc:1175] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "32d706e2535f4fa19a09382d4edac677" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:35.518503 10546 raft_consensus.cc:3055] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:23:35.521579  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 64228.9us
I20260709 12:23:35.519152 10546 raft_consensus.cc:740] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:35.530601  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:35.489001 10504 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.535434  4578 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:23:35.535537  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.557763 10471 raft_consensus.cc:3055] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:35.558342 10471 raft_consensus.cc:740] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:35.535696 10559 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:35.559240 10471 consensus_queue.cc:260] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.560676 10471 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:35.561903 10503 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:35.492599 10501 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:35.563102 10616 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:23:35.563270 10596 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:35.564589 10501 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:35.577095 10573 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.579581  4580 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:23:35.581086 10573 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:35.583721  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.584992  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.564977 10504 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:35.581784 10546 consensus_queue.cc:260] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.597781  3841 raft_consensus.cc:3060] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:35.596333 10350 consensus_queue.cc:1059] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:23:35.600726 10543 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.601389  3848 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:35.604707 10446 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:23:35.607465  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117735us
I20260709 12:23:35.616837  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:35.618682  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.608675  3889 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:35.631709  3844 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:23:35.633361  3925 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:35.634593  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:35.636485 10586 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:35.637614  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:35.639359  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:35.583786 10475 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:23:35.637883 10624 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:35.642552  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.643337  4579 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.645756  4546 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.650612  3841 raft_consensus.cc:2468] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:35.619781 10543 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:35.651926  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 234178us
I20260709 12:23:35.657262  3962 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.652436  3996 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:35.653039  3990 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:23:35.650087  4546 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.655296 10538 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:35.660828 10456 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.645447 10428 raft_consensus.cc:2804] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:35.669456  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.674117  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:35.676437  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 68639.7us
I20260709 12:23:35.683398  3815 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.676889  3962 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.686478  3815 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.699283  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:35.615171 10447 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:35.747802  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 61462.2us
W20260709 12:23:35.746647  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 77251.9us
I20260709 12:23:35.667868 10510 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:35.661999 10608 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.752293  3919 raft_consensus.cc:1240] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:35.753587  3888 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:35.757180  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 80363.7us
I20260709 12:23:35.759596  3962 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:35.759790  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:35.675771 10563 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.768739  3921 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:35.746647 10472 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.746351 10522 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.772315  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:35.773250  3849 raft_consensus.cc:606] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:35.773551  3918 raft_consensus.cc:1240] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:35.773824  3849 raft_consensus.cc:614] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:35.771378  3993 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:23:35.765841  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:35.751775 10428 raft_consensus.cc:697] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:35.756229 10589 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:35.750694 10622 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:35.764314 10475 raft_consensus.cc:2764] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:23:35.761893 10538 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:35.749048 10596 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:23:35.800699  3888 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.765359 10571 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:23:35.788120 10588 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:35.810643 10620 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:35.808286  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.813182  3849 raft_consensus.cc:2376] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 24. Re-sending same reply.
W20260709 12:23:35.819718  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 60243us
I20260709 12:23:35.822947  3962 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.802910 10617 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.831369  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.833138  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96631b804304cddb7995664610e592d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:35.834888  3849 raft_consensus.cc:606] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.835271  3849 raft_consensus.cc:614] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:35.831089  3814 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:35.851760  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.806856 10535 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:23:35.845324  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:35.827426 10475 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.867797  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.868848  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.870010  3850 raft_consensus.cc:1240] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:35.842485 10400 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.875612  3846 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:35.867841  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:35.842146 10622 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:35.837728 10533 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:23:35.877797  3845 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:35.834764 10429 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:23:35.880488  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.858160 10386 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:35.884270  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:35.885360  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:35.903400  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 67077.8us
I20260709 12:23:35.883076 10620 consensus_queue.cc:1059] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:23:35.892478 10621 raft_consensus.cc:2764] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:23:35.853993 10504 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:23:35.904518  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:23:35.905735  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.897475  3843 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.875345 10446 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:35.923171  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:35.940845  3845 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:35.943146 10608 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:35.864580 10610 consensus_queue.cc:1059] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:23:35.944437 10610 raft_consensus.cc:3055] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:35.944813 10610 raft_consensus.cc:740] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:35.945593 10610 consensus_queue.cc:260] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:35.946940 10610 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:35.950119  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.835326 10428 consensus_queue.cc:237] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:35.983203  3843 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
W20260709 12:23:35.984473 10626 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:23:35.985738 10628 log.cc:927] Time spent T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:23:35.986480 10631 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:23:35.987620 10629 log.cc:927] Time spent T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:23:35.879855 10607 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.156s
I20260709 12:23:35.884476 10400 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:36.016098  3813 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.923925 10447 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:35.949298 10450 consensus_queue.cc:1175] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" responder_term: 20 status { last_received { term: 20 index: 18 } last_committed_idx: 18 last_received_current_leader { term: 20 index: 18 } }
I20260709 12:23:36.036738 10533 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:23:36.037269 10533 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.038374 10533 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.044478 10400 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:35.933112 10617 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.963737 10456 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.082119  4580 raft_consensus.cc:1240] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:36.082865  4581 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:36.085290  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:36.087426  3844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34162 (request call id 3075) took 1119 ms. Trace:
W20260709 12:23:36.100128 10471 consensus_meta.cc:287] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 12:23:36.087869  3844 rpcz_store.cc:276] 0709 12:23:34.967792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.109907 (+142115us) service_pool.cc:224] Handling call
0709 12:23:35.627594 (+517687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.632290 (+  4696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.087227 (+454937us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540011bcd0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f28ad 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:36.087362 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071011584}
I20260709 12:23:36.068770 10617 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.118216 10617 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.118433 10590 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.121783  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:36.131078  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:23:36.146615  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.140648 10400 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:36.151844 10607 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:23:36.171875  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:36.172643  3998 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:36.170698  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:36.229460  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 57951.3us
W20260709 12:23:36.237643  3999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.028s	sys 0.030s
W20260709 12:23:36.238557  3999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.028s	sys 0.030s
I20260709 12:23:36.174208 10510 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:36.156896 10429 consensus_queue.cc:1059] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:23:36.175910 10400 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:36.227674 10475 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:36.171437 10447 consensus_queue.cc:1059] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:23:36.242151  3888 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:36.248484  4578 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:23:36.245934  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 75338.8us
I20260709 12:23:36.239835  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:23:36.248859  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 191898us
I20260709 12:23:36.244979 10535 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.268543 10400 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.252728 10475 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.270386 10429 raft_consensus.cc:3055] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:36.282775 10429 raft_consensus.cc:740] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.283806 10429 consensus_queue.cc:260] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.272392 10637 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:36.272905 10428 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.282299 10501 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:36.285867  4581 raft_consensus.cc:1240] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:23:36.256285 10619 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.304250 10428 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.307044 10428 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.308218 10429 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:36.311585 10588 consensus_queue.cc:1059] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:36.285207 10535 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.310530 10510 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Committing config change with OpId 15.14: config changed from index 9 to 14, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:36.323400 10475 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.336105 10535 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.299728 10617 consensus_queue.cc:1059] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:36.344404 10617 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:36.344887 10617 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:36.346139 10617 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.300395 10501 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.348526 10501 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:36.359273  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.360713 10446 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:23:36.366887 10446 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:36.362498 10646 consensus_queue.cc:1175] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bd47d64594f743eba2922d79251c1c5c" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 10 index: 11 } }
I20260709 12:23:36.368886 10633 raft_consensus.cc:3055] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:36.369946 10633 raft_consensus.cc:740] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.367311 10446 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:36.371104 10446 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.370865 10633 consensus_queue.cc:260] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.372802 10633 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:36.374310 10522 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.372680 10446 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.385882  3842 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:36.386586  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.395529  3845 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 24.
I20260709 12:23:36.393379  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.362542  3924 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 9 to 14, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:36.403309 10647 log.cc:927] Time spent T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 12:23:36.361702 10567 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:36.356621 10475 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:36.408182  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:36.411628  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
W20260709 12:23:36.409104  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 167025us
I20260709 12:23:36.395169 10617 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:36.422709  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.423565  3844 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:36.428604  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.429219  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:36.430987  3841 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:36.407176 10567 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:36.433686  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:36.416818 10493 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:23:36.416322 10475 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.400161 10522 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.432001 10509 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:23:36.431838 10495 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:23:36.452832 10621 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:36.453356 10621 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.453719 10621 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:36.455279 10574 consensus_queue.cc:1059] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:36.455832 10651 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:36.456188 10574 consensus_queue.cc:1243] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:36.456856 10574 raft_consensus.cc:3055] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:36.456501 10651 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.457237 10574 raft_consensus.cc:740] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:36.458261 10574 consensus_queue.cc:260] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.459103 10651 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.459673 10606 consensus_queue.cc:1059] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:23:36.426184 10642 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:36.465494  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.465808 10606 raft_consensus.cc:3055] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:36.466673 10606 raft_consensus.cc:740] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:36.469326 10606 consensus_queue.cc:260] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.474927  3844 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:36.447423 10610 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:36.417917 10633 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:23:36.476143 10610 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.478332 10610 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:36.478644 10522 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.480785 10475 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.448652 10615 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:36.460070 10574 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.493037  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.511410  3888 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:36.465627 10642 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:36.541985  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 124155us
I20260709 12:23:36.542644 10637 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:23:36.541879 10612 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:36.547091 10612 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.547742 10501 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.548919  4579 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:36.549414 10612 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.551968 10495 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:36.552713 10495 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.555384 10495 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.551065 10612 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:36.532176 10421 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:36.558485 10421 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.558961 10421 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:36.490666 10621 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.561695 10621 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.543118 10642 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:36.542918 10565 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.568110  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:36.568742  3845 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:36.603260  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.638837  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.648809  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78668us
W20260709 12:23:36.652913  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.563264 10568 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:36.659822 10471 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.661514 10599 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.662302 10588 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:36.486819 10567 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.681070  3841 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:23:36.666105  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 237005us
I20260709 12:23:36.713249 10510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49860 (request call id 1) took 2769 ms. Trace:
I20260709 12:23:36.672937 10501 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:36.732497  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 188483us
I20260709 12:23:36.713819 10510 rpcz_store.cc:276] 0709 12:23:33.944087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.944650 (+   563us) service_pool.cc:224] Handling call
0709 12:23:34.824020 (+879370us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b540092e8a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52970520 00007fdc529f9b42 00007fdc529f8800 00007fdc529f19fa 00007fdc579b94c9 00007fdc50f35c54 00007fdc50f35be2 00007fdc50f35b11 00007fdc50f35a8c 00007fdc50f34d42
0709 12:23:34.948999 (+124979us) log.cc:844] Serialized 494 byte log entry
0709 12:23:35.294356 (+345357us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b540092e8a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc5296c142 00007fdc5294ceaa 00007fdc52953d53 00007fdc52953cd9 00007fdc52953c69 00007fdc52953c31 00007fdc52952dfd 0000000000388634 0000000000388479 00007fdc4f906475
0709 12:23:35.297816 (+  3460us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b540092e8a0. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc52973b26 00007fdc5296d49a 00007fdc5296c714 00007fdc5294ceaa 00007fdc52953d53 00007fdc52953cd9 00007fdc52953c69 00007fdc52953c31 00007fdc52952dfd 0000000000388634
0709 12:23:36.713127 (+1415311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23029,"raft.run_cpu_time_us":5217,"raft.run_wall_time_us":370992,"spinlock_wait_cycles":55112832,"thread_start_us":54698,"threads_started":1,"wal-append.queue_time_us":226056,"wal-append.run_cpu_time_us":2049,"wal-append.run_wall_time_us":1023748}
I20260709 12:23:36.647406 10565 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.749217  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:36.749202  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.762262  3924 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19. Ops: []
I20260709 12:23:36.772065  3921 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:36.773641  3919 raft_consensus.cc:1275] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:36.776701  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.778307  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.784649  3924 raft_consensus.cc:2393] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:36.792147  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:36.793013  3999 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:36.794221  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 58860.7us
I20260709 12:23:36.673187 10471 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:36.817677  4548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.671797 10599 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.741039  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:36.821302 10599 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.824036  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
W20260709 12:23:36.815524  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 62582.9us
I20260709 12:23:36.827272  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:36.827497  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:36.737053 10567 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:36.734871 10519 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:36.669816 10568 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.829211  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:36.674103 10588 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.828474  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:36.832332  4574 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:36.730453 10429 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
W20260709 12:23:36.842152  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 101203us
W20260709 12:23:36.847874 10661 log.cc:927] Time spent T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 12:23:36.849884 10471 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.851166 10400 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:23:36.857944  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.879086  3999 raft_consensus.cc:2468] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:36.789503 10656 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
W20260709 12:23:36.893889  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 63034.5us
W20260709 12:23:36.899520  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 58304.4us
I20260709 12:23:36.913887 10568 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.855259  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260709 12:23:36.915038  3734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 63680.1us
I20260709 12:23:36.872133 10608 raft_consensus.cc:3055] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:36.923866 10608 raft_consensus.cc:740] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.883930 10456 consensus_queue.cc:1059] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:23:36.929312 10456 raft_consensus.cc:3055] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:36.929705 10617 consensus_meta.cc:287] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 12:23:36.929927 10456 raft_consensus.cc:740] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:36.856662 10400 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.931795 10400 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:36.942705 10421 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.943492 10429 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.943718 10533 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:36.944168 10429 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:36.947192  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 43699.6us
W20260709 12:23:36.948796 10653 log.cc:927] Time spent T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:23:36.950049 10504 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.950624 10504 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.952996 10504 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:36.954708 10650 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.541s	user 0.000s	sys 0.021s
W20260709 12:23:36.956516  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 53665.1us
I20260709 12:23:36.958222  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:36.958799 10446 consensus_meta.cc:287] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.010s
W20260709 12:23:36.963222 10657 log.cc:927] Time spent T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:23:36.931300 10456 consensus_queue.cc:260] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.964951 10565 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.966089 10456 raft_consensus.cc:3060] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:36.967257 10588 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.967694 10607 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.837599 10519 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.968323 10607 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.970052 10519 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:36.971750 10607 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:36.976991 10461 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:36.977322 10546 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.977959 10522 consensus_queue.cc:1059] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:36.978789 10522 consensus_queue.cc:1243] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:36.979276 10656 raft_consensus.cc:3055] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:36.979723 10656 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:36.980726 10656 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:36.982203 10656 raft_consensus.cc:3060] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:36.984023  4575 raft_consensus.cc:1240] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:36.985107  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:36.989580 10606 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:36.991950  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:36.992913  3843 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 21: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:36.992450 10608 consensus_queue.cc:260] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:36.993698 10608 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:36.984933 10655 consensus_queue.cc:1048] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:36.995585  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.001022  3843 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
W20260709 12:23:36.998503 10660 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:23:37.004256  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.010353  3842 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:37.010660  3843 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:37.005390  3845 raft_consensus.cc:2468] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
W20260709 12:23:37.016853  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.009943 10637 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.020380  3850 raft_consensus.cc:1240] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19. Ops: [15.11-18.12]
I20260709 12:23:37.019799  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.021502  3995 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:37.022672  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.024415  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.025105  3999 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:37.020661  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.027139  3993 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:37.009146 10621 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:37.086189  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 252114us
I20260709 12:23:37.088927  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.008889 10633 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.097150  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.097645  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.020542 10637 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.100155  3921 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:37.100212  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.103369 10612 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.104094 10612 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.104876 10637 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.106313 10421 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.107864  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:37.108546 10612 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.110885  3993 raft_consensus.cc:1240] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:37.112519  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.110792  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.114689  3994 raft_consensus.cc:1240] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:37.037705 10621 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.125473 10642 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:37.132197 10658 log.cc:927] Time spent T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.472s	user 0.005s	sys 0.000s
W20260709 12:23:37.133908  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 96351.3us
I20260709 12:23:37.135313  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.131907 10633 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.028204 10461 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:23:37.138845  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.136119  3921 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:23:37.141345  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.142071  3888 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.145781  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.146682  3844 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:37.145541  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.148097  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.149065  3921 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:37.148087  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.137089  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.157724  3850 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
W20260709 12:23:37.154475  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.149412  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.160545  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.121886 10621 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.160193  3849 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:37.156247  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.164965  3924 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:37.135725 10475 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:37.167620  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.138360 10572 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.164142 10368 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:23:37.173719 10475 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.155668 10646 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.198035  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.159332 10612 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.194306  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.225805 10612 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.197300 10646 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.195597 10452 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:37.227365  4581 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:37.227175 10452 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.228194 10612 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.229251 10669 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:37.195564 10639 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.229852 10669 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.230314 10639 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.206669 10633 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.170738 10421 raft_consensus.cc:2804] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:37.200213 10475 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:37.171204 10588 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.241143 10588 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.216670  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.218819  3996 raft_consensus.cc:1275] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:37.219120  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:37.242480  3993 raft_consensus.cc:3060] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:37.219468  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.219784  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.218819  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:37.222267  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.223399  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.243698  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.241588 10588 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.244979  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.245762  3995 raft_consensus.cc:2393] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:37.232677 10429 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.244879  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.236719  4547 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:37.247391 10421 raft_consensus.cc:697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:37.230279 10669 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.248409 10421 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.251657 10546 raft_consensus.cc:2804] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:37.252022 10606 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.252274 10546 raft_consensus.cc:697] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:37.252655 10606 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.253433 10546 consensus_queue.cc:237] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.255081 10606 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.242472  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:37.187366 10607 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.232802 10639 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.239079 10400 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.258652  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:37.259931  4574 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:37.263393  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.229351 10452 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:37.255594 10574 consensus_meta.cc:287] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.004s
I20260709 12:23:37.257449 10607 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.273778  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.274547 10607 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.196851 10572 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.269141 10642 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.276949 10572 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.269673  3993 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:37.265091 10667 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.271335  3992 raft_consensus.cc:1240] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:23:37.271922  4575 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 23: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:37.267280 10639 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:37.287480  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.286420  3996 raft_consensus.cc:2955] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Committing config change with OpId 15.14: config changed from index 9 to 14, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:37.294859  3998 raft_consensus.cc:2410] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:23:37.269150 10588 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.291827 10667 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.303916 10667 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.304243 10400 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.301872 10646 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.293351 10639 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.306143 10639 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.302260 10475 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.313943 10667 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.315434 10475 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.316279 10667 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.315419 10639 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.319422 10588 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.320206 10669 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.322355 10639 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.323033 10669 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.088882  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.188225  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:37.363976  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 175672us
I20260709 12:23:37.366698  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.372298  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:37.381042  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.381917  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.382508  3841 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23.
I20260709 12:23:37.189040  3844 raft_consensus.cc:2468] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:37.370944  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:37.234952  3888 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.407104  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.408994  3919 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:37.420011  3917 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:37.425544  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.429546  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.429914  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.430995  3848 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:23:37.431775  3963 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.431023  3847 raft_consensus.cc:2393] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 14: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:37.439604  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:37.440121  3997 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 14.
I20260709 12:23:37.441130  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.444854  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.446403  3994 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 14: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:37.448145  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.448545  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.449242  3850 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.451818  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:37.479722 10446 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:37.480487 10446 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.485105 10446 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.485302 10472 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:23:37.485848  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 243318us
I20260709 12:23:37.486042 10472 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.486521 10472 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:37.494817 10519 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:37.495980 10607 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:37.498943 10350 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.505872  3848 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
W20260709 12:23:37.499265  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 264222us
I20260709 12:23:37.510612 10567 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:37.500073 10533 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.501037 10519 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.518332 10615 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.517633 10639 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:37.519688 10564 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.526665 10585 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.527652 10585 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.529172 10471 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.529752 10471 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:37.530165 10471 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.533430  3962 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.561770  3850 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
W20260709 12:23:37.563280  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 108371us
I20260709 12:23:37.525691 10519 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:37.516017 10533 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.525401 10615 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.535413 10461 raft_consensus.cc:2804] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:23:37.573146  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 182755us
I20260709 12:23:37.570302 10533 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.576978  4546 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.566694 10607 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.566469 10567 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.589371 10668 raft_consensus.cc:2804] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:37.591277 10501 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.570385 10615 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:37.609978  3890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.612197  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.612430  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:37.612972  3925 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 21.
I20260709 12:23:37.613312 10504 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:37.613343  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:37.614377 10504 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.616948 10504 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.613245  3922 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.596118 10567 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.542263 10564 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.628732 10549 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.608318 10461 raft_consensus.cc:697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:37.637224 10501 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.644119 10607 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.621579 10668 raft_consensus.cc:697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:37.665761  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.663367  3888 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.666803  4575 raft_consensus.cc:2393] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 12: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:37.658808 10549 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.653987 10567 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.583489 10350 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:37.674430  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55631.1us
I20260709 12:23:37.677345 10421 raft_consensus.cc:2804] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:37.677984 10421 raft_consensus.cc:697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:37.679057 10421 consensus_queue.cc:237] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.687500 10501 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.690330 10607 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.691310 10538 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.692109 10538 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.694859 10538 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.696770  3744 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 15 to 16, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:37.698764  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.697665  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.699563  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.700016  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:37.701985  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.709497  3842 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:37.703341 10549 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.721207  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.722249  3849 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:37.727929  3845 raft_consensus.cc:2410] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:23:37.676326 10585 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.668452 10668 consensus_queue.cc:237] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.734313  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.730090  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.741365  3922 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:37.742892  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.679730 10461 consensus_queue.cc:237] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.750692 10350 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:37.756428  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 99145.8us
I20260709 12:23:37.743637  4575 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
W20260709 12:23:37.762214  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.771011  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.780336 10522 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:37.780925 10522 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.781387 10522 raft_consensus.cc:3060] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:37.780175  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.789008  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.789996  3843 raft_consensus.cc:2368] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 21. Current term is 22.
I20260709 12:23:37.785635 10472 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.797322 10472 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.801901  4546 leader_election.cc:400] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 21. Current term is 22.
I20260709 12:23:37.802330  4546 leader_election.cc:403] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:37.803622 10642 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.804595 10642 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.805024  3744 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 11, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 11 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:37.807866  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.808069 10510 raft_consensus.cc:3060] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:23:37.811316  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.811698  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.814317 10607 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:37.814793 10607 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.816453 10564 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.815208 10607 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.820947 10507 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.821771 10507 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.831285  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:37.833568  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 62688.4us
I20260709 12:23:37.835096  3847 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:23:37.854511  4546 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.842288 10564 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.864656 10386 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.865170 10606 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.865486 10568 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.865864 10507 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.866258 10568 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.855293 10533 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.867578  3918 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.870043 10568 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.865211 10386 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.871068 10386 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.872458  3919 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:23:37.865998 10606 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.877071  3843 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23.
I20260709 12:23:37.872893  3919 pending_rounds.cc:85] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 11
I20260709 12:23:37.879824  3919 pending_rounds.cc:107] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:23:37.879668  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.879994  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:37.880244  3919 raft_consensus.cc:2889] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.880545  3920 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 12.
I20260709 12:23:37.880714  4575 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:37.884435  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:37.885759  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.887964  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:37.888758  3916 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:37.889442  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:37.890108  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.893837 10501 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:37.895936 10568 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:37.856355 10639 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:37.896442 10568 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.897140 10568 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.896865 10639 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.901000 10522 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.906430 10567 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:37.912117 10688 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:23:37.929797  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:37.850920 10446 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.930585  3992 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:37.930887 10522 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.932443 10446 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.912773 10533 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.913461  3918 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:37.934137  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:37.935012  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:37.935659  3922 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.918044 10391 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.937633 10391 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:37.915480  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51754.8us
I20260709 12:23:37.943989  3962 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:37.945791 10472 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:37.946453 10472 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:37.851799 10642 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.861104 10564 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:37.952028 10564 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.922538  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.923628  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:37.919577  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.924901 10606 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:37.928691  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:37.928555 10615 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.958424  3843 raft_consensus.cc:2368] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:37.918320 10639 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:37.966368  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:37.969488  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:37.971230  3998 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:37.978492  3888 leader_election.cc:400] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:37.978904  3888 leader_election.cc:403] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:23:37.979705 10421 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:37.963915 10585 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:37.980968  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.980647  3846 raft_consensus.cc:2368] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:37.980647 10585 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.939142 10386 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:37.993605  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.996004  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.996781  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:37.997720  3990 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:38.003018 10507 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.004120 10391 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.003986 10507 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.013190 10615 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.013592 10585 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:37.996932  3995 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.024667 10421 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.025278 10421 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:37.995092  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:38.028668  3993 raft_consensus.cc:3060] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:38.037284  3992 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.027981  3744 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 12 to 14, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:38.039275  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:38.042503  3998 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:37.987884 10510 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 21. Current term is 22.
I20260709 12:23:37.947543 10472 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.071127  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:38.071236  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:38.077947  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 112231us
I20260709 12:23:38.084713  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:38.085389  3848 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:38.066141 10574 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:38.086599 10471 consensus_meta.cc:287] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.004s
I20260709 12:23:38.096688  3844 raft_consensus.cc:2468] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:38.099197  3888 leader_election.cc:400] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:38.099592  3888 leader_election.cc:403] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:38.102198 10637 consensus_queue.cc:1048] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:38.108986  3922 raft_consensus.cc:2468] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:38.112712 10574 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.123595  4581 raft_consensus.cc:2468] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
I20260709 12:23:38.128363  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:38.129218  3844 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.110908 10533 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.110255 10421 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.128625 10507 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:38.105284 10471 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.144898  3993 raft_consensus.cc:2468] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 15.
I20260709 12:23:38.136686 10621 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:38.145974  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:38.147676  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.144656 10574 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.154950  3841 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:38.135864 10564 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.149559 10567 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.140348 10607 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.157487  4579 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.153746 10421 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:38.153187 10386 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:38.180168  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:38.171125  4548 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:38.172112  3962 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.183660 10606 raft_consensus.cc:2804] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:38.175560  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.176846  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:38.177726  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50446.1us
I20260709 12:23:38.180254  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.184242 10606 raft_consensus.cc:697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:38.180172  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.185843  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.167379 10564 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.187609 10567 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:38.187299 10606 consensus_queue.cc:237] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.189792 10533 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:38.191877  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.192909 10533 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.195644  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:38.196543 10642 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:38.199595 10567 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.209117  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:38.209369 10642 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:38.209856 10642 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:38.210248 10642 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:38.211609 10538 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:38.211755 10446 raft_consensus.cc:2804] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:38.212083 10538 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:38.207754 10567 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.213086 10538 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.214463 10538 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.215761 10446 raft_consensus.cc:697] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:38.216943 10446 consensus_queue.cc:237] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.219676  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.220356  3918 raft_consensus.cc:3060] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.224540  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.225279  3921 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 9.
I20260709 12:23:38.232076  4574 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 13.
I20260709 12:23:38.234311  3918 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:38.234721  3992 raft_consensus.cc:1275] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:23:38.236680  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 141712us
I20260709 12:23:38.244774 10533 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:38.245357  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:38.245942  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50501.2us
I20260709 12:23:38.246249 10386 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:38.237694  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.246825 10386 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.247371 10386 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:38.247936  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 71241.8us
I20260709 12:23:38.248503 10533 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:38.248932 10533 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.249291 10533 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:38.252646  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.252938  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:38.254130 10421 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:38.257718  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:38.259858  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.260243 10585 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:23:38.260703  3992 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:38.260757 10585 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.261324 10585 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:38.261991 10421 consensus_queue.cc:1059] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:38.263746 10456 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:23:38.264216 10456 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:38.265163 10456 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.266650 10456 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:38.267588  3815 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.269126  3847 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:38.269701 10574 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:38.270282 10574 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:38.271349 10574 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:38.273624 10693 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:23:38.278586  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:38.281751  3844 raft_consensus.cc:2468] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:23:38.283948 10471 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.284305  4548 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:38.285173 10501 raft_consensus.cc:2804] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:38.285701 10501 raft_consensus.cc:697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:38.286710 10501 consensus_queue.cc:237] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.287936  3815 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.297168  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:38.302304  4574 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 23: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:38.305219  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:38.300101  3814 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:38.299327  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.312116 10564 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:38.312361 10621 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 14. Current term is 15.
I20260709 12:23:38.235500 10568 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.334913 10567 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.352969  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.316606 10504 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:38.319665 10549 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:38.331125 10637 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:38.344561 10519 consensus_meta.cc:287] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.003s
I20260709 12:23:38.312780 10533 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.312027 10585 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.365726 10549 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:38.396343  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 50162.7us
I20260709 12:23:38.365928 10564 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:38.407260 10696 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:23:38.369946 10637 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.417677 10637 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.420239  3743 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 289) took 10671 ms. Trace:
I20260709 12:23:38.369910 10606 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:38.402354  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:38.435729  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 114452us
W20260709 12:23:38.435932  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96608.4us
I20260709 12:23:38.393528 10607 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.438045  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:38.448438  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51312.8us
I20260709 12:23:38.400903 10549 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:38.426138 10693 log.cc:927] Time spent T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:23:38.451365  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 130522us
I20260709 12:23:38.455633  3964 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.370350 10519 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.462519  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.494184  3992 raft_consensus.cc:2393] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 18: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:38.464473  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:38.470047  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.471570  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:38.471928  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:38.472646 10538 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.474455  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:38.497684  3999 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:38.480444 10533 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.479991 10564 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:38.481798 10699 log.cc:927] Time spent T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:38.481938 10703 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:38.482800  3995 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:38.485409 10563 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:38.397998 10421 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.491683 10472 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:38.493188  3850 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:38.498476  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 44815.1us
I20260709 12:23:38.502475  3997 raft_consensus.cc:2368] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
W20260709 12:23:38.505671  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 68487.2us
I20260709 12:23:38.508484  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.521380  3993 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:38.456564 10504 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:38.528391  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:38.529094  3849 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:38.528855  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:38.530143  3843 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:23:38.533937  3998 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:38.537855  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.541311  3841 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:38.542284  3923 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:38.545396  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.549887  3923 raft_consensus.cc:2393] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 13: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:38.551942  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.552707  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.554100  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.554942  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.550637  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.551363  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.558936  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.559621  3921 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.559866  3844 raft_consensus.cc:1275] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:38.560681  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.563081  3919 raft_consensus.cc:2393] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 11: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:38.564039  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.568691  3916 raft_consensus.cc:2368] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
I20260709 12:23:38.573333  3920 raft_consensus.cc:2368] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:38.513670 10538 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.580777  3923 raft_consensus.cc:2368] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:38.525750 10421 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.590346  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.593209  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.595508 10704 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.596125 10704 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.596557 10538 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:38.598562 10704 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.599308 10708 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 12:23:38.601763 10700 log.cc:927] Time spent T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:38.594206  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.613091  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.613416  3843 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:38.615332  3991 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:38.617439  3921 raft_consensus.cc:2393] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:38.585925 10568 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.625185 10642 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.628572 10710 consensus_queue.cc:1048] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:38.630671 10504 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.631752  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef"
dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40790
I20260709 12:23:38.633304  3925 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.634085  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:38.420893  3743 rpcz_store.cc:276] 0709 12:23:27.748840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.749113 (+   273us) service_pool.cc:224] Handling call
0709 12:23:27.903926 (+154813us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b5400190638. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587b1e43 00007fdc588b004e 00007fdc56d712a4 00007fdc56d71232 00007fdc56d71161 00007fdc56d710dc 00007fdc56d70392 00007fdc50d2e48c 00007fdc50d2d8c6 00007fdc50d2d26f
0709 12:23:38.419937 (+10516011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:34.721952 (+     0us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b1800262720. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:34.722139 (+   187us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:34.722682 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:34.722717 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:34.722735 (+    18us) tablet.cc:662] Decoding operations
0709 12:23:34.724669 (+  1934us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:34.724755 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:34.724783 (+    28us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:23:34.795205 (+ 70422us) tablet.cc:701] Row locks acquired
0709 12:23:34.795226 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:34.795376 (+   150us) write_op.cc:270] Start()
0709 12:23:34.913142 (+117766us) write_op.cc:276] Timestamp: P: 1783599814795329 usec, L: 0
0709 12:23:34.913179 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:23:34.991751 (+ 78572us) log.cc:844] Serialized 11255 byte log entry
0709 12:23:35.442891 (+451140us) op_driver.cc:464] REPLICATION: finished
0709 12:23:35.586070 (+143179us) write_op.cc:301] APPLY: starting
0709 12:23:35.586169 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:35.987357 (+401188us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:35.987395 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:36.451527 (+464132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:36.451908 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 12:23:36.451955 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:36.452498 (+   543us) log.cc:844] Serialized 252 byte log entry
0709 12:23:36.676123 (+223625us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:36.734456 (+ 58333us) write_op.cc:454] Released schema lock
0709 12:23:36.784259 (+ 49803us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:36.862061 (+ 77802us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:36.872329 (+ 10268us) write_op.cc:454] Released schema lock
0709 12:23:36.962378 (+ 90049us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
Metrics: {"mutex_wait_us":31384,"reported_tablets":51,"spinlock_wait_cycles":18305280,"child_traces":[["op",{"apply.queue_time_us":139864,"apply.run_cpu_time_us":78295,"apply.run_wall_time_us":1249217,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125173,"num_ops":29,"prepare.queue_time_us":326923,"prepare.run_cpu_time_us":118023,"prepare.run_wall_time_us":503336,"raft.queue_time_us":144804,"raft.run_cpu_time_us":8636,"raft.run_wall_time_us":151461,"replication_time_us":494560,"spinlock_wait_cycles":56613504,"thread_start_us":810793,"threads_started":5,"wal-append.queue_time_us":442745,"wal-append.run_cpu_time_us":8261,"wal-append.run_wall_time_us":2336693}]]}
I20260709 12:23:38.754292  3924 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
W20260709 12:23:38.759085  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 237880us
I20260709 12:23:38.622174 10549 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.757675  4579 raft_consensus.cc:606] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:38.763757  4579 raft_consensus.cc:630] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Rejecting request to transfer leadership because tablet server 32d706e2535f4fa19a09382d4edac677 is not a voter in the active config
W20260709 12:23:38.765213  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 171795us
W20260709 12:23:38.774075 10456 consensus_meta.cc:287] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
I20260709 12:23:38.763144 10639 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:38.789887 10386 consensus_meta.cc:287] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.003s
I20260709 12:23:38.823648 10492 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:38.824385 10492 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.807930 10705 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:38.827913 10705 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:38.830977  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 50743.2us
I20260709 12:23:38.827206 10642 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:38.826740 10492 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.840096  3999 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 15.
I20260709 12:23:38.842156  3847 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:38.855954 10549 leader_election.cc:290] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.816473 10386 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.862381  3964 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.873760 10386 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:38.874318 10519 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.874869 10639 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:23:38.874656  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:38.878095 10703 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.878607 10703 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.879772  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.881176 10721 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.882153 10721 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:23:38.892975  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 130442us
I20260709 12:23:38.898178  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:38.901233  3848 raft_consensus.cc:2368] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 17. Current term is 18.
I20260709 12:23:38.906147  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.908803 10706 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:38.909580 10706 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:38.912091 10706 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:38.918283  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:38.918581 10725 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:38.919303  4579 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 11.
I20260709 12:23:38.920315  3964 leader_election.cc:400] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:38.920683  3964 leader_election.cc:403] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:23:38.921636 10642 raft_consensus.cc:3060] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:38.926702  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:38.927634 10725 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.930907  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:38.932360 10456 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:38.935941  3814 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.936937 10706 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:38.937909 10706 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:38.939122 10706 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:38.943068  3889 leader_election.cc:400] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Vote denied by peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865) with higher term. Message: Invalid argument: T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17.
I20260709 12:23:38.946076  3814 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:38.948585  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.952047  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:38.967945  3848 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.969646  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.956410  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:38.960024  4574 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:23:38.973115  4579 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:23:38.963557 10705 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:38.980252  3918 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:38.949946 10391 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:38.986238 10391 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:38.964598  3890 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:38.986176  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:38.987888  3993 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 17.
I20260709 12:23:38.966681  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:38.988471  3848 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:23:38.988801  3920 raft_consensus.cc:3060] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.985344  3916 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 21.
I20260709 12:23:38.990306  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:38.979481 10642 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 16. Current term is 17.
I20260709 12:23:38.998466  3999 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:23:39.005308  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34156 (request call id 3896) took 1422 ms. Trace:
I20260709 12:23:39.005749  3850 rpcz_store.cc:276] 0709 12:23:37.582686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.583297 (+   611us) service_pool.cc:224] Handling call
0709 12:23:37.626998 (+ 43701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.520706 (+893708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:39.005059 (+484353us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540011b7d4. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529f3e01 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2 00007fdc50d2e48c 00007fdc50d2d8c6
0709 12:23:39.005222 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991544064}
I20260709 12:23:38.993940 10533 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.015363  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.015267 10391 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.018864  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:38.995095 10637 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:39.019804 10637 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.020183 10637 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.023722 10472 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:23:39.024819  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.025498  3918 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:39.026774  3998 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:39.027307  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:39.028020  3990 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:39.011350  3888 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:39.031031 10704 raft_consensus.cc:2804] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:39.033174 10704 raft_consensus.cc:697] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:39.034138  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:39.034317 10704 consensus_queue.cc:237] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.035471  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:39.036104  3997 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:39.015698  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.037271  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:39.037767  3922 raft_consensus.cc:1275] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:23:39.039062  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:39.049599  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:39.011137  3920 raft_consensus.cc:2468] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 10.
I20260709 12:23:39.038511  3994 raft_consensus.cc:1275] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:39.010232  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.056886  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:39.060875  3995 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:39.043601  3888 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:39.145927  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:39.146858  3993 raft_consensus.cc:3060] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:39.148931  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 140232us
W20260709 12:23:39.149617  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 98333.1us
I20260709 12:23:39.151278  4546 leader_election.cc:400] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 17. Current term is 18.
I20260709 12:23:39.151701  4546 leader_election.cc:403] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:39.152247  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 94898.6us
I20260709 12:23:39.061635 10706 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:23:39.056257 10533 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.162892  3997 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:39.077442 10472 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:39.151072 10696 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:39.192767  3815 leader_election.cc:400] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
I20260709 12:23:39.196023  3815 leader_election.cc:403] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.154706 10504 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:39.196857  3993 raft_consensus.cc:2468] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:39.162451 10533 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.200670  3918 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 22.
I20260709 12:23:39.077229 10710 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 12:23:39.205928  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:39.233564 10421 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.200842 10504 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:39.250917 10492 consensus_queue.cc:1048] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:39.225625 10706 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 18. Current term is 19.
W20260709 12:23:39.256146 10733 log.cc:927] Time spent T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.009s
I20260709 12:23:39.203414 10607 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:39.272394  3850 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:23:39.204895 10472 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:39.222483 10708 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:39.227588 10726 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:39.276610  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:39.274396  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:39.279436  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 85886.3us
I20260709 12:23:39.283048  4579 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:39.249405 10504 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:39.287740  3890 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:39.290779  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.292037  3843 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:39.272040 10696 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:39.301102  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 149004us
I20260709 12:23:39.304023  4548 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:39.231164 10703 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.306458  3844 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:39.306888  3844 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:39.308499  3848 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:39.277407 10607 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.307114 10350 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:23:39.282673 10708 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.310572 10507 raft_consensus.cc:2804] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:39.328441 10696 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.346580  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:39.347715 10567 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.348855 10741 consensus_queue.cc:1048] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:39.302615 10725 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:23:39.351814  3849 raft_consensus.cc:2368] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22.
W20260709 12:23:39.353466 10736 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:23:39.354280 10472 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.346789 10717 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:23:39.374071 10637 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.374389 10708 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.374542 10607 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.376680 10725 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:23:39.371152  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 220795us
I20260709 12:23:39.390901  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:39.396327  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 203680us
I20260709 12:23:39.365581 10507 raft_consensus.cc:697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:39.415328  3815 leader_election.cc:400] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:39.417505  3815 leader_election.cc:403] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.419512  3815 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:39.422032 10747 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:39.422588 10747 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.422976 10747 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.423646 10519 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:39.430364  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:39.412482 10621 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:39.413470 10725 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
W20260709 12:23:39.436944  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 135066us
I20260709 12:23:39.419945 10549 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 12. Current term is 13.
I20260709 12:23:39.419613 10708 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:39.444073  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.476511 10533 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.478039  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:39.479506  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.480526  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:39.478157 10708 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.481935  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.482529  4580 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.483361 10708 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.484519  4581 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:23:39.485044  3841 raft_consensus.cc:1275] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:39.486335  3962 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:39.453790 10725 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.453325 10507 consensus_queue.cc:237] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.488286  4577 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:39.488839 10725 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:39.490607 10606 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:39.456405  3848 raft_consensus.cc:1275] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:23:39.462113 10747 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.433099 10564 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:39.441977 10621 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.466367 10519 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:39.466737 10637 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.486250 10642 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:23:39.491864  3924 raft_consensus.cc:2368] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:23:39.497855  4580 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:39.479324 10504 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.472299 10726 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 17. Current term is 18.
W20260709 12:23:39.536103  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 211838us
I20260709 12:23:39.534157  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.534511  3814 leader_election.cc:304] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:39.538995  4580 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.541028  3922 raft_consensus.cc:1240] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:39.449568  3815 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
W20260709 12:23:39.542778  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 93359.5us
I20260709 12:23:39.552099  3919 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:39.558619 10703 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.525367 10718 consensus_queue.cc:1048] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:23:39.561179 10504 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.561918  3923 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:39.551877 10705 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:39.567157 10708 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.585673  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 98146.5us
I20260709 12:23:39.575824 10549 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:39.614283  4580 raft_consensus.cc:2468] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:39.567932 10717 consensus_queue.cc:1048] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:23:39.618937  3962 leader_election.cc:400] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22.
W20260709 12:23:39.622862  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78025.5us
I20260709 12:23:39.590220 10713 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:23:39.562963 10519 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.597326 10705 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:39.625752  3919 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:39.591300 10607 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:39.626844  4579 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 11.
I20260709 12:23:39.638825  3890 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:39.640683  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.643103  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.642911  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:39.625792 10696 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.653628 10696 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.656368 10696 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.622784 10549 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:39.660423 10747 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.660215 10549 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.661569  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:39.662411  4579 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:39.670387 10765 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.664474 10621 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.642983  3815 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:39.596936 10708 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.628803 10533 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.641316 10607 consensus_queue.cc:1243] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer 32d706e2535f4fa19a09382d4edac677 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:23:39.687668  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 214204us
I20260709 12:23:39.645193  4580 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.645587 10572 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:39.646224 10750 raft_consensus.cc:2804] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:39.648358 10744 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.673307  4578 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:39.670979 10765 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:39.688901  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46011us
I20260709 12:23:39.706974  3815 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:39.708372  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:39.710395  3920 raft_consensus.cc:1275] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:39.711930  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40790
I20260709 12:23:39.712538  4579 raft_consensus.cc:606] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:39.701789 10572 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.703366 10744 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.702090 10713 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:39.706875 10606 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:39.716085  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 181680us
I20260709 12:23:39.719627  4580 raft_consensus.cc:2468] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:23:39.710857 10750 raft_consensus.cc:697] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:39.688306 10615 consensus_queue.cc:1048] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:23:39.703719 10504 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:39.728456  3890 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:39.720129 10703 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:39.725337 10549 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:39.713366 10706 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:23:39.747104  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:39.747957  3841 raft_consensus.cc:606] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:39.748350  3841 raft_consensus.cc:614] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:39.735731 10621 raft_consensus.cc:2804] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:39.755123 10744 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.729562 10606 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.766060 10606 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:39.755820 10753 consensus_queue.cc:1059] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:23:39.748127 10766 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:23:39.768935 10766 raft_consensus.cc:3055] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:39.769347 10766 raft_consensus.cc:740] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:39.770349 10766 consensus_queue.cc:260] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.772624 10765 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:39.727874 10705 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.741704 10703 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:39.751160 10549 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:39.789970 10549 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.793490  3919 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:39.794090  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:39.747291 10504 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:23:39.782547 10621 raft_consensus.cc:697] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:39.748553 10713 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:39.827219  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 100243us
I20260709 12:23:39.747138 10750 consensus_queue.cc:237] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.833986  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.834911 10703 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.839314 10708 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.841771 10713 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.843799 10621 consensus_queue.cc:237] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:39.850473 10519 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:39.861224 10391 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:39.861898 10391 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:39.867626 10585 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 22 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:39.876118  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 151774us
I20260709 12:23:39.878196 10391 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:39.888512  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.889966  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.906442  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:39.947643  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.946208  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.952646  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:39.954470 10713 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:23:39.970366  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:39.975795  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:39.976585  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:39.981582  3848 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:39.983011  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:39.998196  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:39.998347  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:40.000644  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.006029  3993 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:40.009361  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:39.997083  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:40.019024  3991 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:40.025669  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.033277  3996 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:40.014495  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.034338  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:40.034832  3992 raft_consensus.cc:2393] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 25: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:40.033372  3997 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:23:40.049017  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59793.3us
I20260709 12:23:40.038177 10745 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:40.063508  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.043136 10572 leader_election.cc:290] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:40.095504  3815 leader_election.cc:400] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 11 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 11. Current term is 12.
I20260709 12:23:40.096647  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:40.100931  3846 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 24.
I20260709 12:23:40.115775  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.116735  3990 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 25.
I20260709 12:23:40.119693  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:40.099884 10750 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.102887 10713 consensus_queue.cc:1059] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:23:40.096351 10774 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:40.130769  3846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:40.135721  3846 raft_consensus.cc:606] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:40.136257  3846 raft_consensus.cc:614] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:40.127903  3990 raft_consensus.cc:1217] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 14.10->[15.11-19.13]   Dedup: 15.11->[17.12-19.13]
I20260709 12:23:40.139065  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.144942  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:40.146257  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.137094  3990 pending_rounds.cc:85] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 11
I20260709 12:23:40.191712  3990 pending_rounds.cc:107] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 18.12
W20260709 12:23:40.191350  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 142814us
I20260709 12:23:40.101099 10745 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:40.246204 10745 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:40.249118  3999 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:40.249259  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.220800  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:40.232110 10778 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:23:40.185387 10549 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:40.145846 10713 consensus_queue.cc:1243] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:23:40.126127 10572 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:23:40.149207 10750 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:40.192119  3990 raft_consensus.cc:2889] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:40.253999  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:40.256857  3991 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 16.
I20260709 12:23:40.277336  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:40.262509  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 49599us
I20260709 12:23:40.186151 10774 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:40.266557  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 82373.6us
I20260709 12:23:40.265318  3964 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.268628  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:40.290233  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:23:40.275753 10785 log.cc:927] Time spent T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:23:40.291744  3922 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 25.
I20260709 12:23:40.307425  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:40.308221 10783 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:40.314540  4577 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:40.315958 10780 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:40.294000 10585 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:40.324463 10750 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:40.332582  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:40.334167  3922 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:23:40.331941  3814 leader_election.cc:304] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:40.330597  3815 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:40.332512  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:40.348021  3814 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:40.359266  3847 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:40.364333  4577 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:40.349318 10519 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:40.370728 10774 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:40.372515 10766 raft_consensus.cc:3060] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.335355 10391 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:40.378153  3848 raft_consensus.cc:1275] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:23:40.357299 10533 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:40.384838  3846 raft_consensus.cc:1240] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:40.386686  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:40.387741  3993 raft_consensus.cc:3055] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:40.387913  3850 raft_consensus.cc:3055] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:40.388207  3993 raft_consensus.cc:740] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:40.389142  3993 consensus_queue.cc:260] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:40.389904  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.391258  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.396948  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.388453  3850 raft_consensus.cc:740] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:40.349630 10704 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:23:40.351284 10780 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:40.400784  3888 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:40.459197  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 58541.9us
I20260709 12:23:40.460273  3888 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:40.438308  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47129.7us
I20260709 12:23:40.391637 10771 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:40.351336 10549 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:23:40.409068  3850 consensus_queue.cc:260] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:40.453553 10782 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.211s	user 0.002s	sys 0.001s
I20260709 12:23:40.434587 10704 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.470602  3888 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.390377 10741 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:23:40.491536  3991 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:40.495262  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:40.500583  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:40.506574  3924 raft_consensus.cc:1240] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:40.468990 10780 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:40.467705 10765 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:40.474391 10456 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:40.468443 10637 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:40.480523 10794 log.cc:927] Time spent T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:23:40.522244  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:40.480795 10704 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:40.479221 10621 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:40.522244  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:40.537451  3995 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:40.525435 10780 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:40.549052 10391 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:23:40.582420  3995 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:40.586452 10777 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:23:40.601193  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 263582us
I20260709 12:23:40.587153 10777 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:40.523313 10798 consensus_queue.cc:1048] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:23:40.564595 10642 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:40.657229 10717 raft_consensus.cc:993] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:40.657945 10717 raft_consensus.cc:1081] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
W20260709 12:23:40.660879 10795 log.cc:927] Time spent T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:23:40.666918  3845 raft_consensus.cc:2410] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:23:40.670838  3842 raft_consensus.cc:1275] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:23:40.671253  3842 pending_rounds.cc:85] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 11
I20260709 12:23:40.672796  3842 pending_rounds.cc:107] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:23:40.673158  3842 raft_consensus.cc:2889] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:40.674698  3815 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.587888 10456 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:40.620746 10798 consensus_queue.cc:1243] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:23:40.681686  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 200602us
I20260709 12:23:40.692505 10766 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:40.672590 10549 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:23:40.647642 10642 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:40.717460  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 202687us
I20260709 12:23:40.698096 10642 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:40.721549  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:23:40.680301 10456 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:40.737537  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 239521us
I20260709 12:23:40.744095  4580 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:40.748994  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.731192 10777 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:40.773252  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 249063us
I20260709 12:23:40.761850 10745 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:40.755553  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.763243 10753 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:23:40.826347  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 70913.1us
I20260709 12:23:40.827196  3888 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.829682  3888 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.830474 10741 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:40.831831  3888 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:40.809579 10780 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:40.824944 10808 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:40.839480 10803 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:23:40.839988 10808 consensus_queue.cc:1048] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:40.832813 10741 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:40.835242 10621 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:40.886369  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 167333us
W20260709 12:23:40.890018  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 115774us
W20260709 12:23:40.895771 10812 log.cc:927] Time spent T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:40.898624  3993 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:40.903059  3842 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:40.912575  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:40.944903 10825 log.cc:927] Time spent T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:40.963497 10456 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:40.911548  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:23:40.986038  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 74627.3us
W20260709 12:23:40.987334  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 55355.1us
I20260709 12:23:40.992841  3850 raft_consensus.cc:3060] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.001257  3993 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 12:23:41.001874  3993 pending_rounds.cc:85] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Aborting all ops after (but not including) 13
I20260709 12:23:41.002162  3993 pending_rounds.cc:107] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 12:23:41.002470  3993 raft_consensus.cc:2889] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.011780 10714 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:23:41.016785 10704 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:40.995280 10621 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:23:41.042483 10621 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:41.042886 10621 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:41.043812 10621 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.044961 10621 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:41.050719  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:41.007393 10615 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 12:23:41.062243  3924 raft_consensus.cc:1275] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:41.064906 10780 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 25 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.064903 10704 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 26 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:41.068960  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 232582us
I20260709 12:23:41.071476  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:41.093703  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.094646  3923 pending_rounds.cc:85] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 10
I20260709 12:23:41.095043  3923 pending_rounds.cc:107] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:23:41.095350  3923 raft_consensus.cc:2889] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.095829 10456 consensus_queue.cc:1059] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:41.097319 10456 raft_consensus.cc:3055] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:41.097715 10456 raft_consensus.cc:740] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:41.098588 10456 consensus_queue.cc:260] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.100176 10456 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.069885 10750 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:41.105324  3850 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:23:41.105813  3850 pending_rounds.cc:85] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Aborting all ops after (but not including) 11
I20260709 12:23:41.106077  3850 pending_rounds.cc:107] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:23:41.106335  3850 raft_consensus.cc:2889] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.075145 10704 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.070420 10714 consensus_queue.cc:1048] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:41.107231 10533 consensus_queue.cc:1048] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:23:41.133277  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.134583  3850 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
W20260709 12:23:41.138873  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 67572.8us
I20260709 12:23:41.141423  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:41.142076  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
W20260709 12:23:41.147034  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 406464us
I20260709 12:23:41.148698  3843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:41.149355  3843 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:41.161579  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:41.162523  3991 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:23:41.165277  3919 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:41.145252 10774 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.175117  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:41.126667 10704 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.175935  3922 raft_consensus.cc:2368] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 25. Current term is 26.
I20260709 12:23:41.182082  4580 raft_consensus.cc:1275] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:41.189218 10726 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.189891 10726 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.195940  3843 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 26.
I20260709 12:23:41.208362  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:41.214179  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:41.216483  3991 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 26.
I20260709 12:23:41.229835 10814 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:41.231894 10773 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:23:41.202054 10564 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:23:41.260767 10829 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.265657 10585 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:41.286643 10845 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.288374  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.230494 10814 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.285542 10829 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:41.278697  3744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 169) took 16494 ms (client timeout 15000 ms). Trace:
I20260709 12:23:41.233132 10726 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:41.312760  3815 leader_election.cc:400] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 25 election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 25. Current term is 26.
I20260709 12:23:41.313190  3815 leader_election.cc:403] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:23:41.315600  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:41.299536  3996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99966b4924ae49f889200899350931bb"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:23:41.290773 10504 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:23:41.351414  3996 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.351887  3996 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:41.360420  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45019.2us
W20260709 12:23:41.294214  3744 rpcz_store.cc:269] 0709 12:23:24.796862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.805612 (+  8750us) service_pool.cc:224] Handling call
0709 12:23:41.278601 (+16472989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:38.474561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:38.475375 (+   814us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:38.475433 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:23:38.475493 (+    60us) tablet.cc:662] Decoding operations
0709 12:23:38.476237 (+   744us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:38.476344 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:38.476375 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:38.476925 (+   550us) tablet.cc:701] Row locks acquired
0709 12:23:38.476994 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:23:38.477214 (+   220us) write_op.cc:270] Start()
0709 12:23:38.477385 (+   171us) write_op.cc:276] Timestamp: P: 1783599818477125 usec, L: 0
0709 12:23:38.477435 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:23:38.478423 (+   988us) log.cc:844] Serialized 1293 byte log entry
0709 12:23:38.858541 (+380118us) op_driver.cc:464] REPLICATION: finished
0709 12:23:38.909229 (+ 50688us) write_op.cc:301] APPLY: starting
0709 12:23:38.909337 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:38.912174 (+  2837us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:38.912287 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:38.915795 (+  3508us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:38.916104 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:23:38.916162 (+    58us) write_op.cc:312] APPLY: finished
0709 12:23:38.916457 (+   295us) log.cc:844] Serialized 41 byte log entry
0709 12:23:38.916649 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.916746 (+    97us) write_op.cc:454] Released schema lock
0709 12:23:38.916808 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:38.917340 (+   532us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.917376 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1220817,"reported_tablets":28,"spinlock_wait_cycles":15104,"child_traces":[["op",{"apply.queue_time_us":50348,"apply.run_cpu_time_us":6548,"apply.run_wall_time_us":8045,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":201599,"prepare.run_cpu_time_us":25465,"prepare.run_wall_time_us":335031,"raft.queue_time_us":79941,"raft.run_cpu_time_us":8437,"raft.run_wall_time_us":62600,"replication_time_us":365439,"thread_start_us":314299,"threads_started":4,"wal-append.queue_time_us":256046,"wal-append.run_cpu_time_us":27054,"wal-append.run_wall_time_us":1210126}]]}
I20260709 12:23:41.361234  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:41.325071 10780 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for earlier term 25. Current term is 26.
I20260709 12:23:41.287492 10845 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.347573 10766 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.405279 10741 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.422780 10766 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.490876  3996 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.500293  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.501087  3924 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 16.
I20260709 12:23:41.445324 10741 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.475908 10568 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.533437  3996 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.534387 10838 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:41.535065 10838 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.536276 10533 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:41.537370 10838 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.538286 10533 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:23:41.538901 10533 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:41.541651 10533 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:41.531999  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 181806us
I20260709 12:23:41.528260 10814 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.555111  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.530293 10567 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:41.555908  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.531805 10704 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:41.547971  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 44390.1us
I20260709 12:23:41.567174  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:41.570528 10741 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.566373 10567 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.575649 10704 consensus_queue.cc:1048] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:41.576177 10846 log.cc:927] Time spent T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:41.578279 10845 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.578886 10839 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:41.579391 10839 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:41.579764 10839 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:41.580313 10750 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:41.580868 10750 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.532456 10568 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.599078  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:41.602988  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:41.613317 10766 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.623405  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:23:41.625152 10456 consensus_meta.cc:287] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260709 12:23:41.626354 10568 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.627244 10848 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:41.627770 10848 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.628141 10848 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.585780 10829 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.644589 10567 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:41.645612  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 54887.1us
W20260709 12:23:41.648083  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44147.7us
I20260709 12:23:41.647110  3888 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:41.652412 10839 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.672575  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.656960 10456 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.679719 10861 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.708474  3734 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 99966b4924ae49f889200899350931bb with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 9 but the committed config has opid_index of 14
I20260709 12:23:41.708374 10861 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:41.709599  3734 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 14
I20260709 12:23:41.656242 10843 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:41.657054  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:41.701802  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44001.6us
I20260709 12:23:41.714504  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.730192 10861 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.733656 10750 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.737809 10750 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.724223 10456 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.746528 10456 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:41.750730  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 389536us
I20260709 12:23:41.786486  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:41.763548 10783 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:41.834412 10783 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.766453 10813 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:41.840755 10813 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.845788  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.849200  3919 raft_consensus.cc:1240] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:41.846529  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.851584  3921 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:41.862192  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.832299 10717 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:41.843271 10813 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:41.864405  3925 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:23:41.867340  3925 pending_rounds.cc:85] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 8
I20260709 12:23:41.867688  3925 pending_rounds.cc:107] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:23:41.867952  3925 raft_consensus.cc:2889] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.850015 10350 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:41.871547  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.882836 10839 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.892390  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:41.896409 10813 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.896605 10642 raft_consensus.cc:493] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:41.897217 10813 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.897413 10642 raft_consensus.cc:515] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.885990 10350 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.903502 10350 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.906172  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:41.912138 10808 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:41.914678 10808 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:41.916157 10843 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:41.870664 10717 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:41.918833  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.919056  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:41.899946 10642 leader_election.cc:290] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.924362  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:41.925122  3844 raft_consensus.cc:2393] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:41.926471  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.923692 10813 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.932045  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:41.933876 10783 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:41.935912 10808 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:41.941598  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.948007  3890 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:41.965052  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:41.960937 10843 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:41.968619 10848 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.005338  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:42.006585  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:41.999199 10717 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.006054  4580 raft_consensus.cc:3055] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:42.142874  4580 raft_consensus.cc:740] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:42.147681  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.150507 10811 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:42.151342 10811 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.152318  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.154168 10811 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:42.155148 10884 log.cc:927] Time spent T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.173s	user 0.004s	sys 0.005s
I20260709 12:23:42.157482  4578 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:42.143868  4580 consensus_queue.cc:260] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.178849  4580 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:42.186084 10843 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:42.186784 10843 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.191951  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.196208  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.199609  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.202831  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.206512  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.207823  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.209924  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.164215 10847 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:42.176744 10507 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:23:42.213681  4547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.180204 10815 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:42.219383 10507 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.220945  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:42.222033 10843 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.222323  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:42.222762 10507 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:42.223207 10874 log.cc:927] Time spent T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 12:23:42.233083 10869 log.cc:927] Time spent T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.468s	user 0.003s	sys 0.003s
I20260709 12:23:42.192878 10811 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:42.234839  4579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35184 (request call id 1116) took 1064 ms. Trace:
I20260709 12:23:42.234910 10811 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.235334  4579 rpcz_store.cc:276] 0709 12:23:41.170338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.170746 (+   408us) service_pool.cc:224] Handling call
0709 12:23:41.171028 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.333532 (+162504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.333580 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.362650 (+ 29070us) log.cc:844] Serialized 26 byte log entry
0709 12:23:41.596160 (+233510us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:41.596203 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.596277 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.098377 (+502100us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b4400022b4c. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc4f78edb1 00007fdc4f82cc85 00007fdc4f82d6a2 00007fdc5259f1db 00007fdc5259aaaf 00007fdc5258e86e 00007fdc5258dbb6 00007fdc5258d7d8 00007fdc52597221 00007fdc525971d9 00007fdc52597169
0709 12:23:42.234452 (+136075us) raft_consensus.cc:1685] finished
0709 12:23:42.234491 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.234743 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13777,"raft.queue_time_us":18813,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3431,"spinlock_wait_cycles":222942592,"thread_start_us":306200,"threads_started":2,"wal-append.queue_time_us":257918}
I20260709 12:23:42.238199 10811 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:42.203395 10823 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:42.240978  3848 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 26 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:23:42.241171  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:42.257814  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.263525  4580 raft_consensus.cc:2468] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:42.268328  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.274703  3999 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:42.274700  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.271631  3815 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:42.274097 10703 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:42.276808 10808 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:42.277029 10703 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.279495 10703 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:42.283161  4546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.284972 10885 log.cc:927] Time spent T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:23:42.285176  3995 raft_consensus.cc:1240] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:42.291205  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.294575 10703 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:42.295205 10703 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.295087 10865 consensus_queue.cc:1059] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:42.295768 10703 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:42.296178 10705 raft_consensus.cc:3055] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:42.303555 10705 raft_consensus.cc:740] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:42.316577  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.324402  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:42.326097  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.239245 10823 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.217399 10847 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.244436 10815 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.342751  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.341074  3995 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:42.342706  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.343183  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.330984 10809 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.344921  3991 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 19.
I20260709 12:23:42.341076  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.343187  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.328689 10848 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:42.361300  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.354987  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.314144 10865 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:42.373463 10703 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.375128  3845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.359494  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722124affb914f0496100070a9582045" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.376247  3993 raft_consensus.cc:2468] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:42.373879 10823 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:42.362092  3815 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:42.390506 10706 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.344235 10705 consensus_queue.cc:260] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.392257 10705 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:42.391160 10706 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:42.408416  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46421.1us
I20260709 12:23:42.408825  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:42.410226  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.409526 10585 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.421553  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.423712  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.414616 10533 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.426554  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.430486  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.431484 10852 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:42.441668  3844 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 17: Already voted for candidate bd47d64594f743eba2922d79251c1c5c in this term.
I20260709 12:23:42.416402 10843 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:42.438746  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.471925 10815 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:42.480245 10847 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.482836  3846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
W20260709 12:23:42.496738  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 66703.7us
I20260709 12:23:42.497807  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.467422 10813 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.524379  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.534456  3964 leader_election.cc:304] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.535611 10790 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:42.561233 10706 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.563867  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.576664 10849 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:42.527071 10843 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.588970  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.580963 10783 raft_consensus.cc:2749] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:42.629294  3814 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:42.634173  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 45336us
I20260709 12:23:42.585307 10843 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.635404 10848 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:42.639794 10829 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:42.641594  3814 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:42.635633  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.634231 10585 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:42.645982 10753 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:42.644464 10865 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
W20260709 12:23:42.703166  3816 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.672940 10854 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:23:42.697861 10456 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:42.701552 10865 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.728390 10843 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.728835 10456 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:42.801052  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 303359us
I20260709 12:23:42.812259  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.821172  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:42.822242  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 328060us
I20260709 12:23:42.828459 10706 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:42.829377 10706 raft_consensus.cc:3055] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:42.829731 10706 raft_consensus.cc:740] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:42.830114 10456 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.834062 10533 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:23:42.837981  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 270230us
I20260709 12:23:42.840337  3964 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:42.844543  3814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 152169us
W20260709 12:23:42.846390  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 334372us
W20260709 12:23:42.851171  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 155742us
I20260709 12:23:42.871227  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.871989  3814 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:42.846122 10533 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:42.884539  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.850090 10456 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:42.887316  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.888144  3925 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
W20260709 12:23:42.892403  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 52163.1us
I20260709 12:23:42.893359  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:42.899864  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.901610  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.903296 10901 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:42.905092 10703 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.905990 10865 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:42.888561 10894 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:42.924271  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.924404  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:42.925107  3964 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:42.925464  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.926129  3920 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:42.927430 10456 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:42.928610 10456 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.931646 10903 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:42.932222 10900 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:42.932857 10900 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.935385 10900 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:42.940627  4580 raft_consensus.cc:1240] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:23:42.946476  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.941047  3815 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:42.953727 10728 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:42.956328  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.954236 10728 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:42.971184  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46157.2us
I20260709 12:23:42.973596  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:42.983918  3815 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:42.985030  3992 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 26 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:23:42.986451  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.987550  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.889112 10533 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:42.988937  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.973481 10728 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:42.990127  3745 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:42.990157  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:42.992537  3994 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 16.
I20260709 12:23:42.991724  3745 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 14 to 18, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 18 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:42.995800 10907 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:23:42.998975 10907 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.999718 10533 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:43.005380  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:42.966925 10585 consensus_queue.cc:1059] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:23:43.011147  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:42.992336 10783 raft_consensus.cc:2804] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:43.015201  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:43.016075  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.027580 10706 consensus_queue.cc:260] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:42.997242 10892 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.060851  3815 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:43.063120  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 47122.2us
I20260709 12:23:43.064661  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.066282  3964 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.070050  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:43.070709  3925 raft_consensus.cc:1813] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Handling vote request from an unknown peer bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.071269  3925 raft_consensus.cc:2410] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:23:43.071808 10783 raft_consensus.cc:697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:43.055989 10637 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:23:43.072842 10783 consensus_queue.cc:237] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:43.076493 10705 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:43.077270 10774 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:43.079039 10774 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:43.079459 10774 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:43.079874 10774 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.094161 10907 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:43.089003 10706 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.110608 10774 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.119267  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:43.120200  4578 raft_consensus.cc:1813] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Handling vote request from an unknown peer bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.120826  4578 raft_consensus.cc:2393] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd47d64594f743eba2922d79251c1c5c in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:43.096356 10823 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:43.134871  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:43.139990  3745 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 14, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.145309  3815 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:43.143070  3745 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.160835  3964 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.150350 10892 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.168157  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:43.168932  3997 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:43.169546  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:43.172549  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.173612 10899 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.174710  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:43.175308  3889 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.175324  3990 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:43.176558 10533 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.177922  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.179032 10533 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:43.164930 10771 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:43.179397 10533 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:43.179877 10533 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.180469  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:43.187022  3990 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 20.
I20260709 12:23:43.187742  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.197891  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.202255 10790 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:43.202740 10900 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:43.204253 10533 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.210861 10774 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:43.223984  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:43.228178  3814 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:43.229409 10865 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:43.229979 10865 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:43.230944 10865 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.234090  3745 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 16 to 19, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.222236 10892 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:43.239111  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.240497 10900 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:43.249140 10728 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.250623  3850 raft_consensus.cc:2368] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:43.256771  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:43.257488  3990 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:43.256992  3745 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 15 to 20, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 20 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.260905  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:43.261618  3924 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:43.265957  3990 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:43.267845  3962 leader_election.cc:400] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:43.268172  3962 leader_election.cc:403] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:23:43.268656  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:43.268579  3814 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:43.280323 10615 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:43.293259  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:43.289989 10706 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:43.295912 10706 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:43.297309 10706 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.314874  3924 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:43.277750 10728 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:43.329007  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:43.334201  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.338410 10849 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.364765 10533 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:43.387379  3850 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:43.399547 10843 consensus_queue.cc:1059] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:43.400532 10843 consensus_queue.cc:1243] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer bd47d64594f743eba2922d79251c1c5c log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:43.401013 10843 raft_consensus.cc:3055] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:43.401338 10843 raft_consensus.cc:740] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:43.402220 10843 consensus_queue.cc:260] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.408087  3992 raft_consensus.cc:1240] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:23:43.430639 10843 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:43.534538  3924 raft_consensus.cc:1240] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:43.546146 10892 consensus_queue.cc:1059] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:43.547500 10892 raft_consensus.cc:3055] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:43.547901 10892 raft_consensus.cc:740] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:43.550971 10892 consensus_queue.cc:260] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.569262  4579 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:23:43.572045 10728 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.581012 10774 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:43.591302 10892 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.580313 10728 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.630259  3916 raft_consensus.cc:3060] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:43.642550  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:43.659179  3916 raft_consensus.cc:1275] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:23:43.663862  3743 catalog_manager.cc:5697] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 17, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 17 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.673157  3743 catalog_manager.cc:5697] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.674921  3743 catalog_manager.cc:5697] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 19 to 22, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 22 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.677470  3743 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 13, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.679575  3743 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 18 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.681401  3743 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.684995  3743 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.686125  3743 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.688066  3743 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 19, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.689711  3743 catalog_manager.cc:5697] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 17, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 17 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.691231  3743 catalog_manager.cc:5697] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 16 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.670240 10771 consensus_queue.cc:1048] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:23:43.694142  3924 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:43.692713  3743 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.695353  3743 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 9 to 14, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.697077  3743 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 22, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 22 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.701802 10865 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:43.711537  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:43.712281  3916 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:43.711897  3743 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 20 to 23, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 23 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.714001  3925 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:23:43.714454  3925 pending_rounds.cc:85] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting all ops after (but not including) 12
I20260709 12:23:43.714907  3925 pending_rounds.cc:107] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:23:43.715190  3925 raft_consensus.cc:2889] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:43.714318  3743 catalog_manager.cc:5697] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.716639  3743 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 21, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 21 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.718305  3743 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 12, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 12 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.719724  3743 catalog_manager.cc:5697] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 15 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.720973 10728 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:43.721218  3743 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 19, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.722716  3743 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:43.724067  3743 catalog_manager.cc:5697] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 16 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.725705  3743 catalog_manager.cc:5697] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 16 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.729094  3743 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 20, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 20 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:43.730163  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:43.738492  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:43.761559 10892 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:43.744036 10728 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:43.763736 10728 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.768194 10728 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:23:43.789951  3745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 270) took 16382 ms (client timeout 15000 ms). Trace:
W20260709 12:23:43.790426  3745 rpcz_store.cc:269] 0709 12:23:27.392827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.393668 (+   841us) service_pool.cc:224] Handling call
0709 12:23:43.775186 (+16381518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:43.365855 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:43.366425 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:43.366460 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:23:43.366489 (+    29us) tablet.cc:662] Decoding operations
0709 12:23:43.367290 (+   801us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:43.367375 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:43.367403 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:43.367967 (+   564us) tablet.cc:701] Row locks acquired
0709 12:23:43.367987 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:23:43.368138 (+   151us) write_op.cc:270] Start()
0709 12:23:43.368263 (+   125us) write_op.cc:276] Timestamp: P: 1783599823368086 usec, L: 0
0709 12:23:43.368287 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:43.368968 (+   681us) log.cc:844] Serialized 2450 byte log entry
0709 12:23:43.512679 (+143711us) op_driver.cc:464] REPLICATION: finished
0709 12:23:43.563052 (+ 50373us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b180032c740. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc4f9063f3 00007fdc4f9087c1 00007fdc4f908779 00007fdc4f908709 00007fdc4f9086d1 00007fdc4f9079cd 0000000000388634 0000000000388479 00007fdc4f8e983a
0709 12:23:43.563189 (+   137us) write_op.cc:301] APPLY: starting
0709 12:23:43.563278 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:43.567144 (+  3866us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:43.567166 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:43.580002 (+ 12836us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:43.581272 (+  1270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:23:43.581322 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:43.581569 (+   247us) log.cc:844] Serialized 65 byte log entry
0709 12:23:43.582380 (+   811us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:43.582498 (+   118us) write_op.cc:454] Released schema lock
0709 12:23:43.582542 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:43.619761 (+ 37219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:43.620705 (+   944us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":32969,"apply.run_cpu_time_us":9304,"apply.run_wall_time_us":33483,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":52435,"prepare.run_cpu_time_us":10052,"prepare.run_wall_time_us":76927,"raft.queue_time_us":31499,"raft.run_cpu_time_us":17435,"raft.run_wall_time_us":19532,"replication_time_us":144197,"spinlock_wait_cycles":34994432,"thread_start_us":115041,"threads_started":4,"wal-append.queue_time_us":102823}]]}
W20260709 12:23:43.860373  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 117545us
I20260709 12:23:43.874210 10728 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:43.886826  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:43.884898 10728 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:43.933979  3997 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:23:43.937994 10829 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:43.943989 10501 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.944557 10501 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:43.946784 10501 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:43.947556  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:43.948520  3844 raft_consensus.cc:2410] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:23:43.950662  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:43.957278  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:43.957784  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:43.959702 10501 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:43.959501  3924 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:44.001438  3924 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:44.011317  3815 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.012482 10865 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:44.013006 10865 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:44.014034 10865 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.022161  3992 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:44.028442 10829 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:44.051239  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:44.055526  3844 raft_consensus.cc:606] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
W20260709 12:23:44.070495 10934 log.cc:927] Time spent T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
I20260709 12:23:44.075784  3918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:45278
I20260709 12:23:44.076552  3918 raft_consensus.cc:606] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.082006  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a268ae9485472a8208827344502203"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:44.082762  3847 raft_consensus.cc:606] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.083158  3847 raft_consensus.cc:614] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:44.094832 10533 raft_consensus.cc:993] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:44.095325 10533 raft_consensus.cc:1081] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:44.097283  3990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52870
I20260709 12:23:44.097852  3990 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.098184  3990 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:44.116035 10783 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:44.116762 10783 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.119730  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:44.111743  3847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:44.122934  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:44.123119  3847 raft_consensus.cc:606] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.123845  3918 raft_consensus.cc:2368] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.124064  3847 raft_consensus.cc:614] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:44.125150  3964 leader_election.cc:400] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.125430  3964 leader_election.cc:403] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.126037 10615 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:44.123636 10783 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:44.128137  3990 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.142565  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:44.143292  3847 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:44.143426  3844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:44.144191  3844 raft_consensus.cc:606] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.144570  3844 raft_consensus.cc:614] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:44.155128  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:44.156980 10615 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799) with higher term. Message: Invalid argument: T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.158919  3847 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 27.
I20260709 12:23:44.157151  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:44.160713  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:44.160539  3962 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:44.165334 10783 raft_consensus.cc:2804] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:23:44.167102 10783 raft_consensus.cc:697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 27 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:44.168098 10783 consensus_queue.cc:237] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.175562  3990 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 27 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:44.178818  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:44.179595  3918 raft_consensus.cc:3055] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:23:44.179952  3918 raft_consensus.cc:740] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:44.180616  3918 consensus_queue.cc:260] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.181488  3918 raft_consensus.cc:3060] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:23:44.193841 10913 raft_consensus.cc:993] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:44.194460 10829 raft_consensus.cc:1081] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:44.196931  3990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:23:44.197506  3990 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:44.197872  3990 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.232483  3918 raft_consensus.cc:2468] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 27.
I20260709 12:23:44.243000  3990 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.256479  3990 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:44.258658  3844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:44.259359  3844 raft_consensus.cc:3055] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:44.259696  3844 raft_consensus.cc:740] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:44.260461  3844 consensus_queue.cc:260] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.261868  3844 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.264043  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 99966b4924ae49f889200899350931bb with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:34144
I20260709 12:23:44.268004  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:44.268728  3918 raft_consensus.cc:3060] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:44.268972  3747 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.287297 10939 tablet_replica.cc:333] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:44.288555 10939 raft_consensus.cc:2243] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.289279 10939 raft_consensus.cc:2272] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.299906  3743 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57314 (request call id 290) took 3823 ms. Trace:
I20260709 12:23:44.300361  3743 rpcz_store.cc:276] 0709 12:23:40.476706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.481766 (+  5060us) service_pool.cc:224] Handling call
0709 12:23:44.299815 (+3818049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:43.827754 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:43.828386 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:43.828560 (+   174us) write_op.cc:435] Acquired schema lock
0709 12:23:43.828595 (+    35us) tablet.cc:662] Decoding operations
0709 12:23:43.830524 (+  1929us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:43.830585 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:43.830622 (+    37us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:23:43.846845 (+ 16223us) tablet.cc:701] Row locks acquired
0709 12:23:43.847150 (+   305us) write_op.cc:260] PREPARE: finished
0709 12:23:43.847364 (+   214us) write_op.cc:270] Start()
0709 12:23:43.849644 (+  2280us) write_op.cc:276] Timestamp: P: 1783599823847308 usec, L: 0
0709 12:23:43.849670 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:23:43.883662 (+ 33992us) log.cc:844] Serialized 9407 byte log entry
0709 12:23:43.937010 (+ 53348us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18000aac80. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc587ceab1 00007fdc587db281 00007fdc5642a41d 00007fdc5642c71a 00007fdc5642c6a8 00007fdc5642c628 00007fdc5642c5e3 00007fdc5642b7fc 00007fdc5885e2f6 00007fdc58858aa8 00007fdc529ff310
0709 12:23:43.937079 (+    69us) op_driver.cc:464] REPLICATION: finished
0709 12:23:43.939294 (+  2215us) write_op.cc:301] APPLY: starting
0709 12:23:43.939388 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:44.051184 (+111796us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:44.051234 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.194775 (+143541us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.196055 (+  1280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:23:44.199086 (+  3031us) write_op.cc:312] APPLY: finished
0709 12:23:44.199546 (+   460us) log.cc:844] Serialized 212 byte log entry
0709 12:23:44.199969 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.200182 (+   213us) write_op.cc:454] Released schema lock
0709 12:23:44.200250 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:44.200733 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.200769 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":433265,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":1913,"apply.run_cpu_time_us":32737,"apply.run_wall_time_us":261323,"cfile_cache_hit":96,"cfile_cache_hit_bytes":100176,"num_ops":24,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":7313,"prepare.run_wall_time_us":61414,"replication_time_us":41924,"spinlock_wait_cycles":35691264}]]}
I20260709 12:23:44.304620  3844 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:44.312862  3962 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:44.313987 10783 raft_consensus.cc:2804] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:44.314541 10783 raft_consensus.cc:697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:44.315733 10783 consensus_queue.cc:237] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.317593 10939 ts_tablet_manager.cc:1916] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.323868  3918 raft_consensus.cc:2468] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:44.473580 10533 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:44.474212 10533 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:44.477632 10533 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:44.479207  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:44.479924  3847 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:44.493620  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:44.494635 10939 ts_tablet_manager.cc:1929] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.13
I20260709 12:23:44.494740 10533 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:44.495370 10533 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:44.496546 10533 raft_consensus.cc:3060] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:44.480355  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:44.502156  4579 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 17: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:44.495327 10939 log.cc:1199] T 99966b4924ae49f889200899350931bb P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/99966b4924ae49f889200899350931bb
I20260709 12:23:44.513064  3916 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:44.516431 10829 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:44.530139 10533 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:44.537483  3847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:44.520699  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 99966b4924ae49f889200899350931bb (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:44.553115 10533 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:44.554479  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:44.555351  4579 raft_consensus.cc:2393] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 17: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:44.563422  3847 raft_consensus.cc:2468] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:44.566118  3888 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5
W20260709 12:23:44.568267  3747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 266) took 26638 ms (client timeout 15000 ms). Trace:
I20260709 12:23:44.569775 10533 raft_consensus.cc:2804] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:44.568017  3748 catalog_manager.cc:5697] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 11 to 14, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 17 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:44.581907  3748 catalog_manager.cc:5697] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 16, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 16 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:44.588949  3748 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.595114  3748 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:44.599506  3748 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.610248  3992 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:44.568769  3747 rpcz_store.cc:269] 0709 12:23:17.926600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.926892 (+   292us) service_pool.cc:224] Handling call
0709 12:23:44.565231 (+26638339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:44.362836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:44.363651 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:44.363691 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:23:44.363721 (+    30us) tablet.cc:662] Decoding operations
0709 12:23:44.364146 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:44.364206 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:44.364236 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:44.364450 (+   214us) tablet.cc:701] Row locks acquired
0709 12:23:44.364468 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:44.364622 (+   154us) write_op.cc:270] Start()
0709 12:23:44.364742 (+   120us) write_op.cc:276] Timestamp: P: 1783599824364572 usec, L: 0
0709 12:23:44.364767 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:23:44.365443 (+   676us) log.cc:844] Serialized 538 byte log entry
0709 12:23:44.367953 (+  2510us) op_driver.cc:464] REPLICATION: finished
0709 12:23:44.368435 (+   482us) write_op.cc:301] APPLY: starting
0709 12:23:44.368520 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:44.369380 (+   860us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:44.369472 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.370179 (+   707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.370339 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:23:44.370382 (+    43us) write_op.cc:312] APPLY: finished
0709 12:23:44.370567 (+   185us) log.cc:844] Serialized 25 byte log entry
0709 12:23:44.370731 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.370817 (+    86us) write_op.cc:454] Released schema lock
0709 12:23:44.370861 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:44.371226 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.371260 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17300,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":267,"apply.run_cpu_time_us":2754,"apply.run_wall_time_us":2754,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2959,"prepare.run_wall_time_us":4877,"replication_time_us":3043}]]}
I20260709 12:23:44.632422 10929 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:44.646402 10533 raft_consensus.cc:697] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:44.663920 10533 consensus_queue.cc:237] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:44.681761  3847 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 27 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:23:44.692371 10774 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:44.702607  3918 raft_consensus.cc:1275] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:23:44.708822 10774 consensus_queue.cc:1048] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:44.730047  3744 catalog_manager.cc:5697] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.733623  3744 catalog_manager.cc:5697] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 11 to 13, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 13 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.752319  3744 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 16 to 18, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:44.756426  3744 catalog_manager.cc:5697] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 8 to 10, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 10 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.830551  3847 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:44.832193 10774 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:44.841647  3748 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57298 (request call id 267) took 6225 ms. Trace:
I20260709 12:23:44.851163 10585 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.851821 10585 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.856876 10585 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:44.857900  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:44.858249  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:44.858856  3918 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 17.
I20260709 12:23:44.862062  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:44.863754 10585 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:44.864372 10585 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.864816 10585 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:44.842244  3748 rpcz_store.cc:276] 0709 12:23:38.680017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.777312 (+ 97295us) service_pool.cc:224] Handling call
0709 12:23:44.698371 (+5921059us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.698407 (+    36us) write_op.cc:454] Released schema lock
0709 12:23:44.841545 (+143138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:44.671799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:44.672470 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:44.672510 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:23:44.672532 (+    22us) tablet.cc:662] Decoding operations
0709 12:23:44.673380 (+   848us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:44.673443 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:44.673491 (+    48us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:44.674080 (+   589us) tablet.cc:701] Row locks acquired
0709 12:23:44.674104 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:23:44.674286 (+   182us) write_op.cc:270] Start()
0709 12:23:44.674410 (+   124us) write_op.cc:276] Timestamp: P: 1783599824674238 usec, L: 0
0709 12:23:44.674433 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:23:44.675114 (+   681us) log.cc:844] Serialized 2060 byte log entry
0709 12:23:44.679591 (+  4477us) op_driver.cc:464] REPLICATION: finished
0709 12:23:44.682283 (+  2692us) write_op.cc:301] APPLY: starting
0709 12:23:44.682386 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:44.687902 (+  5516us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:44.688023 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.691256 (+  3233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.696415 (+  5159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:23:44.696475 (+    60us) write_op.cc:312] APPLY: finished
0709 12:23:44.696743 (+   268us) log.cc:844] Serialized 57 byte log entry
0709 12:23:44.697669 (+   926us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.697792 (+   123us) write_op.cc:454] Released schema lock
0709 12:23:44.697868 (+    76us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":676996,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":2422,"apply.run_cpu_time_us":8207,"apply.run_wall_time_us":15929,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":696,"prepare.run_cpu_time_us":3646,"prepare.run_wall_time_us":11869,"replication_time_us":4963}]]}
I20260709 12:23:44.875319  3743 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 17, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 17 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.877075  3743 catalog_manager.cc:5697] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 16, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 16 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.879691  3743 catalog_manager.cc:5697] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.881254  3743 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.882596  3743 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 21 to 22, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 22 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.948922  3744 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47674 (request call id 170) took 3276 ms. Trace:
I20260709 12:23:44.951212  4579 consensus_queue.cc:237] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:44.936046  3743 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.953496  3743 catalog_manager.cc:5697] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 17 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.959758 10815 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:44.960417 10815 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.962689 10815 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:44.963115 10585 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:44.954953  3743 catalog_manager.cc:5697] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 16, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 16 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.966430  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bd47d64594f743eba2922d79251c1c5c" is_pre_election: true
I20260709 12:23:44.966773  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:44.967209  3841 raft_consensus.cc:2368] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.967363  3924 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:44.967393 10585 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:44.968724  3962 leader_election.cc:400] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.969053  3962 leader_election.cc:403] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.966814  3743 catalog_manager.cc:5697] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 24 to 27, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 27 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.970435  3743 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.971803  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:44.974334 10815 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:44.949365  3744 rpcz_store.cc:276] 0709 12:23:41.672169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.672311 (+   142us) service_pool.cc:224] Handling call
0709 12:23:44.948849 (+3276538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:44.806401 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:44.807054 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:44.807102 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:23:44.807128 (+    26us) tablet.cc:662] Decoding operations
0709 12:23:44.807859 (+   731us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:44.807930 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:44.807970 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:44.808459 (+   489us) tablet.cc:701] Row locks acquired
0709 12:23:44.808483 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:23:44.808662 (+   179us) write_op.cc:270] Start()
0709 12:23:44.808796 (+   134us) write_op.cc:276] Timestamp: P: 1783599824808612 usec, L: 0
0709 12:23:44.808822 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:23:44.816006 (+  7184us) log.cc:844] Serialized 1674 byte log entry
0709 12:23:44.821547 (+  5541us) op_driver.cc:464] REPLICATION: finished
0709 12:23:44.822063 (+   516us) write_op.cc:301] APPLY: starting
0709 12:23:44.822158 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:44.824903 (+  2745us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:44.825031 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:44.828208 (+  3177us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b54003d4854. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc5295c571 00007fdc529eee28 00007fdc56429581 00007fdc56428d58 00007fdc5642d9f1 00007fdc5642d9a9 00007fdc5642d939 00007fdc5642d901 00007fdc5642cb2d 0000000000388634 0000000000388479
0709 12:23:44.829267 (+  1059us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:44.829507 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:23:44.829568 (+    61us) write_op.cc:312] APPLY: finished
0709 12:23:44.831263 (+  1695us) log.cc:844] Serialized 49 byte log entry
0709 12:23:44.831508 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.831620 (+   112us) write_op.cc:454] Released schema lock
0709 12:23:44.831662 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:44.834208 (+  2546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:44.834238 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49569,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":284,"apply.run_cpu_time_us":7622,"apply.run_wall_time_us":12098,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":6015,"prepare.run_wall_time_us":22015,"replication_time_us":12571,"spinlock_wait_cycles":14558464}]]}
I20260709 12:23:44.985420 10815 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307) with higher term. Message: Invalid argument: T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 17. Current term is 18.
I20260709 12:23:44.979723  3743 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 20, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 20 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:44.918957  3918 raft_consensus.cc:1275] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:45.003908  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:45.027120  3996 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:45.048332  3841 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:45.050045 10533 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:45.031780  3924 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 18.
I20260709 12:23:45.054236  3815 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:45.055374 10585 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:45.055951 10585 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:45.056846 10585 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:45.075662  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 43805.5us
I20260709 12:23:45.077279  3918 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:45.083135 10930 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:45.117092  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:33622
I20260709 12:23:45.127712 10815 consensus_queue.cc:1048] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:45.144027 10930 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 10 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:45.152184 10956 tablet_replica.cc:333] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:23:45.157326  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfad3fb2927f45958c4a0cf0768a8b53 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:45.192435 10956 raft_consensus.cc:2243] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:45.193773 10956 raft_consensus.cc:2272] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:45.198822 10956 ts_tablet_manager.cc:1916] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:45.222856  3997 raft_consensus.cc:1275] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:23:45.241925  3918 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 10 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:45.245422  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 90963.1us
I20260709 12:23:45.257731  4579 raft_consensus.cc:1275] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:45.280480 10942 consensus_queue.cc:1048] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:45.289548  3746 catalog_manager.cc:5697] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 12 to 14, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 14 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:45.309708 10958 consensus_queue.cc:1048] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:45.379103  3996 raft_consensus.cc:2955] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 10 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:45.382190  3746 catalog_manager.cc:5697] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 10 to 12, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 12 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:45.385203 10961 log.cc:927] Time spent T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:45.400118 10956 ts_tablet_manager.cc:1929] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:23:45.400718 10956 log.cc:1199] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/2bf551f0b2a843aa8a6b0ebdf7ba8fef
I20260709 12:23:45.402661  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet 2bf551f0b2a843aa8a6b0ebdf7ba8fef (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:45.468607  3744 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 18, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:45.502388  3996 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:45.505038 10829 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:45.505533  3747 catalog_manager.cc:5697] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 10 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 20 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:45.513720  3748 catalog_manager.cc:5697] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.544448  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet dfad3fb2927f45958c4a0cf0768a8b53 with delete_type TABLET_DATA_TOMBSTONED (TS bd47d64594f743eba2922d79251c1c5c not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:34144
I20260709 12:23:45.551474  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.572230  3918 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:23:45.579339 10585 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:45.599138 10965 tablet_replica.cc:333] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:45.600526 10965 raft_consensus.cc:2243] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:45.603282 10965 raft_consensus.cc:2272] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:45.615293  3832 tablet_service.cc:1558] Processing DeleteTablet for tablet 99966b4924ae49f889200899350931bb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 9 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:34144
I20260709 12:23:45.620849  3746 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57290 (request call id 271) took 2080 ms. Trace:
I20260709 12:23:45.630806 10965 ts_tablet_manager.cc:1916] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:45.664595  3743 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } }
I20260709 12:23:45.650247  3746 rpcz_store.cc:276] 0709 12:23:43.540706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.540949 (+   243us) service_pool.cc:224] Handling call
0709 12:23:45.620757 (+2079808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:45.448248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:45.448812 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:45.448851 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:23:45.448864 (+    13us) tablet.cc:662] Decoding operations
0709 12:23:45.449310 (+   446us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:45.449362 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:45.449393 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:45.449738 (+   345us) tablet.cc:701] Row locks acquired
0709 12:23:45.449753 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:23:45.449910 (+   157us) write_op.cc:270] Start()
0709 12:23:45.450042 (+   132us) write_op.cc:276] Timestamp: P: 1783599825449861 usec, L: 0
0709 12:23:45.450063 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:45.450734 (+   671us) log.cc:844] Serialized 913 byte log entry
0709 12:23:45.452850 (+  2116us) op_driver.cc:464] REPLICATION: finished
0709 12:23:45.453705 (+   855us) write_op.cc:301] APPLY: starting
0709 12:23:45.453806 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:45.455297 (+  1491us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:45.455419 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:45.456911 (+  1492us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:45.457088 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:23:45.457147 (+    59us) write_op.cc:312] APPLY: finished
0709 12:23:45.457389 (+   242us) log.cc:844] Serialized 33 byte log entry
0709 12:23:45.459007 (+  1618us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:45.459113 (+   106us) write_op.cc:454] Released schema lock
0709 12:23:45.459162 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:45.459583 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:45.459614 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38883,"reported_tablets":51,"spinlock_wait_cycles":29312,"child_traces":[["op",{"apply.queue_time_us":548,"apply.run_cpu_time_us":4466,"apply.run_wall_time_us":5845,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":2807,"prepare.run_wall_time_us":2807,"replication_time_us":2661,"spinlock_wait_cycles":81792}]]}
I20260709 12:23:45.710661 10965 ts_tablet_manager.cc:1929] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 12:23:45.711331 10965 log.cc:1199] T dfad3fb2927f45958c4a0cf0768a8b53 P bd47d64594f743eba2922d79251c1c5c: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/wals/dfad3fb2927f45958c4a0cf0768a8b53
I20260709 12:23:45.727397  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:45.728102  3996 raft_consensus.cc:606] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:45.732676  3996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:45.733340  3996 raft_consensus.cc:606] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:45.737892  3841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:45.738667  3841 raft_consensus.cc:606] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:45.740885  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet dfad3fb2927f45958c4a0cf0768a8b53 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:45.742266  3990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:45.742961  3990 raft_consensus.cc:606] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:45.744658  3732 catalog_manager.cc:5028] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): tablet 99966b4924ae49f889200899350931bb (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:45.752590  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:45.756579  3850 raft_consensus.cc:606] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:45.759388  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:45.761703  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:45.762639  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.824425 10913 raft_consensus.cc:993] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:45.824985 10913 raft_consensus.cc:1081] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:45.840799  3990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:23:45.841532  3990 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:45.841971  3990 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:45.861670  3990 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:45.884235  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:45.884948  3850 raft_consensus.cc:3055] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:45.885260  3850 raft_consensus.cc:740] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:45.886080  3850 consensus_queue.cc:260] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:45.887384  3850 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:45.888857  3990 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:45.893288  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:45.894026  4578 raft_consensus.cc:3060] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:45.895237  3850 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:45.896592  3962 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:45.899293 10815 raft_consensus.cc:2804] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:45.899830 10815 raft_consensus.cc:697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:45.900693 10815 consensus_queue.cc:237] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:45.908301  4578 raft_consensus.cc:2468] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:45.965039 10815 raft_consensus.cc:993] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:45.965674 10815 raft_consensus.cc:1081] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:45.970232  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:23:45.971036  3924 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:45.971503  3924 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:45.953759  3746 catalog_manager.cc:5697] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 16 to 17, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 17 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.998178  3924 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.000737  3924 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:46.002238  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:46.002979  3841 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.011421  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:46.012245  3996 raft_consensus.cc:3055] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:46.012593  3996 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:46.013298 10771 raft_consensus.cc:993] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.013921 10771 raft_consensus.cc:1081] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.013468  3996 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.015976  3996 raft_consensus.cc:3060] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:46.017107  3918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:23:46.017786  3918 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.018183  3918 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:46.025017  3996 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:46.027237  3918 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.040863  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:46.041529  3850 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:46.048131  3918 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:46.050171  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:46.050810  3990 raft_consensus.cc:3055] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:23:46.051184  3990 raft_consensus.cc:740] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:46.052001  3990 consensus_queue.cc:260] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.055994  3990 raft_consensus.cc:3060] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:46.062098  3850 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:46.067117  3889 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:46.067524  3888 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:46.068866 10900 raft_consensus.cc:2804] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:46.036921  3841 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:46.069384 10900 raft_consensus.cc:697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:46.070389 10900 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.071651 10942 raft_consensus.cc:2804] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:46.072259 10942 raft_consensus.cc:697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:46.073223 10942 consensus_queue.cc:237] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.100953 10585 raft_consensus.cc:993] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.101470 10585 raft_consensus.cc:1081] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.107268  3990 raft_consensus.cc:2468] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:46.106032  3918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:23:46.113287  3918 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.113816  3918 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:46.116945  3746 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 18 to 19, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.119904  3746 catalog_manager.cc:5697] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 17 to 18, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 18 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.138420  3918 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.163741  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:46.164494  3850 raft_consensus.cc:3055] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:23:46.164793  3850 raft_consensus.cc:740] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:46.163517  3918 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:46.165567  3850 consensus_queue.cc:260] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.168118  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:46.169056  3992 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:46.167145  3850 raft_consensus.cc:3060] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:23:46.193519  3992 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 22.
I20260709 12:23:46.194356  3999 raft_consensus.cc:1240] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Rejecting Update request from peer bd47d64594f743eba2922d79251c1c5c for earlier term 21. Current term is 22. Ops: []
I20260709 12:23:46.195367  3850 raft_consensus.cc:2468] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 22.
I20260709 12:23:46.196450  3889 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:46.198381 10942 raft_consensus.cc:2804] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:23:46.198935 10942 raft_consensus.cc:697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:46.201457 10942 consensus_queue.cc:237] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.212095 10815 raft_consensus.cc:993] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.212610 10815 raft_consensus.cc:1081] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:46.217283  3918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40568
I20260709 12:23:46.218043  3918 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.218483  3918 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:46.225171  3746 catalog_manager.cc:5697] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 21 to 22, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 22 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.229751  3918 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.234647  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:46.235289  3841 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:46.245131  3841 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 23.
I20260709 12:23:46.246510  3888 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:46.247655 10900 raft_consensus.cc:2804] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:46.248286 10900 raft_consensus.cc:697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:46.249471 10900 consensus_queue.cc:237] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.275687  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:46.276470  3999 raft_consensus.cc:3055] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:23:46.276813  3999 raft_consensus.cc:740] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:46.277705  3999 consensus_queue.cc:260] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:46.279109  3999 raft_consensus.cc:3060] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:46.275631  3918 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:46.287113  3746 catalog_manager.cc:5697] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 22 to 23, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 23 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.290711  4579 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:46.292685 10815 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:46.328912  3999 raft_consensus.cc:2468] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 23.
I20260709 12:23:46.443159  3844 raft_consensus.cc:1275] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:23:46.444885 10771 consensus_queue.cc:1048] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:46.510812  3841 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:46.514053 10900 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:46.534307  3850 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:46.536026 10942 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:46.563735  3999 raft_consensus.cc:1275] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:23:46.568704 10969 consensus_queue.cc:1048] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:46.625821  3999 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:23:46.638281 10970 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:46.655818  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 57299.1us
I20260709 12:23:46.812271  3999 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:23:46.813706  3997 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:23:46.841630 10900 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:46.845395 10900 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:46.858799  3844 raft_consensus.cc:1275] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:23:46.869194 10900 consensus_queue.cc:1048] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:46.876340  3847 raft_consensus.cc:1275] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:23:46.879643 10970 consensus_queue.cc:1048] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:23:46.900084  3796 auto_rebalancer.cc:629] Failed to schedule move for tablet ce77a1e41f7b43cc965d6fd6976759cd: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:46.961222  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.055708  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:47.056423  3999 raft_consensus.cc:606] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:47.058243  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:47.060258  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.061110  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.065219  3850 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:47.149983  3999 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:47.152962 10992 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:47.153789  3918 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:23:47.174263  3815 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c68343b8d5be4269b4b588c1b34d01e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.187728 10991 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:47.265349 10992 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.275213  3918 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.296030  3996 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.310966  3746 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 12, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.342024  3918 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:47.345842 10979 raft_consensus.cc:993] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:23:47.348852 10979 raft_consensus.cc:1081] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:23:47.371794  3850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:23:47.372891  3850 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.381706  3850 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:23:47.460083  3890 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9a206840e1648aeb4571019fa4ca639. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.462941  3999 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:47.465392  3847 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:47.467497 10900 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:47.469786 10970 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:47.528635  3850 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:47.552858  3850 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 24 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:47.552568 10988 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.555290  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:47.556022  3999 raft_consensus.cc:3055] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:23:47.556350  3999 raft_consensus.cc:740] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:47.555572  3996 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.557193  3999 consensus_queue.cc:260] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:47.560411  3999 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:47.571183  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:47.571624  3999 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 24.
I20260709 12:23:47.571938  4579 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:47.574229  3814 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:47.575915 10913 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:47.576452 10913 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 24 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:47.577396 10913 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:47.628379 11014 ts_tablet_manager.cc:933] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:23:47.629091  3850 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.649891 11014 tablet_copy_client.cc:323] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:23:47.652441  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet c68343b8d5be4269b4b588c1b34d01e0 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:23:47.653091  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet c68343b8d5be4269b4b588c1b34d01e0 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-c68343b8d5be4269b4b588c1b34d01e0
I20260709 12:23:47.679397  4579 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 24.
I20260709 12:23:47.683861  3743 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:47.697599  3860 tablet_copy_source_session.cc:215] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:47.703022 11014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68343b8d5be4269b4b588c1b34d01e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:47.714654  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 69232.9us
W20260709 12:23:47.729231  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 133004us
I20260709 12:23:47.748224 11014 tablet_copy_client.cc:806] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:47.749059 11014 tablet_copy_client.cc:670] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:47.951673  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 92089.7us
I20260709 12:23:48.001156  3850 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:23:48.066812  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 156864us
I20260709 12:23:48.106796 11014 tablet_copy_client.cc:538] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:48.121384  3996 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:23:48.119284  3815 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7012fd3393d4b19bd0d25e82fc612df. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.130704  3916 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:48.135658  3743 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 23 to 24, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 24 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:48.146175  3999 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:48.150871  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.157119 11022 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:48.180274 11022 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:23:48.215160 11014 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:23:48.218060 11030 ts_tablet_manager.cc:933] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:48.199260 10992 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 12:23:48.253437  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45606.8us
I20260709 12:23:48.303483  4581 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:23:48.309478 10992 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 12:23:48.316287 11030 tablet_copy_client.cc:323] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:23:48.328188  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet f9a206840e1648aeb4571019fa4ca639 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:23:48.328998  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet f9a206840e1648aeb4571019fa4ca639 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-f9a206840e1648aeb4571019fa4ca639
I20260709 12:23:48.351015 10929 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:48.360988  3925 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:48.385895  3934 tablet_copy_source_session.cc:215] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:48.438634 11030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a206840e1648aeb4571019fa4ca639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.442602  3748 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:23:48.560168 11034 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:48.562458 11042 ts_tablet_manager.cc:933] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307)
I20260709 12:23:48.539140 11030 tablet_copy_client.cc:806] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:48.612360 11030 tablet_copy_client.cc:670] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:48.617105 11030 tablet_copy_client.cc:538] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:48.632684 11014 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:48.640498 11014 tablet_bootstrap.cc:492] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:48.641876  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
mode: GRACEFUL
new_leader_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:45208
I20260709 12:23:48.644726  3999 raft_consensus.cc:606] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Received request to transfer leadership to TS bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:48.647717 11014 ts_tablet_manager.cc:1403] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.437s	user 0.059s	sys 0.007s
I20260709 12:23:48.655690  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:48.661787 11014 raft_consensus.cc:359] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:48.679673 11014 raft_consensus.cc:740] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:23:48.683804 11014 consensus_queue.cc:260] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:48.670075 11042 tablet_copy_client.cc:323] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.65:37307
I20260709 12:23:48.692945  3860 tablet_copy_service.cc:140] P bd47d64594f743eba2922d79251c1c5c: Received BeginTabletCopySession request for tablet e7012fd3393d4b19bd0d25e82fc612df from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:36260)
I20260709 12:23:48.693601  3860 tablet_copy_service.cc:161] P bd47d64594f743eba2922d79251c1c5c: Beginning new tablet copy session on tablet e7012fd3393d4b19bd0d25e82fc612df from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:36260: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-e7012fd3393d4b19bd0d25e82fc612df
I20260709 12:23:48.701779 11014 ts_tablet_manager.cc:1434] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.007s
I20260709 12:23:48.717167  3859 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c68343b8d5be4269b4b588c1b34d01e0 received from {username='slave'} at 127.0.0.1:36260
I20260709 12:23:48.717978  3859 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-c68343b8d5be4269b4b588c1b34d01e0 on tablet c68343b8d5be4269b4b588c1b34d01e0 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:48.732554 11030 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:23:48.751551  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 84263.1us
I20260709 12:23:48.753721  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:48.754920  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.767503  3997 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:48.766060  3860 tablet_copy_source_session.cc:215] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:48.803092 11042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7012fd3393d4b19bd0d25e82fc612df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.813397 10993 raft_consensus.cc:993] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: : Instructing follower bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:23:48.813992 10993 raft_consensus.cc:1081] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Signalling peer bd47d64594f743eba2922d79251c1c5c to start an election
I20260709 12:23:48.815639  4579 raft_consensus.cc:1217] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:23:48.817956  3850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:23:48.818617  3850 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:48.819063  3850 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.828613  3850 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:48.870077  3850 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:48.871057  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:48.863101  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 55326.3us
I20260709 12:23:48.871778  4579 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.885175  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:48.886703  3815 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:48.887840 11023 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:48.888422 11023 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Becoming Leader. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:48.889624 11023 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:48.918442 11042 tablet_copy_client.cc:806] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:48.919977 11042 tablet_copy_client.cc:670] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:48.927608 11042 tablet_copy_client.cc:538] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:48.962169  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:48.963088  3995 raft_consensus.cc:3055] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:48.963415  3995 raft_consensus.cc:740] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:48.964329  3995 consensus_queue.cc:260] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:48.971081  3995 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.970341  3743 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c reported cstate change: term changed from 13 to 14, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to bd47d64594f743eba2922d79251c1c5c (127.2.157.65). New cstate: current_term: 14 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.020017  3995 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd47d64594f743eba2922d79251c1c5c in term 14.
I20260709 12:23:49.055392 11042 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:23:49.132510 11030 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.133613 11030 tablet_bootstrap.cc:492] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:49.134454 11030 ts_tablet_manager.cc:1403] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.402s	user 0.039s	sys 0.020s
I20260709 12:23:49.200112 11030 raft_consensus.cc:359] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:49.201095 11030 raft_consensus.cc:740] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:23:49.201805 11030 consensus_queue.cc:260] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:49.232612 11030 ts_tablet_manager.cc:1434] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:23:49.234578  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-f9a206840e1648aeb4571019fa4ca639 received from {username='slave'} at 127.0.0.1:46046
I20260709 12:23:49.235105  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-f9a206840e1648aeb4571019fa4ca639 on tablet f9a206840e1648aeb4571019fa4ca639 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:49.315405 11042 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.323925 11042 tablet_bootstrap.cc:492] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:49.324823 11042 ts_tablet_manager.cc:1403] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.270s	user 0.042s	sys 0.027s
I20260709 12:23:49.328328 11042 raft_consensus.cc:359] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:49.332074 11042 raft_consensus.cc:740] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:23:49.344070 11042 consensus_queue.cc:260] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:49.346431  4579 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:49.347630 11042 ts_tablet_manager.cc:1434] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:23:49.350826  3860 tablet_copy_service.cc:342] P bd47d64594f743eba2922d79251c1c5c: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e7012fd3393d4b19bd0d25e82fc612df received from {username='slave'} at 127.0.0.1:36260
I20260709 12:23:49.352172  3860 tablet_copy_service.cc:434] P bd47d64594f743eba2922d79251c1c5c: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e7012fd3393d4b19bd0d25e82fc612df on tablet e7012fd3393d4b19bd0d25e82fc612df with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:49.350720 10929 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:49.391665  3992 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:49.405197 11023 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:49.588464 10929 raft_consensus.cc:1064] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:49.600770 10929 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:49.621428  4578 raft_consensus.cc:1217] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
W20260709 12:23:49.721659  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 63092.1us
I20260709 12:23:49.730072  4581 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:23:49.753013  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68517.2us
I20260709 12:23:49.804503  3997 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:49.824520 11023 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:23:49.825766  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 71297.2us
I20260709 12:23:49.826812 11022 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:49.834717  4578 raft_consensus.cc:1217] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:23:49.846623  3917 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:23:49.859704 11023 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:49.961441 11068 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.000993  4578 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.019881 11017 raft_consensus.cc:1064] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:50.033191  3925 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.034888 11017 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.076553  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.081779  3747 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 12 to 13, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.104840  3995 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.194464  3850 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.206943  4581 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.211602 11075 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:50.212456 11068 raft_consensus.cc:1064] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:50.220054 11068 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.222710 11056 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:50.247589  3995 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.260350 11056 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:23:50.340209  3997 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.342849 11059 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:23:50.383785 11083 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:23:50.389217 11050 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.413988  3920 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.417294  4579 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:50.432591  4581 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.452872 11059 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:23:50.455823 11066 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:50.508036  3850 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.509055  3995 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.533353  3841 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.590438  3995 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:50.593180 11066 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:50.598789  4581 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:23:50.569531  3743 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.609601  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2900e71c0212466e8be300d30595c609"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:50.610389  3850 raft_consensus.cc:606] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Received request to transfer leadership to TS 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:50.609468 11059 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 12:23:50.632236 11088 log.cc:927] Time spent T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:23:50.639693 11023 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.653611  4581 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.666847  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84"
dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
mode: GRACEFUL
new_leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40202
I20260709 12:23:50.667563  3850 raft_consensus.cc:606] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Received request to transfer leadership to TS 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:23:50.671623  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:50.671060 11022 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.678931  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:50.679822  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.679994  4579 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.709055  3997 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:50.714033  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 112710us
I20260709 12:23:50.688333  3996 raft_consensus.cc:2955] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.726716 11085 raft_consensus.cc:993] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:50.727991 11085 raft_consensus.cc:1081] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Signalling peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 to start an election
I20260709 12:23:50.734685  3917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84"
dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:23:50.735342  3917 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:50.735755  3917 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:50.761268  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c68343b8d5be4269b4b588c1b34d01e0 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.787043  3920 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.793286  3748 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 14 to 15, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.796218 11023 raft_consensus.cc:993] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: : Instructing follower 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:50.796859 11066 raft_consensus.cc:1081] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Signalling peer 32d706e2535f4fa19a09382d4edac677 to start an election
I20260709 12:23:50.797032  3743 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 13 to 14, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 18 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.799789  3997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2900e71c0212466e8be300d30595c609"
dest_uuid: "32d706e2535f4fa19a09382d4edac677"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:23:50.800473  3997 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:50.800926  3997 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.817586  3917 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.822263  3842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:50.822893  3842 raft_consensus.cc:3055] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:23:50.823203  3842 raft_consensus.cc:740] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:50.824118  3842 consensus_queue.cc:260] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.825286  3842 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:50.825845  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:50.826471  4579 raft_consensus.cc:3060] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:50.847959  4579 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:50.861685  3841 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.866391  3997 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.874642  3841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "bd47d64594f743eba2922d79251c1c5c"
I20260709 12:23:50.877162  3841 raft_consensus.cc:3055] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:23:50.878324  4581 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:50.879839  3841 raft_consensus.cc:740] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bd47d64594f743eba2922d79251c1c5c, State: Running, Role: LEADER
I20260709 12:23:50.880717  3841 consensus_queue.cc:260] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.881865  3841 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.882515 11023 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:50.884407  3997 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:50.886909  3996 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer bd47d64594f743eba2922d79251c1c5c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:50.907860  3841 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:50.908260 11022 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:50.909471  3962 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c; no voters: 
I20260709 12:23:50.910573 11074 raft_consensus.cc:2804] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:50.911067 11074 raft_consensus.cc:697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:50.887811  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:50.912320  4581 raft_consensus.cc:3060] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:50.886128  3842 raft_consensus.cc:2468] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:50.913481  3917 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:50.916644 11074 consensus_queue.cc:237] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.921197 11085 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.892068  3890 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:23:50.925237 11017 raft_consensus.cc:2804] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:50.925871 11017 raft_consensus.cc:697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:50.926937 11017 consensus_queue.cc:237] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:50.933393  4580 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:50.939069  4581 raft_consensus.cc:2468] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 20.
I20260709 12:23:51.006485  3996 raft_consensus.cc:2955] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.016625  3917 consensus_queue.cc:237] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:51.041260  3913 tablet_service.cc:1558] Processing DeleteTablet for tablet c68343b8d5be4269b4b588c1b34d01e0 with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:44892
I20260709 12:23:51.044013  3842 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:51.054885  3732 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7012fd3393d4b19bd0d25e82fc612df with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.053777  3743 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 15 to 16, VOTER 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) evicted. New cstate: current_term: 19 leader_uuid: "bd47d64594f743eba2922d79251c1c5c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.065759 11017 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:51.066529  4580 raft_consensus.cc:1275] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:51.073200 10900 consensus_queue.cc:1048] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:51.078608 10900 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.082070  3841 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.091902  4580 raft_consensus.cc:2955] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.113708  3747 catalog_manager.cc:5697] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 19 to 20, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 20 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.102483  3748 catalog_manager.cc:5697] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 18 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.164245  3915 tablet_service.cc:1558] Processing DeleteTablet for tablet e7012fd3393d4b19bd0d25e82fc612df with delete_type TABLET_DATA_TOMBSTONED (TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:44892
I20260709 12:23:51.186668  3734 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9a206840e1648aeb4571019fa4ca639 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.187067  3746 catalog_manager.cc:5697] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c reported cstate change: config changed from index 15 to 16, VOTER 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) evicted. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:51.241571 11097 tablet_replica.cc:333] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:23:51.260777 11097 raft_consensus.cc:2243] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.261911 11097 raft_consensus.cc:2272] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.292452  3985 tablet_service.cc:1558] Processing DeleteTablet for tablet f9a206840e1648aeb4571019fa4ca639 with delete_type TABLET_DATA_TOMBSTONED (TS 32d706e2535f4fa19a09382d4edac677 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:33622
I20260709 12:23:51.295910 11097 ts_tablet_manager.cc:1916] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.311643 11099 tablet_replica.cc:333] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:23:51.313014 11099 raft_consensus.cc:2243] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.313905 11099 raft_consensus.cc:2272] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.322592  3841 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:51.324622 10900 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:51.330698 11097 ts_tablet_manager.cc:1929] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 12:23:51.331363 11097 log.cc:1199] T c68343b8d5be4269b4b588c1b34d01e0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/c68343b8d5be4269b4b588c1b34d01e0
I20260709 12:23:51.345563 11099 ts_tablet_manager.cc:1916] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.364609  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet c68343b8d5be4269b4b588c1b34d01e0 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:51.366851 11097 tablet_replica.cc:333] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:23:51.377043 11097 raft_consensus.cc:2243] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.381202 11097 raft_consensus.cc:2272] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.395869 11097 ts_tablet_manager.cc:1916] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.413395  4580 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:51.423985  4580 raft_consensus.cc:1275] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:51.427037 11075 consensus_queue.cc:1048] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:51.430577  3842 raft_consensus.cc:1275] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:23:51.432535 10993 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:23:51.509268 10771 consensus_queue.cc:1048] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:23:51.584879 11097 ts_tablet_manager.cc:1929] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 12:23:51.585507 11097 log.cc:1199] T e7012fd3393d4b19bd0d25e82fc612df P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/wals/e7012fd3393d4b19bd0d25e82fc612df
I20260709 12:23:51.586786 11099 ts_tablet_manager.cc:1929] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 12:23:51.587520 11099 log.cc:1199] T f9a206840e1648aeb4571019fa4ca639 P 32d706e2535f4fa19a09382d4edac677: Deleting WAL directory at /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/wals/f9a206840e1648aeb4571019fa4ca639
I20260709 12:23:51.588660  3734 catalog_manager.cc:5028] TS 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): tablet e7012fd3393d4b19bd0d25e82fc612df (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:51.593158  3733 catalog_manager.cc:5028] TS 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): tablet f9a206840e1648aeb4571019fa4ca639 (table test-workload [id=7c0d40c13c414823aaa0a7d0fb408d5c]) successfully deleted
I20260709 12:23:51.998674  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.161845  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:52.163821  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:52.164659  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.232928  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.289096  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
W20260709 12:23:52.295485  3962 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:23:52.327100  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 49863.6us
W20260709 12:23:52.420332  3815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 45637.3us
W20260709 12:23:52.448451  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50637.1us
W20260709 12:23:52.472018  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.482028  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.482662  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.483224  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.495086  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.500995  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.507223  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.511266  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 78494.1us
W20260709 12:23:52.518522  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.521679  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.522404  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.523697  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.525345  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.534736  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.546358  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.550225  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.559033  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.560046  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.560848  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.561568  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.567840  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.587720  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.589321  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.598605  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.603752  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.607532  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.622304  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.627002  3962 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:52.636232  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.656760  3996 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:23:52.680569  3962 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.683418  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:52.689038  2677 tablet_replica.cc:333] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.695104  2677 raft_consensus.cc:2243] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.696098  2677 raft_consensus.cc:2272] T 7265897ebd4e4f6ba4330aca29c74838 P bd47d64594f743eba2922d79251c1c5c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.699435  2677 tablet_replica.cc:333] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
W20260709 12:23:52.706754  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.709817  3917 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:52.713773 11074 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:52.716661  2677 raft_consensus.cc:2243] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:52.720132  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.720683  2677 raft_consensus.cc:2272] T 65de00ab7bf84d57b73f50c0d7c07565 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.724238  2677 tablet_replica.cc:333] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
W20260709 12:23:52.724875  3964 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 610ee9fca78e4559ab9cde25d14edade. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.725391  2677 raft_consensus.cc:2243] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:23:52.737236  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.740585  2677 raft_consensus.cc:2272] T 3bc1f0da5d664bee8661e3dbace70630 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:52.750803  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.750092  2677 tablet_replica.cc:333] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.760596  2677 raft_consensus.cc:2243] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.761734 11123 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:52.763505  3918 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
W20260709 12:23:52.775307  3962 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.775344  2677 raft_consensus.cc:2272] T c68343b8d5be4269b4b588c1b34d01e0 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.786211  2677 tablet_replica.cc:333] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.788688  2677 raft_consensus.cc:2243] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.801669  2677 raft_consensus.cc:2272] T 91a268ae9485472a8208827344502203 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.793632  3917 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:52.815167  3746 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:52.823052  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.826256  2677 tablet_replica.cc:333] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.833936  2677 raft_consensus.cc:2243] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.835163  2677 raft_consensus.cc:2272] T d25c2d062dfa4db8852d794adc28cdf2 P bd47d64594f743eba2922d79251c1c5c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.838238  2677 tablet_replica.cc:333] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
W20260709 12:23:52.857002  3890 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2dbe9e57610c4d9b92c97966fbbfc00d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.857072  3995 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:23:52.862011  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:52.864109 10900 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:52.864346  2677 raft_consensus.cc:2243] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.880304  2677 raft_consensus.cc:2272] T 67af26a7a42843f6855950af7a5b7781 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.887130  2677 tablet_replica.cc:333] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.888155  2677 raft_consensus.cc:2243] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.889310  2677 raft_consensus.cc:2272] T f8842b18207e4c90a92bd153fe9d059e P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.911702  2677 tablet_replica.cc:333] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.912683  2677 raft_consensus.cc:2243] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.913319  2677 raft_consensus.cc:2272] T 58188a85c5c940b2a6a6d9e2640f3b18 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.918124  2677 tablet_replica.cc:333] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.918999  2677 raft_consensus.cc:2243] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.920221  2677 raft_consensus.cc:2272] T bbef64c2ac9444d6983c225484fccfda P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.923357  2677 tablet_replica.cc:333] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.925537  2677 raft_consensus.cc:2243] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.928709  2677 raft_consensus.cc:2272] T e7012fd3393d4b19bd0d25e82fc612df P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.932096  2677 tablet_replica.cc:333] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.933302  2677 raft_consensus.cc:2243] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.934012  2677 raft_consensus.cc:2272] T 88805767597d4bf9bed095ba7d4f4a76 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.937273  2677 tablet_replica.cc:333] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.938304  2677 raft_consensus.cc:2243] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.939576  2677 raft_consensus.cc:2272] T 565a1813fc6b4a21aa0897f0624b5122 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.940861 11049 raft_consensus.cc:2955] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:52.942716  2677 tablet_replica.cc:333] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.943827  2677 raft_consensus.cc:2243] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.944638  2677 raft_consensus.cc:2272] T 1fc77961701c41028cd54ea83719dae9 P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.947721  2677 tablet_replica.cc:333] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.949131  2677 raft_consensus.cc:2243] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.949891  2677 raft_consensus.cc:2272] T f370e99c95594dc19f98fb403380e06c P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.953083  2677 tablet_replica.cc:333] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.952179  3995 raft_consensus.cc:2955] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:52.954174  2677 raft_consensus.cc:2243] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.955273  2677 raft_consensus.cc:2272] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P bd47d64594f743eba2922d79251c1c5c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.968428  2677 tablet_replica.cc:333] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.977246  2677 raft_consensus.cc:2243] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:52.985199  2677 raft_consensus.cc:2272] T 9c325a58070740f29bc40a3a22e2b61d P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.988760  2677 tablet_replica.cc:333] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.989717  2677 raft_consensus.cc:2243] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.990612  2677 raft_consensus.cc:2272] T 722124affb914f0496100070a9582045 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.997928  2677 tablet_replica.cc:333] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:52.999042  2677 raft_consensus.cc:2243] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.002257  2677 raft_consensus.cc:2272] T 2dbe9e57610c4d9b92c97966fbbfc00d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.023356  2677 tablet_replica.cc:333] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.024401  2677 raft_consensus.cc:2243] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.025365  2677 raft_consensus.cc:2272] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.028439  2677 tablet_replica.cc:333] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.040388  2677 raft_consensus.cc:2243] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.048022  2677 raft_consensus.cc:2272] T a29f44dfd3d24dccaa224167c983a5a4 P bd47d64594f743eba2922d79251c1c5c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.056346  2677 tablet_replica.cc:333] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.057519  2677 raft_consensus.cc:2243] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.068065  2677 raft_consensus.cc:2272] T 63ac059d92404e2aa8792e1c5b02ae88 P bd47d64594f743eba2922d79251c1c5c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.999002  3997 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:53.078516  2677 tablet_replica.cc:333] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.079824  2677 raft_consensus.cc:2243] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.080787  2677 raft_consensus.cc:2272] T 07eac049e3fe41bf98d28d3d572dcb8a P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.084492  2677 tablet_replica.cc:333] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.090426  2677 raft_consensus.cc:2243] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.082360  3747 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:53.092641  2677 raft_consensus.cc:2272] T a66f6f6f296148d9b3b0931f1c94d49a P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:53.111999  3964 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e029f255cf96482eb49b53e7dc7ed25d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.114964  2677 tablet_replica.cc:333] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
W20260709 12:23:53.115532  3962 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.115893  2677 raft_consensus.cc:2243] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.117089  2677 raft_consensus.cc:2272] T 30c0e62036464a72858695d542f42a18 P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.118216  3917 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:23:53.120162 11121 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:53.136124  2677 tablet_replica.cc:333] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.137945  2677 raft_consensus.cc:2243] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.139230  2677 raft_consensus.cc:2272] T 7469adb046a64b1b9311cea78d13a0e6 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.152990 11121 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:53.156966  3918 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:53.178704  2677 tablet_replica.cc:333] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.179734  2677 raft_consensus.cc:2243] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.188298  2677 raft_consensus.cc:2272] T 271f08ec28384c99b6dd3fb41fb92ebf P bd47d64594f743eba2922d79251c1c5c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.191174  2677 tablet_replica.cc:333] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.195652  2677 raft_consensus.cc:2243] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.196455  2677 raft_consensus.cc:2272] T ff4bdec26d3e4879bd33a92daad5d607 P bd47d64594f743eba2922d79251c1c5c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.214979  3997 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:53.220762  3746 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 13, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:53.239557  2677 tablet_replica.cc:333] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.240574  2677 raft_consensus.cc:2243] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.241394  2677 raft_consensus.cc:2272] T 63cbbf40cb084518a89acf7f7026e77b P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.257339  3918 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:53.269037 10771 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:53.255355  2677 tablet_replica.cc:333] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.270587  2677 raft_consensus.cc:2243] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:53.271014  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.271284  2677 raft_consensus.cc:2272] T 3d61667a526f478f888a20a9619a1e2b P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:53.273646  3964 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173): Couldn't send request to peer 328b0b7296c545ff8ea6f7c70f93f2c5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88805767597d4bf9bed095ba7d4f4a76. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.284065  2677 tablet_replica.cc:333] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.285144  2677 raft_consensus.cc:2243] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.285877  2677 raft_consensus.cc:2272] T c95cac50f4de4720ab08d1d1e49d71b5 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.292235  2677 tablet_replica.cc:333] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.293716  2677 raft_consensus.cc:2243] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.305943  2677 raft_consensus.cc:2272] T ce77a1e41f7b43cc965d6fd6976759cd P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.309264  2677 tablet_replica.cc:333] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.316715 11135 ts_tablet_manager.cc:933] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.322927  2677 raft_consensus.cc:2243] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.324294  2677 raft_consensus.cc:2272] T 125588992e20455d8e0b267fb10d24a7 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.327188  2677 tablet_replica.cc:333] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.328052  2677 raft_consensus.cc:2243] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.328764  2677 raft_consensus.cc:2272] T 56a5b44f8f3e46ae9582b9f86d191610 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.329595 11136 ts_tablet_manager.cc:933] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:53.335651 11121 raft_consensus.cc:2955] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:53.347801  2677 tablet_replica.cc:333] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.348964  2677 raft_consensus.cc:2243] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.350205  2677 raft_consensus.cc:2272] T d96631b804304cddb7995664610e592d P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.350158  3918 raft_consensus.cc:2955] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } } }
I20260709 12:23:53.353209 11108 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:53.353856 11108 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.357486 11108 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.358038  2677 tablet_replica.cc:333] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.358248  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:53.360136  2677 raft_consensus.cc:2243] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.362092  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.363224  2677 raft_consensus.cc:2272] T 2900e71c0212466e8be300d30595c609 P bd47d64594f743eba2922d79251c1c5c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.364549 11135 tablet_copy_client.cc:323] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:23:53.373943  3814 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:53.375489 11023 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:53.376070  4008 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 610ee9fca78e4559ab9cde25d14edade from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:23:53.376892  4008 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 610ee9fca78e4559ab9cde25d14edade from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-610ee9fca78e4559ab9cde25d14edade
I20260709 12:23:53.377601  2677 tablet_replica.cc:333] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.378646  2677 raft_consensus.cc:2243] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.379266  2677 raft_consensus.cc:2272] T f3bacd87db564c3ba5256af726514f84 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.388701 11023 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:23:53.389315 11023 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:53.391613 11023 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:53.392270 11136 tablet_copy_client.cc:323] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.66:38799
I20260709 12:23:53.394119  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:53.396297  3934 tablet_copy_service.cc:140] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Received BeginTabletCopySession request for tablet 2dbe9e57610c4d9b92c97966fbbfc00d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:46046)
I20260709 12:23:53.396885  3934 tablet_copy_service.cc:161] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Beginning new tablet copy session on tablet 2dbe9e57610c4d9b92c97966fbbfc00d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:46046: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-2dbe9e57610c4d9b92c97966fbbfc00d
I20260709 12:23:53.398504  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.400590  3815 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:53.401803 11108 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:53.433682  2677 tablet_replica.cc:333] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.434690  2677 raft_consensus.cc:2243] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.435058  4008 tablet_copy_source_session.cc:215] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.435433  2677 raft_consensus.cc:2272] T 0fc6b8b0d8114762a0c8cec5e5461a82 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.438867 11135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ee9fca78e4559ab9cde25d14edade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.441242  2677 tablet_replica.cc:333] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.444710  2677 raft_consensus.cc:2243] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.446203  2677 raft_consensus.cc:2272] T 610ee9fca78e4559ab9cde25d14edade P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.449088  3934 tablet_copy_source_session.cc:215] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.449373  2677 tablet_replica.cc:333] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.454846  2677 raft_consensus.cc:2243] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.456861  2677 raft_consensus.cc:2272] T 83b1a4f620064a52bb4a2fb284f00276 P bd47d64594f743eba2922d79251c1c5c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.458717 11136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbe9e57610c4d9b92c97966fbbfc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.425186  3743 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index -1 to 8, NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) added. New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:53.460794  2677 tablet_replica.cc:333] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.461946  2677 raft_consensus.cc:2243] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.463024  2677 raft_consensus.cc:2272] T f9a206840e1648aeb4571019fa4ca639 P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.466325  2677 tablet_replica.cc:333] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.467299  2677 raft_consensus.cc:2243] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.475536  2677 raft_consensus.cc:2272] T fdd5ceb511e74bc7a94d43444ea1d35e P bd47d64594f743eba2922d79251c1c5c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.476805 11023 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:53.477360 11023 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.492697  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.501541 11023 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.502923  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:53.503468 11135 tablet_copy_client.cc:806] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.509011  2677 tablet_replica.cc:333] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.528613 11135 tablet_copy_client.cc:670] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.512909 11136 tablet_copy_client.cc:806] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.528964  2677 raft_consensus.cc:2243] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.529394 11136 tablet_copy_client.cc:670] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.530239  2677 raft_consensus.cc:2272] T ba989d98d508441a9e56717e49c9004d P bd47d64594f743eba2922d79251c1c5c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.526353 11108 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:53.535046 11108 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.534952  3815 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:53.538514 11023 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:53.539204 11136 tablet_copy_client.cc:538] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.541343 11108 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.542929  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:53.544634 11139 ts_tablet_manager.cc:933] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.547363 11135 tablet_copy_client.cc:538] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.548986  2677 tablet_replica.cc:333] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.549921  2677 raft_consensus.cc:2243] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.550624  2677 raft_consensus.cc:2272] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.564899  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.570573  3815 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:53.571659 11135 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:23:53.580286 11136 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:23:53.585485 11108 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:53.593967  2677 tablet_replica.cc:333] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.594935  2677 raft_consensus.cc:2243] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.595755  2677 raft_consensus.cc:2272] T a7d019c5856041bca1afab26bbc6c7a6 P bd47d64594f743eba2922d79251c1c5c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.618517 11139 tablet_copy_client.cc:323] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:23:53.622081  2677 tablet_replica.cc:333] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.623029  2677 raft_consensus.cc:2243] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:53.632378  4008 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet e029f255cf96482eb49b53e7dc7ed25d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:23:53.633138  4008 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet e029f255cf96482eb49b53e7dc7ed25d from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-e029f255cf96482eb49b53e7dc7ed25d
I20260709 12:23:53.655419  2677 raft_consensus.cc:2272] T 982a62c46cea46f2b2e381471e7e080c P bd47d64594f743eba2922d79251c1c5c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.660844 11108 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:23:53.661680 11108 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.665097  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.669059  4008 tablet_copy_source_session.cc:215] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.669545  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "bd47d64594f743eba2922d79251c1c5c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:53.670135 11108 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.663705  2677 tablet_replica.cc:333] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.678679 11139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f255cf96482eb49b53e7dc7ed25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.680905  2677 raft_consensus.cc:2243] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.674180  3814 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd47d64594f743eba2922d79251c1c5c; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:23:53.689949 11108 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:23:53.688601  2677 raft_consensus.cc:2272] T 138b76e837f84a518585fccdcf9ff6d4 P bd47d64594f743eba2922d79251c1c5c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.694126  2677 tablet_replica.cc:333] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.694905  2677 raft_consensus.cc:2243] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.695639  2677 raft_consensus.cc:2272] T c9cb9cc431d048dd8cfea736da6af5fa P bd47d64594f743eba2922d79251c1c5c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.698868  2677 tablet_replica.cc:333] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c: stopping tablet replica
I20260709 12:23:53.699687  2677 raft_consensus.cc:2243] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.700309  2677 raft_consensus.cc:2272] T e029f255cf96482eb49b53e7dc7ed25d P bd47d64594f743eba2922d79251c1c5c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.823575 11139 tablet_copy_client.cc:806] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.824235 11139 tablet_copy_client.cc:670] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.832871 11139 tablet_copy_client.cc:538] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.843022 11143 ts_tablet_manager.cc:933] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Initiating tablet copy from peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:53.844332 11135 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.845392 11135 tablet_bootstrap.cc:492] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:53.846140 11135 ts_tablet_manager.cc:1403] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.276s	user 0.046s	sys 0.008s
I20260709 12:23:53.857082 11143 tablet_copy_client.cc:323] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.67:35865
I20260709 12:23:53.862093 11074 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:53.862634  4008 tablet_copy_service.cc:140] P 32d706e2535f4fa19a09382d4edac677: Received BeginTabletCopySession request for tablet 88805767597d4bf9bed095ba7d4f4a76 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 ({username='slave'} at 127.0.0.1:37296)
I20260709 12:23:53.862759 11074 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.863765  4008 tablet_copy_service.cc:161] P 32d706e2535f4fa19a09382d4edac677: Beginning new tablet copy session on tablet 88805767597d4bf9bed095ba7d4f4a76 from peer 328b0b7296c545ff8ea6f7c70f93f2c5 at {username='slave'} at 127.0.0.1:37296: session id = 328b0b7296c545ff8ea6f7c70f93f2c5-88805767597d4bf9bed095ba7d4f4a76
I20260709 12:23:53.868098  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.849431 11135 raft_consensus.cc:359] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:53.872136 11135 raft_consensus.cc:740] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
I20260709 12:23:53.872924 11135 consensus_queue.cc:260] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:23:53.874866  3962 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:53.875352  3962 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:53.877106 10771 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:23:53.865402 11074 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:53.898524 11135 ts_tablet_manager.cc:1434] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:23:53.900904  4009 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-610ee9fca78e4559ab9cde25d14edade received from {username='slave'} at 127.0.0.1:37296
I20260709 12:23:53.901508  4009 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-610ee9fca78e4559ab9cde25d14edade on tablet 610ee9fca78e4559ab9cde25d14edade with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:53.905416 11136 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.914197 11136 tablet_bootstrap.cc:492] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:53.920640 11136 ts_tablet_manager.cc:1403] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.341s	user 0.051s	sys 0.007s
I20260709 12:23:53.928151 11049 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:53.928773 11049 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.903192  4008 tablet_copy_source_session.cc:215] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.932226  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:53.933696  3997 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:53.935912 11139 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
I20260709 12:23:53.936012  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:53.936877 11143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88805767597d4bf9bed095ba7d4f4a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.937117 10900 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:53.937525 10900 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:53.937873 10900 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:53.932786 11049 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:53.958084  3888 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:53.970515 10900 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.973776 10771 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:53.974391 10771 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:53.978672 10771 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:53.961386 11136 raft_consensus.cc:359] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:53.979799  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:53.980257 11136 raft_consensus.cc:740] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
W20260709 12:23:53.978506  3888 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:53.981544  3962 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:53.981190 11136 consensus_queue.cc:260] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:53.982148  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:53.983255 11074 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:53.985471  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:53.986218  3997 raft_consensus.cc:3060] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:53.998456 11136 ts_tablet_manager.cc:1434] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:23:54.016006  3997 raft_consensus.cc:2468] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 21.
I20260709 12:23:54.017910  3889 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.018640 11143 tablet_copy_client.cc:806] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:54.019058 11075 raft_consensus.cc:2804] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:54.016611 10900 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.022491  3934 tablet_copy_service.cc:342] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2dbe9e57610c4d9b92c97966fbbfc00d received from {username='slave'} at 127.0.0.1:46046
I20260709 12:23:54.031677 11049 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.047610  3934 tablet_copy_service.cc:434] P 146eb0cb8a2f4846ae6ef2b8758dd6a6: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-2dbe9e57610c4d9b92c97966fbbfc00d on tablet 2dbe9e57610c4d9b92c97966fbbfc00d with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:54.049901 11143 tablet_copy_client.cc:670] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:54.056538 11049 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.063812 11049 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.068917  3888 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.072494 10771 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.073104 10771 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.075104 10771 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:54.079217  3962 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.085240  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.085953  3997 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:54.089373  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:54.094377  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.096208 11049 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.096648 11049 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.097048 11049 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.104300  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.105140 10771 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.106854 11143 tablet_copy_client.cc:538] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:54.108286 11075 raft_consensus.cc:697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:54.108803 11049 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.109457 11075 consensus_queue.cc:237] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.120687 11049 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.124174  3888 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.125838  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:54.126502  3997 raft_consensus.cc:3060] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.139714  3997 raft_consensus.cc:2468] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:54.150415  3889 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.151857 10900 raft_consensus.cc:2804] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:54.152535 10900 raft_consensus.cc:697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:54.157256 10900 consensus_queue.cc:237] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.150264 11113 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.163864 11113 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.166872 11113 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.169034 11121 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.169227  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.169663 11121 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.170203 11143 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap starting.
W20260709 12:23:54.178812  4546 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.179307  4546 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.181504 11112 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.200774 11121 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.196097 11049 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.204759 11049 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.207121 11049 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.210086  3743 catalog_manager.cc:5697] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 20 to 21, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 21 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.215274 11075 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.215909 11075 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.218098 11075 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.242902  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 44560.5us
I20260709 12:23:54.244331 11074 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.244952 11074 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.247150 11074 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:54.257186  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:54.257925  3917 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
W20260709 12:23:54.282612  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 72848.2us
I20260709 12:23:54.283205  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.283892  3995 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:54.284655  4581 raft_consensus.cc:1217] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 12:23:54.295936 10771 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.296654 10771 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.299644 10771 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.302130 11074 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.302717 11074 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.304919 11074 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.307303  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.308017  3995 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:54.311913  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:54.314222 11121 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.314823 11121 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.316454  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:54.316586  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:54.317063 11121 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:54.319705  3962 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.317122  3918 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:54.322376  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:54.321355  3888 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:54.324916  3888 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.336020 10900 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:54.323714 11139 log.cc:927] Time spent T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.056s	user 0.004s	sys 0.000s
I20260709 12:23:54.336601 10900 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.328176 11074 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.327240 11075 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.352705 10900 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.363713  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 52619.2us
I20260709 12:23:54.366420  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:54.367167  4581 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:54.353461 11074 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.354329 11075 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.373513  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:54.388337  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 61814.2us
I20260709 12:23:54.380435 11074 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:54.403050  3888 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.387207 11075 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:54.412813  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 84753.4us
I20260709 12:23:54.390157 11154 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.418344  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:54.427626 11151 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:54.428215 11151 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.428606 11151 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.422130 11154 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.431680  4581 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:54.431795 11154 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.440670  4580 raft_consensus.cc:1217] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 12:23:54.442515  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.443181  3996 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:23:54.443158  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:54.448997 10771 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:54.449558 10771 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.449991 10771 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:54.454273  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 65142.6us
I20260709 12:23:54.453069  4547 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:54.455673  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:54.473328  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:54.474022  3995 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 17.
I20260709 12:23:54.455005 11148 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.457806 11113 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:23:54.476332  4546 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.470711 11163 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:54.490041  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.479862 11113 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.498817 11162 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.499492 11162 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.500273 11113 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:54.501742 11162 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.484717 11148 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.505692 11148 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.485339 11163 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.492910 11121 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.520119 11163 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.524885 11158 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:54.531044 10771 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.528453 11158 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.538784 10771 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:23:54.546819  4546 connection.cc:573] client connection to 127.2.157.65:37307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:23:54.543287 11157 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.552132 11139 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:54.553252 11139 tablet_bootstrap.cc:492] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:54.528532 11121 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.558692 11121 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:54.541664 11158 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:54.559266 11151 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.570775 11151 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.576165  3962 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.552201 11157 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.578994 11167 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.579675 11167 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.580904 11157 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.582537 11167 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:54.583206 11139 ts_tablet_manager.cc:1403] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.648s	user 0.050s	sys 0.027s
I20260709 12:23:54.589154 11075 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.592046 11075 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.619176  3962 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:54.621342  3962 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.621917  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:54.638236  3962 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.644308 11121 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:23:54.655814 11163 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.663115 11163 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:54.674324  3888 connection.cc:769] client connection to 127.2.157.65:37307 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:23:54.675249  3962 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:54.677191  3962 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:54.658964 11113 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.681567 11074 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.669260 11159 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:54.692117  3962 connection.cc:769] client connection to 127.2.157.65:37307 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:23:54.695780 11159 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.698614 11159 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.701087 11167 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:54.702100  4546 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.703929 11167 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.707584 11167 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.728766 11074 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.738420 11113 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.748106 11139 raft_consensus.cc:359] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:54.749310 11139 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
W20260709 12:23:54.750730  4546 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.750195 11139 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:54.735119 11158 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.755347 11158 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.756469  4546 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.758361 11139 ts_tablet_manager.cc:1434] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.175s	user 0.008s	sys 0.000s
W20260709 12:23:54.774786  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 248549us
I20260709 12:23:54.779625  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:23:54.780364  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
I20260709 12:23:54.784214  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:54.784960  4581 raft_consensus.cc:3060] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:54.801208  4581 raft_consensus.cc:2468] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
W20260709 12:23:54.801393  3888 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.803803  3888 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.835911  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:54.836117  3888 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.836730  4579 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
W20260709 12:23:54.836968  3888 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.839000  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:54.839775  3888 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.849988 11168 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.850368  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:54.850675 11168 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.851368  3920 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:54.853209 11168 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.857352 11158 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.857962 11158 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.860035 11158 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.860065  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:54.862332 11174 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.862998 11174 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.863948 10900 raft_consensus.cc:1064] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
W20260709 12:23:54.864629  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:54.865151  3888 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.865454 11174 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:54.866258  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:54.866626 10900 consensus_queue.cc:237] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:54.867672  3888 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.868889  3748 catalog_manager.cc:5697] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 18 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.872948 11159 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.873528  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:54.873621 11159 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:54.874367  3925 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 18.
I20260709 12:23:54.876376 11159 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:54.881894  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:54.882786  3918 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 19: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
W20260709 12:23:54.887641  3962 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.887735  4581 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:54.889415  4546 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.891311 10900 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:54.913628 10900 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.914233 10900 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.917326 10900 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:54.926460  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:54.929947  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:54.940943  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:54.944624 11174 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:54.945303 11174 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:54.947903 11174 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:54.949156  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.950476 11174 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:54.950886  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:54.951172 11174 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:54.953794  3962 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:54.995755 11174 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:54.996047  3962 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.996799  3962 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.998172  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:54.998764  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:54.999329  3962 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.956660  3888 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:54.983575  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:54.992673 10771 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:55.002902  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46289.9us
I20260709 12:23:55.003170 10771 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:55.003669  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.005553 10771 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:55.009933 11174 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.014680 10771 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:55.015148 10771 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.015558 10771 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:55.017153  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.031232  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 80420.5us
I20260709 12:23:55.032521  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.033783  3964 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.034390 11074 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:55.034951 11074 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.035429 11074 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:55.045250  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.057181  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.062546  3962 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:55.063189  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.063724  3962 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.061628 11074 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.075968 11174 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:55.078128 11074 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:55.080590 11143 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:23:55.080842  3962 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.081642 11143 tablet_bootstrap.cc:492] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Bootstrap complete.
I20260709 12:23:55.082434 11143 ts_tablet_manager.cc:1403] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent bootstrapping tablet: real 0.912s	user 0.045s	sys 0.013s
W20260709 12:23:55.083227  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48269.2us
I20260709 12:23:55.083348 11167 raft_consensus.cc:2804] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:55.084612 11167 raft_consensus.cc:697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:55.085035 11174 raft_consensus.cc:1064] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:55.085559 11167 consensus_queue.cc:237] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.089416  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.090241  3996 raft_consensus.cc:2393] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 19: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:55.094036  4008 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e029f255cf96482eb49b53e7dc7ed25d received from {username='slave'} at 127.0.0.1:37296
I20260709 12:23:55.093931  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.094621  4008 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-e029f255cf96482eb49b53e7dc7ed25d on tablet e029f255cf96482eb49b53e7dc7ed25d with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:55.096109  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.097064  3992 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 20: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:55.098206  3962 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.091044 10771 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.100307  3996 raft_consensus.cc:2393] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in current term 15: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:55.101204 10771 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:23:55.104411  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:23:55.104653  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.105158  3997 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 14.
I20260709 12:23:55.104285  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.104247  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.107745  3990 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 24.
I20260709 12:23:55.108011  3992 raft_consensus.cc:1275] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:23:55.106237  3995 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 22.
W20260709 12:23:55.117718  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.118664  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.123072 11143 raft_consensus.cc:359] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
W20260709 12:23:55.125983  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.098347 11174 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:55.126596  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.130056  3962 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:55.137691  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.139853  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.140751  3995 raft_consensus.cc:2393] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:55.145398  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.146346  3995 raft_consensus.cc:2393] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:55.148346  3888 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.155895  3748 catalog_manager.cc:5697] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.158378  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.159112  3999 raft_consensus.cc:3060] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:55.168365  3999 raft_consensus.cc:2468] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
W20260709 12:23:55.149596  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.183786  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:55.184514  3918 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 22.
W20260709 12:23:55.184631  3962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.179049  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:55.187628  3925 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:55.191620  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:55.170140  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.171861  3992 raft_consensus.cc:1275] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:55.172288  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.198246  3995 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 18.
I20260709 12:23:55.173386  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.200045  3990 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
W20260709 12:23:55.201149  3962 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.174165  3997 raft_consensus.cc:1275] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:55.175349  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:55.202004 11154 raft_consensus.cc:3060] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:55.193190  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.202513  3996 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 22.
I20260709 12:23:55.203596 10900 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:55.203989 10900 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.204329 10900 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.124251 11143 raft_consensus.cc:740] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Initialized, Role: LEARNER
W20260709 12:23:55.207762  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.208338  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.208238 11143 consensus_queue.cc:260] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: NON_VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: true } }
I20260709 12:23:55.214201 10900 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.217124  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.224174 11075 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:55.224563 11075 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.216953 11145 consensus_queue.cc:1048] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:55.224910 11075 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:55.225033  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.226081 11145 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.226516  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.227305 11168 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.228394  3920 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:23:55.232635  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.236948  4547 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.238430  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.239634 11159 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:55.239727 11152 raft_consensus.cc:3060] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.241063 11075 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.242233 11143 ts_tablet_manager.cc:1434] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.004s
I20260709 12:23:55.245224 11154 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:55.245445  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.253671  3888 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.258756 11075 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:55.257890 11152 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:55.259989 10900 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:55.222741  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.266219  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 43529.1us
W20260709 12:23:55.271431  3888 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.260430  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.284710 11159 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:23:55.285223 11159 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.285629 11159 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:55.291366  4580 raft_consensus.cc:1217] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 12:23:55.291844  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:23:55.292690  4578 raft_consensus.cc:2393] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 20: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:55.293998  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:55.295235  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.295785  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:23:55.301343  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:55.304173  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.311367  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
W20260709 12:23:55.319350  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.312212  4580 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:55.328970  4579 raft_consensus.cc:2468] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 15.
I20260709 12:23:55.332760  4578 raft_consensus.cc:2468] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:23:55.221608  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.352515 11174 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:55.353571  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 132039us
I20260709 12:23:55.361848  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.363528  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.368940 11167 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.331185 11159 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.372064  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.367611 11174 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:55.375480  4581 raft_consensus.cc:2393] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 25: Already voted for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in this term.
I20260709 12:23:55.379333 11174 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
W20260709 12:23:55.380908  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.381210 11174 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:23:55.388798  4546 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.377169 11159 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:55.392582 10771 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:55.393005 10771 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.393337 10771 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:55.416075 11174 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.408635 10771 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.426378 10771 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:55.413439  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.428819 11163 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:55.429284 11163 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.429718 11163 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:55.431532  3962 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:55.436403  3962 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.439153 11163 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.442422 11167 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:23:55.447876  3889 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.459523 10900 raft_consensus.cc:2804] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:55.459656  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.460150 10900 raft_consensus.cc:697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:55.460258 11075 consensus_queue.cc:1048] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:55.460917  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.461071 10900 consensus_queue.cc:237] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.462006 11075 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:55.462152 11145 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:55.462504 11075 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.462769 11145 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.463028 11075 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:55.463269 11145 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.468851 11168 consensus_queue.cc:1048] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:55.473095  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.478422 11168 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:23:55.479066 11168 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader bd47d64594f743eba2922d79251c1c5c)
I20260709 12:23:55.479579 11168 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:23:55.482887  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.489205 11075 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.489931  3748 catalog_manager.cc:5697] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 17 to 18, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 18 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.496672 11145 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.498643 11075 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:55.455737 11174 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:55.514940  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:23:55.514991  3962 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.515726  3992 raft_consensus.cc:3060] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:23:55.517673 11145 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:55.517935  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.518524  3996 raft_consensus.cc:3060] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:23:55.518932 11168 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.519869  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.520635  3999 raft_consensus.cc:3060] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:55.503163  3888 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.507587  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:55.524395  3920 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 23: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:55.524216  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.525141  3995 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 19: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:55.530184  3888 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:55.531371  3888 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:55.509924 11163 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:55.510542  4008 tablet_copy_service.cc:342] P 32d706e2535f4fa19a09382d4edac677: Request end of tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-88805767597d4bf9bed095ba7d4f4a76 received from {username='slave'} at 127.0.0.1:37296
I20260709 12:23:55.535421  3996 raft_consensus.cc:2468] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 23.
I20260709 12:23:55.536561  4008 tablet_copy_service.cc:434] P 32d706e2535f4fa19a09382d4edac677: ending tablet copy session 328b0b7296c545ff8ea6f7c70f93f2c5-88805767597d4bf9bed095ba7d4f4a76 on tablet 88805767597d4bf9bed095ba7d4f4a76 with peer 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:23:55.543650  3992 raft_consensus.cc:2468] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 25.
I20260709 12:23:55.544359  3999 raft_consensus.cc:2468] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 15.
I20260709 12:23:55.547119 11168 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:55.552667  3964 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.558964 11167 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:23:55.563472 11167 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:55.567384  3964 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.568713 11167 raft_consensus.cc:2804] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:55.571610 11167 raft_consensus.cc:697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:55.582607  3964 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.584554  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.589114 11174 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:23:55.589170 11163 raft_consensus.cc:2804] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:23:55.594720  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:55.599216  3920 raft_consensus.cc:2393] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 19: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:55.600883  4547 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.601688  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.604873 11159 raft_consensus.cc:2804] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:23:55.605103  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:55.605537 11159 raft_consensus.cc:697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:55.605873  3925 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 in current term 16: Already voted for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in this term.
I20260709 12:23:55.606637 11159 consensus_queue.cc:237] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.611524 11167 consensus_queue.cc:237] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.618678 11163 raft_consensus.cc:697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:55.623400 11163 consensus_queue.cc:237] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:55.641168 11075 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.645557  3889 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.660018  3889 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.678159  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.666349 11158 raft_consensus.cc:2804] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:23:55.673554 11145 raft_consensus.cc:2804] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:55.690387  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.690728  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:55.705199  3997 raft_consensus.cc:2393] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 16: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
W20260709 12:23:55.713930  3962 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.682540 11158 raft_consensus.cc:697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:55.685151 11174 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:55.719281  4581 raft_consensus.cc:1275] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:55.725742  3746 catalog_manager.cc:5697] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 24 to 25, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 25 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.727145  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.734396 10771 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.734896  3996 raft_consensus.cc:2393] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in current term 23: Already voted for candidate 32d706e2535f4fa19a09382d4edac677 in this term.
I20260709 12:23:55.735641  3964 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:55.735976  2677 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3871)
I20260709 12:23:55.748582 10771 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:55.780277 11145 raft_consensus.cc:697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
W20260709 12:23:55.765461 11190 log.cc:927] Time spent T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:23:55.792527 10771 consensus_queue.cc:1048] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:55.810886 11145 consensus_queue.cc:237] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:55.811554  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:55.792263 11191 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:55.766589 11158 consensus_queue.cc:237] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:55.850564 11199 raft_consensus.cc:2955] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:55.874704  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 78580us
W20260709 12:23:55.877117  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 126804us
I20260709 12:23:55.878744  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.876261  4579 raft_consensus.cc:2955] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:55.886793 11165 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.888365  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:55.892086  3746 catalog_manager.cc:5697] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 18 to 19, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:55.895856  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 110815us
I20260709 12:23:55.908492  3748 catalog_manager.cc:5697] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:55.920323  3746 catalog_manager.cc:5697] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 15 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.927376  4581 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:55.919685 11192 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:23:55.953819  4578 raft_consensus.cc:1217] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:23:55.973091  3918 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:55.979949  3996 raft_consensus.cc:2955] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.005970 11191 raft_consensus.cc:1064] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:56.028106  3743 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.040467  3746 catalog_manager.cc:5697] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 22 to 23, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 23 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.042472  3746 catalog_manager.cc:5697] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 14 to 15, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 15 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:56.101938  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 75945.4us
I20260709 12:23:56.123705  3992 raft_consensus.cc:1275] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:23:56.146919  4579 raft_consensus.cc:1275] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:23:56.147321 11152 consensus_queue.cc:1048] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:23:56.157963  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.162714  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.164652 11191 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:56.194562  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.194339  3991 consensus_queue.cc:237] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:56.234407 11074 consensus_queue.cc:1048] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:23:56.234872  3991 raft_consensus.cc:1275] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:23:56.245369 10900 consensus_queue.cc:1048] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:56.259636  3918 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:56.262446  4580 raft_consensus.cc:1275] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:56.262936 11074 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:56.289151 11074 consensus_queue.cc:1048] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:56.429118  3991 raft_consensus.cc:1275] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:56.439227 11074 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.457638  4578 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:56.457818  4581 raft_consensus.cc:1275] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:23:56.463080  4581 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.470963 11205 consensus_queue.cc:1048] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:56.471830  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.492904  3923 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:23:56.493768  3993 raft_consensus.cc:1275] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:23:56.508280  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.513976  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:56.516347  3962 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.522676 11216 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:56.523036 11229 consensus_queue.cc:1048] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:23:56.526091 10771 raft_consensus.cc:1064] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: attempting to promote NON_VOTER 328b0b7296c545ff8ea6f7c70f93f2c5 to VOTER
I20260709 12:23:56.530861 11199 consensus_queue.cc:1048] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:56.528884 10771 consensus_queue.cc:237] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:56.551616 11163 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:23:56.575892  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 610ee9fca78e4559ab9cde25d14edade with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:56.592199  3918 raft_consensus.cc:2955] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:56.681257  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.694136  3923 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:56.697041  3746 catalog_manager.cc:5697] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.711686  4574 raft_consensus.cc:1275] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEARNER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:56.711521 11208 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:56.714329 10771 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.720858  3923 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:56.736594  2677 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3871)
I20260709 12:23:56.728446 11208 consensus_queue.cc:1048] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:23:56.743412  4574 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.839284  3746 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 13 to 14, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } attrs { replace: true } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.872251  3992 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:56.885885  3918 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:56.891130  4581 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:23:56.900729 11163 raft_consensus.cc:2955] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:56.912084 11217 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:23:56.913038 11216 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:23:56.913409  3923 raft_consensus.cc:2955] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
W20260709 12:23:56.935003  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 610ee9fca78e4559ab9cde25d14edade: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.007936  4574 raft_consensus.cc:2955] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:57.010803 11217 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:57.031623  4581 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:57.047587  3733 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e029f255cf96482eb49b53e7dc7ed25d with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:57.061329  3746 catalog_manager.cc:5697] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: config changed from index 8 to 9, 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:57.095067  3923 raft_consensus.cc:2955] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } } }
I20260709 12:23:57.108702  3743 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 reported cstate change: config changed from index 14 to 15, VOTER bd47d64594f743eba2922d79251c1c5c (127.2.157.65) evicted. New cstate: current_term: 19 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.144097 11192 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.144824 11192 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.147336 11192 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:57.162020  3888 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.176225  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:57.176991  3992 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:57.186635  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.187503 11145 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:57.187951 11145 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.188341 11145 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:57.227873  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.230973 11145 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:57.262228  3888 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.270380 11197 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.273128 11197 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:57.282279  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:57.282961  3992 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:23:57.284086  4547 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:57.284978 11201 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:23:57.285535 11201 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.285992 11201 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:23:57.287986 11197 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:57.296332  3888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111) [suppressed 421 similar messages]
W20260709 12:23:57.297633  4546 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:57.324277  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.336752 11201 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:23:57.347980 11217 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.348659 11217 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.351126 11217 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:57.352475  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:57.353257  3918 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
I20260709 12:23:57.354887  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:23:57.356976  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.359364 11217 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:57.360067 11217 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.360572 11217 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:57.361303  3962 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.362401 11145 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:57.364488  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:57.365229  3992 raft_consensus.cc:3060] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:23:57.377735  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.378371  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.384479 11201 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:57.387674  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:57.388404  3999 raft_consensus.cc:3060] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:23:57.389351  4546 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.392339 11145 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.392953 11145 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.395998 11145 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:23:57.397553  3999 raft_consensus.cc:2468] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 21.
I20260709 12:23:57.382575 11217 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.399930  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:23:57.408175  3996 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 19.
I20260709 12:23:57.402172 11220 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.409381 11220 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:57.417109  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.426002  3962 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.426784  3992 raft_consensus.cc:2468] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:57.434017 11217 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:57.436539  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:57.439815  3923 raft_consensus.cc:3060] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.437300  4547 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.444038 11113 raft_consensus.cc:2804] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:23:57.444680 11113 raft_consensus.cc:697] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:23:57.445668 11113 consensus_queue.cc:237] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:23:57.454360  3888 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:57.460246  3962 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.468533  3923 raft_consensus.cc:2468] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:57.474889  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.476418 11192 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:23:57.476881 11192 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.477243 11192 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:57.481750  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:57.482611  3924 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 23.
I20260709 12:23:57.507604  3964 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.508838  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.508924 11208 raft_consensus.cc:2804] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:57.509716 11208 raft_consensus.cc:697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:57.509881 11167 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:23:57.510382 11167 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.510706 11208 consensus_queue.cc:237] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.510725 11167 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:57.513731 11220 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:57.511246  3889 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:57.515828  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.521598  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.523947  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.515903 11145 raft_consensus.cc:2804] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:57.523052 11192 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.525008 11145 raft_consensus.cc:697] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:57.554134 11216 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.554751 11216 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.561960 11216 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:23:57.565101 11145 consensus_queue.cc:237] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.562983 11167 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.568307 11167 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:57.570852  3962 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:57.572782  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.590510  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 50155.6us
W20260709 12:23:57.593869  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 48840us
I20260709 12:23:57.606531 11192 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:23:57.611876  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.612442  3962 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:57.624832  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:57.624684  3743 catalog_manager.cc:5697] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 19 to 21, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 21 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.633955  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:23:57.637763  3918 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 16.
W20260709 12:23:57.643261  3888 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:57.653155  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.652398  3746 catalog_manager.cc:5697] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 17, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 17 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.659013  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:23:57.659994  3996 raft_consensus.cc:3060] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:23:57.660581  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:57.661266  3918 raft_consensus.cc:3060] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:23:57.689273  3996 raft_consensus.cc:2468] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 20.
I20260709 12:23:57.689723  3918 raft_consensus.cc:2468] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 24.
W20260709 12:23:57.706306  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.709379  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:57.709955  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:57.709787  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.709673  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46825.7us
I20260709 12:23:57.718679  3889 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
I20260709 12:23:57.719301  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:57.721221  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.722998  3964 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: bd47d64594f743eba2922d79251c1c5c
W20260709 12:23:57.737237  2677 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3871)
I20260709 12:23:57.730887  3748 catalog_manager.cc:5697] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 18 to 20, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 20 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.723045 11208 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:57.741482 11208 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.741935 11208 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.722852 11253 raft_consensus.cc:2804] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:23:57.747889 11253 raft_consensus.cc:697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:23:57.748958 11253 consensus_queue.cc:237] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:23:57.728014 11252 raft_consensus.cc:2804] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:23:57.772620 11252 raft_consensus.cc:697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 24 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:57.773749 11252 consensus_queue.cc:237] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:57.782070  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.782461  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.782840  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 50743.4us
W20260709 12:23:57.795300  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.822758  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.825583  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.826231 11208 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:57.848662  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.849646  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.859414  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:23:57.860332  3918 raft_consensus.cc:3060] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.864964  3993 raft_consensus.cc:1275] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:23:57.867514  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.870296 11201 consensus_queue.cc:1048] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:23:57.875571  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.886106  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:57.886485  3918 raft_consensus.cc:2468] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 17.
I20260709 12:23:57.888164  3964 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:23:57.889266 11208 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: Requested vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:23:57.893906  3962 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:57.896153 11258 raft_consensus.cc:2804] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:57.898504 11258 raft_consensus.cc:697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:23:57.907866 11258 consensus_queue.cc:237] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:23:57.933429  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:57.940178  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:58.093241  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:58.110742  3746 catalog_manager.cc:5697] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 18 to 20, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66). New cstate: current_term: 20 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:58.144282  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:58.155807  3747 catalog_manager.cc:5697] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 22 to 24, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 24 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.158617  3747 catalog_manager.cc:5697] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 15 to 17, leader changed from bd47d64594f743eba2922d79251c1c5c (127.2.157.65) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 17 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:58.183600  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:58.184260  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:58.203259  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:58.257772  3923 raft_consensus.cc:1275] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:23:58.282706  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 610ee9fca78e4559ab9cde25d14edade: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:23:58.296087  3996 raft_consensus.cc:1275] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:23:58.296249 11256 consensus_queue.cc:1048] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:58.297963  3997 raft_consensus.cc:1275] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:23:58.323719 11145 consensus_queue.cc:1048] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:58.332196 11145 consensus_queue.cc:1048] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:58.407521  3924 raft_consensus.cc:1275] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:23:58.433701 11258 consensus_queue.cc:1048] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:23:58.366261  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:58.454386  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:58.448742  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 82527.6us
W20260709 12:23:58.499521  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.504441 11270 log.cc:927] Time spent T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:23:58.522965  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:58.532239  3924 raft_consensus.cc:1275] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:58.534789 11251 consensus_queue.cc:1048] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:58.561033  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 81593.4us
W20260709 12:23:58.662492  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:58.669622  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:58.737967  2677 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3871)
W20260709 12:23:58.738304  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.775763  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.852362  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.901749  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:58.987689  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.317243  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:59.364718  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 610ee9fca78e4559ab9cde25d14edade: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:23:59.676987  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.683394  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.738548  2677 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3871)
W20260709 12:23:59.760213  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.789922  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.827193  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.919242  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:59.920454  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.124361  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:00.130764  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.131193  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.167435  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.189134  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.191057  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.192715  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:00.221154  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.241847  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.250201  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.274188  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.321060  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.363643  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:00.396790  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:00.402194  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.422426  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.481271  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:00.499459  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.656849  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.660048  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.698720  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.704172  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.739116  2677 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:00.757694  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:00.767860  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:00.770287  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.775157  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.778687  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:00.785820  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:00.799278  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.800575  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:00.811111  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.827678  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.852769  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:00.934717  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:01.099856  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.337200  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.390759  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.442337  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.499871  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 610ee9fca78e4559ab9cde25d14edade: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:01.531158  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:01.740396  2677 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:02.006969  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:02.131202  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.218103  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.296825  3962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111) [suppressed 470 similar messages]
W20260709 12:24:02.303105  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.365482  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.407480  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.431556  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.435734  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.507841  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.518916  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.599296  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:02.659610  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.712769  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.741189  2677 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:02.748802  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:02.749423  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.763669  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:02.819818  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.820688  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.833350  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 46489.6us
W20260709 12:24:02.872401  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:02.887997  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.889549  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.914507  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.951563  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:02.955688  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:02.995256  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:02.995348  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:03.027129  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.027932  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:03.048996  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.051328  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.058588  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.109484  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.114037  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.128365  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.141134  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:03.155023  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.163270  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.163955  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.204205  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.253736  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:03.445384  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:03.464335  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:03.741763  2677 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:03.797209  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:03.801025  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:03.841146  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:03.874394  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 68619.7us
W20260709 12:24:03.973233  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:04.074244  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:04.490196  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:04.588749  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.607765  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.720764  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.728269  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 51186.3us
W20260709 12:24:04.742329  2677 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:04.839572  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.907423  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.919564  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:04.989114  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:05.135577  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:05.142506  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:05.148413  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:05.154816  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:05.212412  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:05.215531  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:05.240505  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:05.248800  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:05.270951  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:05.742918  2677 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:06.501904  3732 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 264725us
W20260709 12:24:06.505398  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 610ee9fca78e4559ab9cde25d14edade: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:06.520985  4549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.021s	sys 0.005s
W20260709 12:24:06.521816  4549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.021s	sys 0.005s
I20260709 12:24:06.541239 11287 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.549974 11287 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.555488 11319 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.556255 11319 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.556881 11287 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:06.559823  3891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.008s	sys 0.026s
W20260709 12:24:06.562153  3891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.010s	sys 0.027s
I20260709 12:24:06.566840 11319 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.573278 11321 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.574081 11321 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.575836 11323 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.576471 11323 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.576857 11321 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.577435 11307 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.577998 11307 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.578732 11323 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.580111 11307 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.582039 11325 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.582645 11325 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.585032 11325 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.586434 11325 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.586959 11325 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.589133 11325 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.630801 11324 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.631587 11324 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.634011 11324 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.634546 11324 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.635103 11324 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.663389 11287 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.664064 11287 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.664438 11324 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.666543 11287 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.667977 11324 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.668735 11312 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.668627 11324 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.669271 11312 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.670782 11324 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.671348 11312 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.675029 11325 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.676065 11312 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.675824 11325 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.676644 11312 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.678150 11325 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.678673 11325 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.679235 11312 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.679108 11325 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.681980 11325 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.688192 11318 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.688802 11318 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.689102 11329 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.689880 11329 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.691071 11318 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.692732 11329 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.706233 11317 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.717437 11317 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.719995 11317 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.703357 11320 raft_consensus.cc:493] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.722177 11320 raft_consensus.cc:515] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.726785 11320 leader_election.cc:290] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.733073 11326 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.714430  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.734028 11278 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.707932 11325 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.715360  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.752549 11325 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.709952 11327 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.737497 11317 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.754671 11317 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.755038 11325 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.716125  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.710566 11328 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.739504 11332 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.746039 11318 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.761425 11325 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.761485 11318 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:24:06.762253  2677 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 3871)
I20260709 12:24:06.762073 11325 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.764374 11333 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.764911 11325 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.766018  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.716704 11329 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.708608 11287 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.776281 11287 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.779141 11287 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.752130 11326 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.708395 11306 raft_consensus.cc:493] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:06.711220 11312 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.756783  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.754253 11327 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.759001 11332 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.760015 11317 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.759754 11328 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.757539 11278 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.711512 11324 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.780293  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.800115 11287 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.806051 11331 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.811372 11278 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.812577 11287 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.765137 11333 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.819325 11278 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.820904 11287 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.808115 11318 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.822049 11278 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.812652 11312 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.825908 11312 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.809000 11306 raft_consensus.cc:515] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.816382 11325 raft_consensus.cc:493] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:24:06.821134  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 59180.6us
I20260709 12:24:06.827776 11325 raft_consensus.cc:515] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.829653 11306 leader_election.cc:290] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.829782  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.816820 11324 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.830495  4574 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:24:06.831373 11307 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.809265 11320 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.809535 11329 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.836449  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf551f0b2a843aa8a6b0ebdf7ba8fef" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.837512 11329 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.837709 11326 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.840212 11278 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.827157 11333 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.846443  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.831990 11307 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.846952 11326 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:06.865911 11326 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:06.866865 11307 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.868157 11326 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:06.848006  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:06.849511 11327 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.816179 11331 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.829950 11325 leader_election.cc:290] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.850903 11332 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:06.857481  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:06.832099 11324 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:06.847142 11328 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:06.843855 11320 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:06.985927 11330 raft_consensus.cc:493] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.345203 11330 raft_consensus.cc:515] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.346494 11320 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:06.991420  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 152614us
W20260709 12:24:07.347707  3888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111) [suppressed 301 similar messages]
I20260709 12:24:07.347795 11342 raft_consensus.cc:493] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.065045 11340 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.349690 11340 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.068780 11341 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:24:07.191121  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 343128us
I20260709 12:24:07.286499  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58188a85c5c940b2a6a6d9e2640f3b18" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:06.843180 11318 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:06.840128 11312 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:07.302266 11331 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:07.305478  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.306155  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96631b804304cddb7995664610e592d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.306522  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271f08ec28384c99b6dd3fb41fb92ebf" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.306701  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.307371  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.311537  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.318259  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.322425  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.323137  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.323839 11317 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.324687  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.357595 11317 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.330232  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.358174  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.330675 11325 raft_consensus.cc:493] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.359366  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.359402 11325 raft_consensus.cc:515] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.360095 11336 raft_consensus.cc:493] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:07.354825 11318 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.360863 11336 raft_consensus.cc:515] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.361845 11325 leader_election.cc:290] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:07.362498 11318 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:07.042552 11337 raft_consensus.cc:493] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.356077  3919 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 12.
I20260709 12:24:07.352761 11341 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.321547  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.354139 11312 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.365724 11337 raft_consensus.cc:515] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.367096 11312 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:07.360138  3992 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:24:07.359928 11317 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:07.353539 11342 raft_consensus.cc:515] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.369712  3990 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 11.
I20260709 12:24:07.350698 11330 leader_election.cc:290] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:07.351888 11320 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:07.387769  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.382684  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a62c46cea46f2b2e381471e7e080c" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.363025 11336 leader_election.cc:290] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:07.363883 11331 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.402405  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.391139 11325 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.408113 11325 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:07.410171  4605 debug-util.cc:398] Leaking SignalData structure 0x7b0800132980 after lost signal to thread 2680
I20260709 12:24:07.410454 11325 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.411504  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08001c85a0 after lost signal to thread 3782
I20260709 12:24:07.411978 11340 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.412994  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08003ddd20 after lost signal to thread 3949
I20260709 12:24:07.413522 11342 leader_election.cc:290] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.414250  4605 debug-util.cc:398] Leaking SignalData structure 0x7b080028b280 after lost signal to thread 4023
I20260709 12:24:07.414479 11341 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:07.416551 11318 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:07.417102 11318 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.393210 11320 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.421587 11320 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:07.402644 11331 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.424152 11331 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:07.424887 11337 leader_election.cc:290] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.425094  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08001173e0 after lost signal to thread 4608
I20260709 12:24:07.452104  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7012fd3393d4b19bd0d25e82fc612df" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.419272 11318 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:07.463618  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.471462  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.474754  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.481654  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.479067 11343 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:07.496963 11343 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.499155 11343 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:07.479912 11336 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:07.512794  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.513269 11336 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:07.518536 11332 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.519122 11332 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.521822 11332 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.522861  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.530360  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a66f6f6f296148d9b3b0931f1c94d49a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.524721 11336 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:07.528888  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:07.542276  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.542984  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.543279  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.543721  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.544294  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.546062  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a206840e1648aeb4571019fa4ca639" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.548295  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.548569  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88805767597d4bf9bed095ba7d4f4a76" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.548918  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.549233  3919 raft_consensus.cc:2468] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 13.
I20260709 12:24:07.549602  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eac049e3fe41bf98d28d3d572dcb8a" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.549609  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.552204  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:24:07.537089  4546 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.555725  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.557257  4546 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.557766  4546 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.558238  4546 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.560792  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.567935  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125588992e20455d8e0b267fb10d24a7" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:24:07.569041  4546 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.569371  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9cb9cc431d048dd8cfea736da6af5fa" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:24:07.569711  4546 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.570215  4546 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.574054  4546 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.574640  4546 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.575130  4546 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.575623  4546 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.576313  4546 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.577204  4546 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.580295  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.580716  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.581635  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.582131  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d019c5856041bca1afab26bbc6c7a6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.583031  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.592335  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.595854  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4bdec26d3e4879bd33a92daad5d607" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:24:07.611308  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:07.612061  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.612555  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.613154  3888 leader_election.cc:336] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.614086  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.624472  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.631789  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:24:07.632750 11343 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:07.633183 11343 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:07.633637 11343 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:07.635294  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.636327  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.638213  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.641157  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.651909  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918f90de47bb48d493e4dd0737810b63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.652257  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68343b8d5be4269b4b588c1b34d01e0" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.653574  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a29f44dfd3d24dccaa224167c983a5a4" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.653712  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2900e71c0212466e8be300d30595c609" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:07.663815  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.665078 11336 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.665809  3889 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.666736 11338 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.667598  4547 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.668617 11324 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.670574  4547 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.671694  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 116936us
I20260709 12:24:07.672494  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.673735  4547 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.674849  4547 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.683688 11312 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:07.684520 11327 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:07.684746  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 71604us
W20260709 12:24:07.685325  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.685595 11324 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:07.685858  3888 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.686347  3888 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.686769  3888 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.687222  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.687822  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:07.688274  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.688702  3888 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.689210  3888 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.689657  3888 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.690022  3888 leader_election.cc:336] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.690306  3888 leader_election.cc:304] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.692939 11336 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.693099 11312 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.696874  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.697912  3888 leader_election.cc:336] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.698452  3888 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.699070  3888 leader_election.cc:336] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.699491  3888 leader_election.cc:304] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.700030  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:24:07.700594  3888 leader_election.cc:336] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.701076 11338 raft_consensus.cc:2749] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:07.701889 11338 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:07.703025  3889 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.702968 11343 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.703922 11338 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:24:07.704206  3997 raft_consensus.cc:1240] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Rejecting Update request from peer 328b0b7296c545ff8ea6f7c70f93f2c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:07.698583 11325 raft_consensus.cc:2749] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.705127  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.705952 11325 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:07.707507  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.708389  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.708912  3962 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.709374  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.710125  4547 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.708055 11312 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:07.724624 11312 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:07.725055 11312 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:07.725389 11343 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:07.725940  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:07.730103  3962 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:07.719826  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 103059us
I20260709 12:24:07.732520  4548 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.733354 11327 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.734323  4548 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:24:07.723508  3888 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.723945  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.735342 11338 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:24:07.723356  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 81230us
I20260709 12:24:07.736434 11327 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.736948  4547 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.737329  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.748250 11324 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:07.748888  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.749562  4547 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.750154  3889 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.751078 11325 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:07.751811 11325 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.752544 11325 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:07.753437 11324 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:07.757210 11327 consensus_queue.cc:1059] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:07.758574 11324 raft_consensus.cc:3055] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:07.758812  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:24:07.737478  3888 leader_election.cc:336] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.738258 11352 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.760327 11328 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:07.760903  3890 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.761623  3889 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.762678  2677 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 3871)
I20260709 12:24:07.762593  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.759039 11324 raft_consensus.cc:740] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
I20260709 12:24:07.739212  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.767050 11352 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:07.767645 11328 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:07.768508  4548 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.769325 11352 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:07.770707  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.730612  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.772044 11352 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:07.772169 11324 consensus_queue.cc:260] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.773571  4548 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.773927 11324 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:07.774422 11352 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.775656 11343 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:07.776253  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.776603  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 46543.3us
I20260709 12:24:07.777437 11312 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:07.777192  3962 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.778987  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.779206  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.779645 11352 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.779767 11343 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:07.780912  3962 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.781502 11338 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:07.782368  3889 leader_election.cc:304] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.782577  3962 leader_election.cc:336] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.783171 11325 raft_consensus.cc:2749] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.783622  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.784364 11325 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:07.784816  3889 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.785557 11325 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.786275  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.787078 11325 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:07.788719  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.791936  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.794899  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.796506  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba989d98d508441a9e56717e49c9004d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:07.802847 11312 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:07.786669  3962 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.803546  3889 leader_election.cc:304] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.803926  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.804450  3962 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.804981 11328 raft_consensus.cc:2749] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:07.804925  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:24:07.808780  3889 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.808852  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:24:07.811074  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:07.811894 11343 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:07.815095  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.817180 11328 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.820535  3964 leader_election.cc:304] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.821429 11343 raft_consensus.cc:2749] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:24:07.827037  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:24:07.827742  3962 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.828338  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.829463  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:24:07.829730 11343 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:07.830109  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.830650  3962 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.836304  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.837237 11328 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:07.840412  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.841234 11341 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:07.843721  3964 leader_election.cc:304] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:07.831063  3962 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.854846  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:07.855839 11352 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.865592 11341 raft_consensus.cc:2749] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.865731 11343 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:07.861586  4580 raft_consensus.cc:2468] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
W20260709 12:24:07.867065  3962 leader_election.cc:336] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.867607  3962 leader_election.cc:304] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.868459 11343 raft_consensus.cc:2749] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:07.869623  3962 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.870106  3962 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.872385 11343 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:07.873472  3962 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.873986  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.876530  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:07.878348  4020 debug-util.cc:398] Leaking SignalData structure 0x7b080024b3a0 after lost signal to thread 2680
W20260709 12:24:07.879678  4020 debug-util.cc:398] Leaking SignalData structure 0x7b080038d3c0 after lost signal to thread 3782
W20260709 12:24:07.880297  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08000cabc0 after lost signal to thread 3891
W20260709 12:24:07.881356  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7220 after lost signal to thread 3949
W20260709 12:24:07.882548  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08001889c0 after lost signal to thread 4023
W20260709 12:24:07.883944  4020 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6d00 after lost signal to thread 4608
I20260709 12:24:07.887732 11343 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:07.893749  3962 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:07.894325  3962 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.895180 11343 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:07.896416  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.897120  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.897353  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "108e3004fd4341f78b24caefdf2ef63f" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.898305  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.898555  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.900058  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.900254  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.904917  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1565e90e2094af9b0891393186e41da" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:24:07.907796  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:07.931314  3964 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
W20260709 12:24:07.934511  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:07.944919  3964 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:07.946911  3964 leader_election.cc:304] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:07.942862 11341 raft_consensus.cc:2804] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:07.950834 11341 raft_consensus.cc:697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:24:07.950376 11344 raft_consensus.cc:2749] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.951889 11341 consensus_queue.cc:237] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:07.954955  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:07.968897 11347 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:07.970795  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:07.949724 11343 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:07.977468 11347 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:07.979799  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:07.996917  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:08.005367 11347 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:08.008420  3964 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:08.009389 11347 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:08.032063  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:08.033418 11347 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:08.051193  3746 catalog_manager.cc:5697] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 12 to 13, leader changed from 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 13 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.084900  4577 raft_consensus.cc:1240] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Rejecting Update request from peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:08.086918 11354 consensus_queue.cc:1059] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:08.088099 11354 raft_consensus.cc:3055] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:08.088716 11354 raft_consensus.cc:740] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:24:08.089658 11354 consensus_queue.cc:260] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:08.091044 11354 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:08.123921 11356 log.cc:927] Time spent T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:24:08.231956  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:24:08.277171  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:08.467272  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:08.468032  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:08.530689  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:08.546882  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:08.573336  3918 raft_consensus.cc:3060] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:08.576325  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:08.596479  4577 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:08.612254 11343 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:08.610993  3918 raft_consensus.cc:1275] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:08.645231 11343 consensus_queue.cc:1048] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:24:08.763722  2677 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:08.815260  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:08.961517  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 101902us
W20260709 12:24:09.082075  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.106093  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.106917  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.149505  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.161644  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.238669  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:09.296046 11354 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.299883 11354 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:09.304049  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:09.311275  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:09.312288  4577 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 12.
I20260709 12:24:09.314615  3890 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:24:09.315829 11328 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:09.316253 11328 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:09.316605 11328 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.337188 11328 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:09.308952  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:09.338364 11354 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:09.344638  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 51395.5us
W20260709 12:24:09.442675  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:09.486073  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:24:09.486799  4577 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.498418  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:09.500348 11328 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Requested vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:09.511365  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
W20260709 12:24:09.515653  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:09.524566  4577 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146eb0cb8a2f4846ae6ef2b8758dd6a6 in term 13.
I20260709 12:24:09.562668 11317 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:09.563624 11317 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:09.565992 11317 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:09.576269  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:09.582111  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:24:09.606750  3890 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:24:09.620059 11336 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:09.620683 11336 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Becoming Leader. State: Replica: 146eb0cb8a2f4846ae6ef2b8758dd6a6, State: Running, Role: LEADER
I20260709 12:24:09.621790 11336 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:09.687137  3746 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:09.688709  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 89921.4us
W20260709 12:24:09.668607  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 46913.6us
W20260709 12:24:09.695545  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:09.722791  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:09.723815  4580 raft_consensus.cc:2368] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:24:09.744776  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:24:09.764264  2677 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:09.768801  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.771327  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:09.774953  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.779623  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:09.796944  3964 leader_election.cc:400] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
I20260709 12:24:09.797528  3964 leader_election.cc:403] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:09.798396 11342 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:24:09.809540 11342 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173) with higher term. Message: Invalid argument: T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32d706e2535f4fa19a09382d4edac677 for earlier term 12. Current term is 13.
W20260709 12:24:09.811247  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:09.834949  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.840209  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.891544  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.935961  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.951116  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.953480  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.963685  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:09.989686  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:10.010088  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:10.014518  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:10.015193  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:10.764892  2677 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 3871)
I20260709 12:24:11.025547  4574 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:11.036887 11395 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:11.041721 11393 raft_consensus.cc:493] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.042436 11393 raft_consensus.cc:515] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.046731 11393 leader_election.cc:290] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.055933 11393 raft_consensus.cc:493] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.056604 11393 raft_consensus.cc:515] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.059201 11393 leader_election.cc:290] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.060670  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.238976 11393 raft_consensus.cc:493] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.240597 11341 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.240996 11393 raft_consensus.cc:515] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.241251 11341 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.237207 11336 raft_consensus.cc:493] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.257169 11396 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.257529 11400 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.258028 11396 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.258208 11400 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.260627 11400 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.261152 11395 raft_consensus.cc:493] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:24:11.280179  4546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 48375.3us
I20260709 12:24:11.262461 11394 raft_consensus.cc:493] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.261822 11391 raft_consensus.cc:493] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.239840 11343 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.243521 11341 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.304775 11328 raft_consensus.cc:493] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.305476 11328 raft_consensus.cc:515] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.261652 11397 raft_consensus.cc:493] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.311329 11397 raft_consensus.cc:515] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.281981 11395 raft_consensus.cc:515] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.280421 11400 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.290161 11342 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.291123 11317 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.303853 11399 raft_consensus.cc:493] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.303967 11343 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.282335 11336 raft_consensus.cc:515] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.300176 11393 leader_election.cc:290] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:11.325999  3779 debug-util.cc:398] Leaking SignalData structure 0x7b080000b620 after lost signal to thread 2680
W20260709 12:24:11.340197  3779 debug-util.cc:398] Leaking SignalData structure 0x7b0800283760 after lost signal to thread 3782
I20260709 12:24:11.325219 11342 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.314147 11391 raft_consensus.cc:515] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.334869 11393 raft_consensus.cc:493] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.326582 11400 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.341405 11328 leader_election.cc:290] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.374965 11391 leader_election.cc:290] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.375510 11396 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.314347 11394 raft_consensus.cc:515] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.327499 11317 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.385823  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.388559 11392 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.389086 11397 leader_election.cc:290] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.333591 11399 raft_consensus.cc:515] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.390838 11410 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.386044 11393 raft_consensus.cc:515] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.421751 11392 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.424403 11406 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.425027 11406 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.426788 11399 leader_election.cc:290] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:11.428184  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:11.429854 11394 leader_election.cc:290] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.432915 11410 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.419502 11328 raft_consensus.cc:493] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.434089 11328 raft_consensus.cc:515] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.425335 11380 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.469686 11396 raft_consensus.cc:493] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.472255 11342 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.469354 11374 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.475247 11336 leader_election.cc:290] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.472440  3920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.475586 11374 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.476541  3920 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:24:11.469069 11397 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.471925  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfc9dfe4d724180a29bd9c8bf9e16d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.474848 11396 raft_consensus.cc:515] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.461633 11343 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.477643 11397 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.468765 11392 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.480082 11396 leader_election.cc:290] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:11.471946  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08001297e0 after lost signal to thread 3949
W20260709 12:24:11.481712  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7480 after lost signal to thread 4023
W20260709 12:24:11.482352  3888 leader_election.cc:336] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.435370 11410 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.481724  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:24:11.483011  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8540 after lost signal to thread 4608
W20260709 12:24:11.488057  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8420 after lost signal to thread 11352
W20260709 12:24:11.488402  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce520 after lost signal to thread 11362
W20260709 12:24:11.488642  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3600 after lost signal to thread 11363
W20260709 12:24:11.488868  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9280 after lost signal to thread 11372
W20260709 12:24:11.489146  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc520 after lost signal to thread 11378
W20260709 12:24:11.489427  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9aa0 after lost signal to thread 11379
W20260709 12:24:11.489718  3779 debug-util.cc:398] Leaking SignalData structure 0x7b08002782c0 after lost signal to thread 11385
I20260709 12:24:11.478099 11374 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.432909 11317 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.436235 11328 leader_election.cc:290] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.483762 11395 leader_election.cc:290] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.485112 11397 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.511718  4548 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
I20260709 12:24:11.512766 11382 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:11.513190 11382 raft_consensus.cc:493] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.513600 11382 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:11.437536 11393 leader_election.cc:290] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.454260 11406 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.518375 11397 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.532709 11397 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.534976 11397 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.521948 11395 raft_consensus.cc:493] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 328b0b7296c545ff8ea6f7c70f93f2c5)
I20260709 12:24:11.535738 11395 raft_consensus.cc:515] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.537955 11395 leader_election.cc:290] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.524539 11374 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.539215 11374 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.435812 11413 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.518836 11380 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:11.519654  3888 leader_election.cc:336] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.442354 11400 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.544597 11374 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.545190 11413 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.552342  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3bacd87db564c3ba5256af726514f84" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.553294 11416 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.553844 11416 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:11.554782  4546 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.555891 11413 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.556505  4548 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.558151 11376 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.556548 11403 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:24:11.559785  3890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 221130us
I20260709 12:24:11.559222 11403 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.561947 11410 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.562547 11403 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.562562 11410 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.567530  3991 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Refusing update from remote peer 146eb0cb8a2f4846ae6ef2b8758dd6a6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:11.574437 11317 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.576190 11317 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.577028 11416 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.578353 11317 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:11.578624 11410 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:11.545231 11380 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:11.582022  4546 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.587950 11382 raft_consensus.cc:515] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.593282 11382 leader_election.cc:290] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.573904  3890 leader_election.cc:304] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.601948 11415 raft_consensus.cc:2749] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:11.614662  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.618078  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.619051  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b1a4f620064a52bb4a2fb284f00276" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.619696 11393 raft_consensus.cc:493] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.619246  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63ac059d92404e2aa8792e1c5b02ae88" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.620134  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6"
I20260709 12:24:11.622488  3916 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:11.620270 11393 raft_consensus.cc:515] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.626466  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:24:11.624157  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 109513us
I20260709 12:24:11.628954  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd5ceb511e74bc7a94d43444ea1d35e" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.629166 11393 leader_election.cc:290] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.630774 11395 raft_consensus.cc:493] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:11.631251  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e693a63f62764df9a01acfa82fed09e8" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.638021 11395 raft_consensus.cc:515] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.639921  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc6b8b0d8114762a0c8cec5e5461a82" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.640508 11395 leader_election.cc:290] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:11.642997  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abd4286feba432697849b5bcf582f63" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.644776  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8842b18207e4c90a92bd153fe9d059e" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.645936  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de00ab7bf84d57b73f50c0d7c07565" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.648057  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba6f4e278ba4a6daa236e0b38b36cc0" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.650902  3916 raft_consensus.cc:2468] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 20.
I20260709 12:24:11.652068  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:24:11.654933  3888 leader_election.cc:336] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.655252  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.656538  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:11.666034  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25c2d062dfa4db8852d794adc28cdf2" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.717911  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677"
I20260709 12:24:11.719017  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7265897ebd4e4f6ba4330aca29c74838" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.720126  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61667a526f478f888a20a9619a1e2b" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.666353  3994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f255cf96482eb49b53e7dc7ed25d" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.666909  3990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a268ae9485472a8208827344502203" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.668828  3996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b32e0bc8a63482a89916840eae42f8a" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.669595  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565a1813fc6b4a21aa0897f0624b5122" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.669865  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c0e62036464a72858695d542f42a18" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.726392  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc1f0da5d664bee8661e3dbace70630" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.727803  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.729142  3917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.670297  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99966b4924ae49f889200899350931bb" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.731220  3920 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:11.671236  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc77961701c41028cd54ea83719dae9" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.671840  3991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f370e99c95594dc19f98fb403380e06c" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.672708  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ee9fca78e4559ab9cde25d14edade" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.676110  3993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfad3fb2927f45958c4a0cf0768a8b53" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.678365  3918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce77a1e41f7b43cc965d6fd6976759cd" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.679080 11410 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:11.679778  3919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cac50f4de4720ab08d1d1e49d71b5" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.681320  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56a5b44f8f3e46ae9582b9f86d191610" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.734573 11410 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:11.688088  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c325a58070740f29bc40a3a22e2b61d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.689601  3921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7469adb046a64b1b9311cea78d13a0e6" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.696028  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef64c2ac9444d6983c225484fccfda" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
I20260709 12:24:11.696111  3992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac719796849e490f935d71c2a43cd7d6" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
W20260709 12:24:11.687225  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:11.715952  3888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 61074.5us
I20260709 12:24:11.737272 11410 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:11.746649  3888 leader_election.cc:336] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.746884 11395 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:11.737248  4548 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 
W20260709 12:24:11.747687  3888 leader_election.cc:336] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.748333  3888 leader_election.cc:336] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.748744 11408 raft_consensus.cc:2804] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:11.748831  3888 leader_election.cc:304] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.749429 11408 raft_consensus.cc:697] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Becoming Leader. State: Replica: 328b0b7296c545ff8ea6f7c70f93f2c5, State: Running, Role: LEADER
W20260709 12:24:11.749588  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 62433us
I20260709 12:24:11.751084  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:24:11.752115  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:11.753237  3962 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.751016 11408 consensus_queue.cc:237] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.754150  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
W20260709 12:24:11.754705  3962 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.755281  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:11.756147  3962 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.757017 11395 raft_consensus.cc:2749] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:11.757369  3962 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.757041  3888 leader_election.cc:336] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.758512  3888 leader_election.cc:304] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:11.759783  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:11.760286  3888 leader_election.cc:336] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.760917  3888 leader_election.cc:336] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.758077  3962 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.764266  3962 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.764880  3962 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.762708 11395 raft_consensus.cc:2749] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:11.765527  2677 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 3871)
I20260709 12:24:11.765851  3964 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.771818 11416 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.767700  3889 leader_election.cc:304] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.773973 11393 raft_consensus.cc:2749] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:24:11.775008  3962 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.775714  3962 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.776604  3964 leader_election.cc:304] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:11.780849 11416 raft_consensus.cc:2749] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:11.778131  3889 leader_election.cc:304] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
W20260709 12:24:11.785894  3962 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.790103  3962 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.791344  3962 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:11.791957  3962 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.789253  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.794353 11416 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:11.793295  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:11.794955  4583 raft_consensus.cc:1240] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Rejecting Update request from peer 32d706e2535f4fa19a09382d4edac677 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:11.795675  3889 leader_election.cc:304] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.796433  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:11.797075  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:11.795001 11393 raft_consensus.cc:2749] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:11.801054  3962 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.801299 11416 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:11.803699 11393 raft_consensus.cc:2749] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:11.814451  3747 catalog_manager.cc:5697] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 reported cstate change: term changed from 19 to 20, leader changed from 32d706e2535f4fa19a09382d4edac677 (127.2.157.67) to 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68). New cstate: current_term: 20 leader_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.816587  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.818625 11410 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.823505 11416 consensus_queue.cc:1059] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:11.824363 11416 consensus_queue.cc:1243] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Peer 328b0b7296c545ff8ea6f7c70f93f2c5 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:24:11.824873 11416 raft_consensus.cc:3055] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:11.825199 11416 raft_consensus.cc:740] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:24:11.826143  3889 leader_election.cc:304] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.826437 11416 consensus_queue.cc:260] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:11.827381  4547 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.827811 11416 raft_consensus.cc:3060] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:11.827888 11393 raft_consensus.cc:2749] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:11.828248 11408 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:11.829141  3889 leader_election.cc:304] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.830847 11395 raft_consensus.cc:2749] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:11.833323  3888 leader_election.cc:336] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.840608  3888 leader_election.cc:304] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:11.841722  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:11.841746 11415 raft_consensus.cc:2749] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:24:11.834129  3889 leader_election.cc:304] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:11.842453  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:11.843019  3888 leader_election.cc:336] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:11.845288 11415 raft_consensus.cc:2749] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.843662  3889 leader_election.cc:304] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.850926 11415 raft_consensus.cc:2749] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:11.850584  3889 leader_election.cc:304] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.851913  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138b76e837f84a518585fccdcf9ff6d4" candidate_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:11.854312 11393 raft_consensus.cc:2749] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:11.856016  3889 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.856882 11393 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:11.858234  3889 leader_election.cc:304] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.859766 11393 raft_consensus.cc:2749] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:11.862613  3964 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.862700  3889 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.865967 11393 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.866446 11410 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:11.867575  3889 leader_election.cc:304] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.868477  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.868636 11393 raft_consensus.cc:2749] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:11.870960 11416 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:11.872439  3889 leader_election.cc:304] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:11.874735 11415 raft_consensus.cc:2749] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:11.880640  3916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63cbbf40cb084518a89acf7f7026e77b" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" is_pre_election: true
W20260709 12:24:11.892470  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:24:11.913558  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 328b0b7296c545ff8ea6f7c70f93f2c5
I20260709 12:24:11.914651 11416 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:11.916329  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.925520 11416 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:11.940284  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.941772  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.942422 11416 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:11.944101  3964 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.944711 11416 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:11.946000 11416 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:11.967882  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.970042  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.970916 11416 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:11.979434  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:11.979167 11317 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:12.002919 11392 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:12.003038  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:12.011904 11410 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:12.032194  3889 leader_election.cc:304] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:12.034242 11418 raft_consensus.cc:2749] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:12.060498  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:24:12.136713  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:12.154415  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:12.292449  3921 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:12.294246 11403 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:24:12.299665  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:12.355563  4546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111) [suppressed 422 similar messages]
W20260709 12:24:12.367079  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:12.376976  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:12.377548  3992 raft_consensus.cc:1275] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Refusing update from remote peer 328b0b7296c545ff8ea6f7c70f93f2c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:12.382079 11382 consensus_queue.cc:1048] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:24:12.418718  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:12.453672  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.464375  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:12.656409  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:38173, user_credentials={real_user=slave}} blocked reactor thread for 43666.9us
W20260709 12:24:12.664896  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.728013  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.765961  2677 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:12.889389  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:12.891417  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.908090  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.913038  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.913575  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:12.914089  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:12.915699  3888 consensus_peers.cc:597] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:12.916160  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:12.959057  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.133281  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:13.134799  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:13.191373  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.199894  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.262899  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.322136  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:13.356586  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:13.387663  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.413942  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:13.450699  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.555684  3888 consensus_peers.cc:597] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:13.556273  3888 consensus_peers.cc:597] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.560770  3888 consensus_peers.cc:597] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.602406  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.640831  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:13.734462  3946 debug-util.cc:398] Leaking SignalData structure 0x7b0800205e40 after lost signal to thread 2680
W20260709 12:24:13.735670  3946 debug-util.cc:398] Leaking SignalData structure 0x7b0800351580 after lost signal to thread 3782
W20260709 12:24:13.737004  3946 debug-util.cc:398] Leaking SignalData structure 0x7b0800169b00 after lost signal to thread 3949
W20260709 12:24:13.738380  3946 debug-util.cc:398] Leaking SignalData structure 0x7b08001660a0 after lost signal to thread 4023
W20260709 12:24:13.740001  3946 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3200 after lost signal to thread 4608
W20260709 12:24:13.766516  2677 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 3871)
W20260709 12:24:13.800806  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.820291  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.855293  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:13.910739  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.037370  3888 consensus_peers.cc:597] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.047511  3888 consensus_peers.cc:597] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.060122  3888 consensus_peers.cc:597] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.060676  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.255419  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:14.264914  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.343513  3888 consensus_peers.cc:597] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:14.523579  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:14.573233  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:14.581923  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
W20260709 12:24:14.721387  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:14.757906  4548 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 62991.7us
W20260709 12:24:14.758824  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 49045.2us
W20260709 12:24:14.791803  3732 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 47335.5us
W20260709 12:24:14.799530  3889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 108060us
W20260709 12:24:14.841981  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e029f255cf96482eb49b53e7dc7ed25d: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:14.896651  3888 consensus_peers.cc:597] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:14.913605  3888 consensus_peers.cc:597] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:14.919037  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:14.943912  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.957911  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:14.972445  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.035208  3888 consensus_peers.cc:597] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:15.078414  3888 consensus_peers.cc:597] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:15.209174  3888 consensus_peers.cc:597] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.210690  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:15.247815  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:24:15.262557  4548 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.264542  4548 consensus_peers.cc:597] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.285140  3964 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.288538  4548 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.300793  3888 consensus_peers.cc:597] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.302115  4548 consensus_peers.cc:597] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.302284  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.326076  3964 consensus_peers.cc:597] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.327316  3888 consensus_peers.cc:597] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:15.350234  4548 consensus_peers.cc:597] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.367340  4548 consensus_peers.cc:597] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.380275  4548 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.405349  3964 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.429926  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:15.440032  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:15.447660  4548 consensus_peers.cc:597] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.451627  3964 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.462725  3888 consensus_peers.cc:597] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:15.474184  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.475174  4548 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.483513  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:15.485170  4548 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.491686  3964 consensus_peers.cc:597] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.502697  3888 consensus_peers.cc:597] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:15.525079  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:15.526245  2677 tablet_replica.cc:333] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.533075  2677 raft_consensus.cc:2243] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.533803  2677 raft_consensus.cc:2272] T 7265897ebd4e4f6ba4330aca29c74838 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.536240  3964 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.538143  2677 tablet_replica.cc:333] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.539173  2677 raft_consensus.cc:2243] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.544045  2677 raft_consensus.cc:2272] T 65de00ab7bf84d57b73f50c0d7c07565 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.547132  2677 tablet_replica.cc:333] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.548117  2677 raft_consensus.cc:2243] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.548799  2677 raft_consensus.cc:2272] T 918f90de47bb48d493e4dd0737810b63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.567605  2677 tablet_replica.cc:333] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.568472  2677 raft_consensus.cc:2243] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.570783  2677 raft_consensus.cc:2272] T 3bc1f0da5d664bee8661e3dbace70630 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.573865  2677 tablet_replica.cc:333] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.574913  2677 raft_consensus.cc:2243] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.575563  2677 raft_consensus.cc:2272] T 7abd4286feba432697849b5bcf582f63 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.592541  2677 tablet_replica.cc:333] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.593513  2677 raft_consensus.cc:2243] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.594648  2677 raft_consensus.cc:2272] T 07eb7068067d45559c8b38061e7c8808 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.598935  2677 tablet_replica.cc:333] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
W20260709 12:24:15.599803  4548 consensus_peers.cc:597] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.599865  2677 raft_consensus.cc:2243] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.604806  2677 raft_consensus.cc:2272] T 99966b4924ae49f889200899350931bb P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.656262  2677 tablet_replica.cc:333] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.657260  2677 raft_consensus.cc:2243] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:24:15.670387  4548 consensus_peers.cc:597] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.673647  2677 raft_consensus.cc:2272] T bbef64c2ac9444d6983c225484fccfda P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.676909  2677 tablet_replica.cc:333] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.677917  2677 raft_consensus.cc:2243] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.678651  2677 raft_consensus.cc:2272] T d25c2d062dfa4db8852d794adc28cdf2 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.681581  2677 tablet_replica.cc:333] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.682442  2677 raft_consensus.cc:2243] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.683074  2677 raft_consensus.cc:2272] T e693a63f62764df9a01acfa82fed09e8 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.685918  2677 tablet_replica.cc:333] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.686774  2677 raft_consensus.cc:2243] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.687539  2677 raft_consensus.cc:2272] T 91a268ae9485472a8208827344502203 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.690266  2677 tablet_replica.cc:333] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.691092  2677 raft_consensus.cc:2243] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.691917  2677 raft_consensus.cc:2272] T 565a1813fc6b4a21aa0897f0624b5122 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.695009  2677 tablet_replica.cc:333] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.695919  2677 raft_consensus.cc:2243] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.697106  2677 raft_consensus.cc:2272] T 1fc77961701c41028cd54ea83719dae9 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.700008  2677 tablet_replica.cc:333] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.700932  2677 raft_consensus.cc:2243] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.701867  2677 raft_consensus.cc:2272] T 88805767597d4bf9bed095ba7d4f4a76 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.704900  2677 tablet_replica.cc:333] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
W20260709 12:24:15.705513  3964 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.705808  2677 raft_consensus.cc:2243] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.752542  2677 raft_consensus.cc:2272] T f8842b18207e4c90a92bd153fe9d059e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.755836  2677 tablet_replica.cc:333] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.756942  2677 raft_consensus.cc:2243] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.757781  2677 raft_consensus.cc:2272] T 9b32e0bc8a63482a89916840eae42f8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.759596  3964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:38799, user_credentials={real_user=slave}} blocked reactor thread for 54147.6us
W20260709 12:24:15.760392  3964 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.765038  2677 tablet_replica.cc:333] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.766112  2677 raft_consensus.cc:2243] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:24:15.777494  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:15.767225  2677 raft_consensus.cc:2272] T 9c325a58070740f29bc40a3a22e2b61d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.784775  2677 tablet_replica.cc:333] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.785706  2677 raft_consensus.cc:2243] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.787402  2677 raft_consensus.cc:2272] T 2dbe9e57610c4d9b92c97966fbbfc00d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.814695  2677 tablet_replica.cc:333] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.815623  2677 raft_consensus.cc:2243] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.816649  2677 raft_consensus.cc:2272] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.802109  3964 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:15.819839  3964 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.825006  2677 tablet_replica.cc:333] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.825994  2677 raft_consensus.cc:2243] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:15.832340  3888 consensus_peers.cc:597] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:15.833065  2677 raft_consensus.cc:2272] T f370e99c95594dc19f98fb403380e06c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.836901  2677 tablet_replica.cc:333] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.837801  2677 raft_consensus.cc:2243] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.838505  2677 raft_consensus.cc:2272] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.852447  3888 consensus_peers.cc:597] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:15.853693  2677 tablet_replica.cc:333] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.854647  2677 raft_consensus.cc:2243] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.855940  2677 raft_consensus.cc:2272] T 07eac049e3fe41bf98d28d3d572dcb8a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.864598  3962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:37307, user_credentials={real_user=slave}} blocked reactor thread for 76310.6us
I20260709 12:24:15.868230  2677 tablet_replica.cc:333] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.869201  2677 raft_consensus.cc:2243] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:15.870882  3964 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.870050  2677 raft_consensus.cc:2272] T dfad3fb2927f45958c4a0cf0768a8b53 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.874990  2677 tablet_replica.cc:333] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
W20260709 12:24:15.875772  3964 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.876219  2677 raft_consensus.cc:2243] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.876971  2677 raft_consensus.cc:2272] T 63ac059d92404e2aa8792e1c5b02ae88 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:15.881588  3964 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.884038  2677 tablet_replica.cc:333] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.885031  2677 raft_consensus.cc:2243] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:24:15.885560  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 81566.4us
I20260709 12:24:15.886284  2677 raft_consensus.cc:2272] T 30c0e62036464a72858695d542f42a18 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.889214  2677 tablet_replica.cc:333] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.890079  2677 raft_consensus.cc:2243] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.890681  2677 raft_consensus.cc:2272] T a66f6f6f296148d9b3b0931f1c94d49a P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.909891  2677 tablet_replica.cc:333] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.910799  2677 raft_consensus.cc:2243] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.912096  2677 raft_consensus.cc:2272] T 7469adb046a64b1b9311cea78d13a0e6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.914952  2677 tablet_replica.cc:333] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
W20260709 12:24:15.915812  4548 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.928058  2677 raft_consensus.cc:2243] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.928967  2677 raft_consensus.cc:2272] T ac719796849e490f935d71c2a43cd7d6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.932168  2677 tablet_replica.cc:333] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.933053  2677 raft_consensus.cc:2243] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.933722  2677 raft_consensus.cc:2272] T 108e3004fd4341f78b24caefdf2ef63f P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.936535  2677 tablet_replica.cc:333] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.937418  2677 raft_consensus.cc:2243] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.938333  2677 raft_consensus.cc:2272] T 125588992e20455d8e0b267fb10d24a7 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.941226  2677 tablet_replica.cc:333] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.947959  2677 raft_consensus.cc:2243] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.949131  2677 raft_consensus.cc:2272] T 56a5b44f8f3e46ae9582b9f86d191610 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.953953  2677 tablet_replica.cc:333] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.963275  2677 raft_consensus.cc:2243] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.964684  2677 raft_consensus.cc:2272] T c95cac50f4de4720ab08d1d1e49d71b5 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.967490  2677 tablet_replica.cc:333] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.968458  2677 raft_consensus.cc:2243] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:15.969817  2677 raft_consensus.cc:2272] T ce77a1e41f7b43cc965d6fd6976759cd P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.978313  2677 tablet_replica.cc:333] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:15.979305  2677 raft_consensus.cc:2243] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:15.980083  2677 raft_consensus.cc:2272] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:15.986155  2677 tablet_replica.cc:333] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.010010  2677 raft_consensus.cc:2243] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.011287  2677 raft_consensus.cc:2272] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.017946  2677 tablet_replica.cc:333] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.019224  2677 raft_consensus.cc:2243] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:16.022573  4547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:35865, user_credentials={real_user=slave}} blocked reactor thread for 96848.8us
I20260709 12:24:16.033859  2677 raft_consensus.cc:2272] T 610ee9fca78e4559ab9cde25d14edade P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:16.056036  3888 consensus_peers.cc:597] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:16.058756  2677 tablet_replica.cc:333] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.059748  2677 raft_consensus.cc:2243] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.060752  2677 raft_consensus.cc:2272] T f3bacd87db564c3ba5256af726514f84 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.066578  2677 tablet_replica.cc:333] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.068372  2677 raft_consensus.cc:2243] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.069666  2677 raft_consensus.cc:2272] T ff4bdec26d3e4879bd33a92daad5d607 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.079244  2677 tablet_replica.cc:333] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.080210  2677 raft_consensus.cc:2243] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.084946  2677 raft_consensus.cc:2272] T 63cbbf40cb084518a89acf7f7026e77b P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.088688  2677 tablet_replica.cc:333] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.121629  2677 raft_consensus.cc:2243] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.142676  2677 raft_consensus.cc:2272] T a7d019c5856041bca1afab26bbc6c7a6 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:16.130921  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:16.152379  3964 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:16.155138  3962 consensus_peers.cc:597] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:16.166666  3962 consensus_peers.cc:597] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:16.170207  2677 tablet_replica.cc:333] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.189877  2677 raft_consensus.cc:2243] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:24:16.196172  3962 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:16.199874  3962 consensus_peers.cc:597] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:16.201341  2677 raft_consensus.cc:2272] T 982a62c46cea46f2b2e381471e7e080c P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:16.223632  3962 consensus_peers.cc:597] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:16.241986  2677 tablet_replica.cc:333] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.250067  2677 raft_consensus.cc:2243] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.253577  2677 raft_consensus.cc:2272] T 138b76e837f84a518585fccdcf9ff6d4 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.266585  2677 tablet_replica.cc:333] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.269752  2677 raft_consensus.cc:2243] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.272173  2677 raft_consensus.cc:2272] T c9cb9cc431d048dd8cfea736da6af5fa P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:16.289621  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:16.292028  2677 tablet_replica.cc:333] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.292860  2677 raft_consensus.cc:2243] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.293527  2677 raft_consensus.cc:2272] T c1565e90e2094af9b0891393186e41da P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.295930  2677 tablet_replica.cc:333] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.296669  2677 raft_consensus.cc:2243] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.297732  2677 raft_consensus.cc:2272] T e029f255cf96482eb49b53e7dc7ed25d P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.301123  2677 tablet_replica.cc:333] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.301846  2677 raft_consensus.cc:2243] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.302402  2677 raft_consensus.cc:2272] T 83b1a4f620064a52bb4a2fb284f00276 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.316937  2677 tablet_replica.cc:333] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.317797  2677 raft_consensus.cc:2243] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:16.319119  2677 raft_consensus.cc:2272] T f9a206840e1648aeb4571019fa4ca639 P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:16.322211  2677 tablet_replica.cc:333] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6: stopping tablet replica
I20260709 12:24:16.322927  2677 raft_consensus.cc:2243] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:16.323668  2677 raft_consensus.cc:2272] T fdd5ceb511e74bc7a94d43444ea1d35e P 146eb0cb8a2f4846ae6ef2b8758dd6a6 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:16.331244  3962 consensus_peers.cc:597] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:16.399076  3962 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:16.443194  4548 connection.cc:769] client connection to 127.2.157.66:38799 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:24:16.491191  3962 consensus_peers.cc:597] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:16.559885  3962 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:16.727380 11448 raft_consensus.cc:493] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.728062 11448 raft_consensus.cc:515] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:16.730322 11448 leader_election.cc:290] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:16.741302  3962 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:16.746956  3964 leader_election.cc:336] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:16.747584  3964 leader_election.cc:304] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:16.749752 11440 raft_consensus.cc:2749] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:16.752173 11448 raft_consensus.cc:493] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.752725 11448 raft_consensus.cc:515] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:16.755251 11448 leader_election.cc:290] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:16.766628  3962 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:16.783145  3964 leader_election.cc:336] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:16.785758  3964 leader_election.cc:304] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:16.786710 11448 raft_consensus.cc:2749] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:16.790693  3962 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:16.876132 11444 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.876838 11444 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:16.889289 11444 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:16.903518  4548 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:16.930450  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:16.933408 11444 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.934064 11448 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.934659 11448 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:16.937543  4547 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:16.938026 11448 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
I20260709 12:24:16.938808 11437 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:16.934113 11444 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:16.941023 11444 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:16.957372  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:16.958237  4580 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 13.
I20260709 12:24:16.962108 11448 raft_consensus.cc:493] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.962711 11448 raft_consensus.cc:515] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:24:16.963647  4546 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:16.964870 11448 leader_election.cc:290] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:16.974212  3962 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:16.976890 11448 raft_consensus.cc:493] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.977496 11448 raft_consensus.cc:515] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:16.979759 11448 leader_election.cc:290] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:16.981424  4548 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:16.985321  4548 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:16.984733  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 
I20260709 12:24:16.990268 11448 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:16.990767 11448 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:16.991200 11448 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:16.998410 11452 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:17.006623 11448 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.044569 11448 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Requested vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:17.025132  3962 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.042439  3964 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.055483  3962 consensus_peers.cc:597] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:17.076764  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:17.080968 11444 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.081775 11444 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.085222 11444 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.088826  4546 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.091917  4548 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.094429  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.098253 11444 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:17.098603  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07eb7068067d45559c8b38061e7c8808" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5"
I20260709 12:24:17.099350  4580 raft_consensus.cc:3060] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:17.101465  3964 leader_election.cc:336] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.102325  3964 leader_election.cc:304] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.103116 11454 raft_consensus.cc:2749] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:17.109695  4580 raft_consensus.cc:2468] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 14.
W20260709 12:24:17.111927  3964 leader_election.cc:336] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.112536  3964 leader_election.cc:304] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.114585 11454 raft_consensus.cc:2749] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:17.130380  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:17.140717 11454 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.141340 11454 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.153379 11454 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 328b0b7296c545ff8ea6f7c70f93f2c5 (127.2.157.68:38173)
W20260709 12:24:17.179356  3962 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.186537 11452 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.187136 11452 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.189566 11452 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.218412  4548 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.222050  4546 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.227475  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.249468 11444 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.254454 11444 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.258219 11444 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:17.259635 11444 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:17.271936  3964 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.300036 11454 raft_consensus.cc:493] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.301261 11448 raft_consensus.cc:493] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.301836 11448 raft_consensus.cc:515] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.305250 11440 raft_consensus.cc:493] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.305826 11440 raft_consensus.cc:515] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.308460 11448 leader_election.cc:290] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.310138 11440 leader_election.cc:290] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.300729 11454 raft_consensus.cc:515] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.314694 11454 leader_election.cc:290] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.328876  4548 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.339951  4546 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.343242  4581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "32d706e2535f4fa19a09382d4edac677" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" is_pre_election: true
I20260709 12:24:17.343567  4546 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.344041  4581 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32d706e2535f4fa19a09382d4edac677 in term 19.
I20260709 12:24:17.349570 11454 raft_consensus.cc:493] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.350231 11454 raft_consensus.cc:515] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.352684 11454 leader_election.cc:290] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.356429  4548 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111) [suppressed 526 similar messages]
I20260709 12:24:17.358114 11452 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:17.385762  3964 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6
I20260709 12:24:17.395056 11440 raft_consensus.cc:2804] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:17.395756 11440 raft_consensus.cc:697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Becoming Leader. State: Replica: 32d706e2535f4fa19a09382d4edac677, State: Running, Role: LEADER
I20260709 12:24:17.396766 11440 consensus_queue.cc:237] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.438133  3743 catalog_manager.cc:5697] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 reported cstate change: term changed from 13 to 14, leader changed from 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66) to 32d706e2535f4fa19a09382d4edac677 (127.2.157.67). New cstate: current_term: 14 leader_uuid: "32d706e2535f4fa19a09382d4edac677" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.468267 11464 raft_consensus.cc:493] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.468892 11464 raft_consensus.cc:515] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:24:17.469485  3962 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.470199  3962 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.470652  3962 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.471161 11464 leader_election.cc:290] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.487982 11440 raft_consensus.cc:493] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.488659 11440 raft_consensus.cc:515] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.490211  3995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbe9e57610c4d9b92c97966fbbfc00d" candidate_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "32d706e2535f4fa19a09382d4edac677" is_pre_election: true
I20260709 12:24:17.490840  3995 raft_consensus.cc:2468] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 328b0b7296c545ff8ea6f7c70f93f2c5 in term 19.
I20260709 12:24:17.493319 11440 leader_election.cc:290] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.494387  3962 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.461247 11448 raft_consensus.cc:493] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
W20260709 12:24:17.495028  3962 consensus_peers.cc:597] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:17.499958  3964 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.505889  4546 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:17.511639  3964 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5, 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:17.512787  3964 leader_election.cc:336] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.513196  3964 leader_election.cc:304] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:17.514051  3964 leader_election.cc:336] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.514401  3964 leader_election.cc:304] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:17.515209  3964 leader_election.cc:336] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.517930  3964 leader_election.cc:304] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.520303 11464 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:17.520965 11464 raft_consensus.cc:2749] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:17.521556 11464 raft_consensus.cc:2749] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:17.522133 11464 raft_consensus.cc:2749] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:17.530519  3962 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:24:17.531072 11448 raft_consensus.cc:515] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.531921 11458 raft_consensus.cc:493] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.534880 11458 raft_consensus.cc:515] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
W20260709 12:24:17.532516  3962 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.540226 11440 raft_consensus.cc:493] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.540841 11440 raft_consensus.cc:515] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.543138 11454 raft_consensus.cc:493] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.543793 11454 raft_consensus.cc:515] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } }
I20260709 12:24:17.564860 11448 leader_election.cc:290] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.566265  3964 leader_election.cc:336] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.566895  3964 leader_election.cc:304] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.568681 11448 raft_consensus.cc:2749] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:17.576773 11440 leader_election.cc:290] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.577781 11458 leader_election.cc:290] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.591653 11454 leader_election.cc:290] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.566227  3962 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.606813  4546 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:17.616007  3964 leader_election.cc:336] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.616544  3964 leader_election.cc:304] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:17.617719  3964 leader_election.cc:336] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.617777 11468 raft_consensus.cc:2749] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:17.618254  3964 leader_election.cc:304] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:17.630966  3964 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.632072  3964 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.632596  3964 consensus_peers.cc:597] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.632990  3964 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.633419  3964 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.635839 11444 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.636806 11444 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.635885 11459 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:17.639139 11444 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:17.640002 11454 raft_consensus.cc:2749] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:17.639139 11459 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:17.644737 11459 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:17.645453  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:17.649097  4546 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.652768  4546 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:17.666121  3962 leader_election.cc:336] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.675719  3962 leader_election.cc:304] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.679075 11468 raft_consensus.cc:2749] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:17.680437  3962 leader_election.cc:336] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.682803  3962 leader_election.cc:304] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.684213 11468 raft_consensus.cc:2749] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:17.683408  4548 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:17.687513  4548 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.693799 11444 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:17.694902  4548 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:17.692821  3962 leader_election.cc:336] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.696564  3962 leader_election.cc:304] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.697345 11454 raft_consensus.cc:2749] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:17.698405  3962 leader_election.cc:336] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:17.699007  3962 leader_election.cc:304] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32d706e2535f4fa19a09382d4edac677; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.695537  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:17.699905 11444 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:17.701610 11454 raft_consensus.cc:2749] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:17.722855  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
W20260709 12:24:17.733479  4546 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:17.725611  3962 consensus_peers.cc:597] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:17.736837  4548 consensus_peers.cc:597] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.743237  4548 consensus_peers.cc:597] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.795874  3962 consensus_peers.cc:597] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:17.858242  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
W20260709 12:24:17.866880  3964 consensus_peers.cc:597] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.868738  4547 consensus_peers.cc:597] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.870839  3962 consensus_peers.cc:597] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:17.883739  4548 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.897758  4548 consensus_peers.cc:597] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.903568  3964 consensus_peers.cc:597] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.915632  4547 consensus_peers.cc:597] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.957605  4548 consensus_peers.cc:597] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.958295  4548 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:17.978739  4547 consensus_peers.cc:597] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.981010  4548 consensus_peers.cc:597] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:17.987936  4580 raft_consensus.cc:1275] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Refusing update from remote peer 32d706e2535f4fa19a09382d4edac677: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:24:17.996508  3962 consensus_peers.cc:597] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:24:18.004601 11467 consensus_queue.cc:1048] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:24:18.011776  4548 consensus_peers.cc:597] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:18.015789  4547 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.016614  4547 consensus_peers.cc:597] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.020905  3964 consensus_peers.cc:597] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.037257  3964 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.041697  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:18.043527  2677 tablet_replica.cc:333] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.044498  2677 raft_consensus.cc:2243] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.046638  2677 raft_consensus.cc:2272] T 918f90de47bb48d493e4dd0737810b63 P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.048329  4546 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:18.049813  2677 tablet_replica.cc:333] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.050757  2677 raft_consensus.cc:2243] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.051810  2677 raft_consensus.cc:2272] T 7265897ebd4e4f6ba4330aca29c74838 P 32d706e2535f4fa19a09382d4edac677 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.052930  4547 consensus_peers.cc:597] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.054015  4547 consensus_peers.cc:597] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.055289  2677 tablet_replica.cc:333] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.056396  2677 raft_consensus.cc:2243] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.057022  2677 raft_consensus.cc:2272] T 3bc1f0da5d664bee8661e3dbace70630 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.059859  2677 tablet_replica.cc:333] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
W20260709 12:24:18.054915  4547 consensus_peers.cc:597] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.060950  2677 raft_consensus.cc:2243] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:18.061262  4547 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.061717  2677 raft_consensus.cc:2272] T 65de00ab7bf84d57b73f50c0d7c07565 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.064839  2677 tablet_replica.cc:333] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.065733  2677 raft_consensus.cc:2243] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.066464  2677 raft_consensus.cc:2272] T 7abd4286feba432697849b5bcf582f63 P 32d706e2535f4fa19a09382d4edac677 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.069258  2677 tablet_replica.cc:333] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.070211  2677 raft_consensus.cc:2243] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.073185  2677 raft_consensus.cc:2272] T c68343b8d5be4269b4b588c1b34d01e0 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.076102  2677 tablet_replica.cc:333] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.083319  2677 raft_consensus.cc:2243] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.084730  2677 raft_consensus.cc:2272] T 91a268ae9485472a8208827344502203 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.088665  2677 tablet_replica.cc:333] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.091776  2677 raft_consensus.cc:2243] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.092986  2677 raft_consensus.cc:2272] T d25c2d062dfa4db8852d794adc28cdf2 P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.096088  2677 tablet_replica.cc:333] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
W20260709 12:24:18.098352  4547 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.099905  2677 raft_consensus.cc:2243] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.100693  2677 raft_consensus.cc:2272] T 67af26a7a42843f6855950af7a5b7781 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.103798  2677 tablet_replica.cc:333] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.104658  2677 raft_consensus.cc:2243] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.105350  2677 raft_consensus.cc:2272] T e693a63f62764df9a01acfa82fed09e8 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.109565  2677 tablet_replica.cc:333] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.110528  2677 raft_consensus.cc:2243] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.111855  2677 raft_consensus.cc:2272] T 565a1813fc6b4a21aa0897f0624b5122 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.113411  4548 consensus_peers.cc:597] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.114826  2677 tablet_replica.cc:333] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.118232  2677 raft_consensus.cc:2243] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:18.118394  3964 consensus_peers.cc:597] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.119026  2677 raft_consensus.cc:2272] T 1fc77961701c41028cd54ea83719dae9 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.122097  2677 tablet_replica.cc:333] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
W20260709 12:24:18.121798  3964 consensus_peers.cc:597] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.123207  2677 raft_consensus.cc:2243] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.124442  2677 raft_consensus.cc:2272] T 07eb7068067d45559c8b38061e7c8808 P 32d706e2535f4fa19a09382d4edac677 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.127385  2677 tablet_replica.cc:333] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.128311  2677 raft_consensus.cc:2243] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.129505  2677 raft_consensus.cc:2272] T 99966b4924ae49f889200899350931bb P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.132599  2677 tablet_replica.cc:333] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.133602  2677 raft_consensus.cc:2243] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.134289  2677 raft_consensus.cc:2272] T bbef64c2ac9444d6983c225484fccfda P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.137259  2677 tablet_replica.cc:333] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.138150  2677 raft_consensus.cc:2243] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.139393  2677 raft_consensus.cc:2272] T f370e99c95594dc19f98fb403380e06c P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.142575  2677 tablet_replica.cc:333] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.143426  2677 raft_consensus.cc:2243] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.144635  2677 raft_consensus.cc:2272] T e7012fd3393d4b19bd0d25e82fc612df P 32d706e2535f4fa19a09382d4edac677 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.147552  2677 tablet_replica.cc:333] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.148386  2677 raft_consensus.cc:2243] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.150270  2677 raft_consensus.cc:2272] T 88805767597d4bf9bed095ba7d4f4a76 P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.153337  2677 tablet_replica.cc:333] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.154186  2677 raft_consensus.cc:2243] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.154733  2677 raft_consensus.cc:2272] T 9c325a58070740f29bc40a3a22e2b61d P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.157757  2677 tablet_replica.cc:333] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.158695  2677 raft_consensus.cc:2243] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.159516  2677 raft_consensus.cc:2272] T 722124affb914f0496100070a9582045 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.162530  2677 tablet_replica.cc:333] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.163542  2677 raft_consensus.cc:2243] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.164469  2677 raft_consensus.cc:2272] T 2dbe9e57610c4d9b92c97966fbbfc00d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.166160  4548 consensus_peers.cc:597] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.167539  2677 tablet_replica.cc:333] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.168491  2677 raft_consensus.cc:2243] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.169688  2677 raft_consensus.cc:2272] T 58188a85c5c940b2a6a6d9e2640f3b18 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.172610  2677 tablet_replica.cc:333] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.173425  2677 raft_consensus.cc:2243] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.174059  2677 raft_consensus.cc:2272] T f8842b18207e4c90a92bd153fe9d059e P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.176862  2677 tablet_replica.cc:333] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.177765  2677 raft_consensus.cc:2243] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.178653  2677 raft_consensus.cc:2272] T 9b32e0bc8a63482a89916840eae42f8a P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.183637  2677 tablet_replica.cc:333] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.184597  2677 raft_consensus.cc:2243] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.185871  2677 raft_consensus.cc:2272] T a29f44dfd3d24dccaa224167c983a5a4 P 32d706e2535f4fa19a09382d4edac677 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.188905  2677 tablet_replica.cc:333] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.189779  2677 raft_consensus.cc:2243] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.190742  2677 raft_consensus.cc:2272] T 30c0e62036464a72858695d542f42a18 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.191641  4548 consensus_peers.cc:597] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.193683  2677 tablet_replica.cc:333] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.194628  2677 raft_consensus.cc:2243] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.195593  2677 raft_consensus.cc:2272] T 7469adb046a64b1b9311cea78d13a0e6 P 32d706e2535f4fa19a09382d4edac677 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.198523  2677 tablet_replica.cc:333] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.199456  2677 raft_consensus.cc:2243] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.200202  2677 raft_consensus.cc:2272] T dfad3fb2927f45958c4a0cf0768a8b53 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.203164  2677 tablet_replica.cc:333] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.204121  2677 raft_consensus.cc:2243] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:24:18.205276  3964 consensus_peers.cc:597] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.205392  2677 raft_consensus.cc:2272] T 271f08ec28384c99b6dd3fb41fb92ebf P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.205935  3964 consensus_peers.cc:597] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:18.206815  4547 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.207736  4547 consensus_peers.cc:597] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Couldn't send request to peer 32d706e2535f4fa19a09382d4edac677. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.208611  2677 tablet_replica.cc:333] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.209529  2677 raft_consensus.cc:2243] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.210256  2677 raft_consensus.cc:2272] T 63cbbf40cb084518a89acf7f7026e77b P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.212987  2677 tablet_replica.cc:333] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.213873  2677 raft_consensus.cc:2243] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:24:18.214433  3962 consensus_peers.cc:597] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:18.215085  2677 raft_consensus.cc:2272] T 3d61667a526f478f888a20a9619a1e2b P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.218310  2677 tablet_replica.cc:333] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.219259  2677 raft_consensus.cc:2243] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.220656  2677 raft_consensus.cc:2272] T d96631b804304cddb7995664610e592d P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.223528  2677 tablet_replica.cc:333] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.224474  2677 raft_consensus.cc:2243] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.225243  2677 raft_consensus.cc:2272] T 56a5b44f8f3e46ae9582b9f86d191610 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.228238  2677 tablet_replica.cc:333] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.229183  2677 raft_consensus.cc:2243] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:24:18.229218  3964 consensus_peers.cc:597] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.230628  2677 raft_consensus.cc:2272] T 125588992e20455d8e0b267fb10d24a7 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.233651  2677 tablet_replica.cc:333] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.235394  2677 raft_consensus.cc:2243] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.236629  2677 raft_consensus.cc:2272] T 2900e71c0212466e8be300d30595c609 P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.239547  2677 tablet_replica.cc:333] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.240414  2677 raft_consensus.cc:2243] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.241639  2677 raft_consensus.cc:2272] T c1565e90e2094af9b0891393186e41da P 32d706e2535f4fa19a09382d4edac677 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.244417  2677 tablet_replica.cc:333] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.245240  2677 raft_consensus.cc:2243] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.245858  2677 raft_consensus.cc:2272] T e029f255cf96482eb49b53e7dc7ed25d P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.248647  2677 tablet_replica.cc:333] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.249558  2677 raft_consensus.cc:2243] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.250360  2677 raft_consensus.cc:2272] T 0fc6b8b0d8114762a0c8cec5e5461a82 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.253161  2677 tablet_replica.cc:333] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.254000  2677 raft_consensus.cc:2243] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.255084  2677 raft_consensus.cc:2272] T 610ee9fca78e4559ab9cde25d14edade P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.257941  2677 tablet_replica.cc:333] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.258800  2677 raft_consensus.cc:2243] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:18.260617  4548 consensus_peers.cc:597] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:18.259503  2677 raft_consensus.cc:2272] T ba989d98d508441a9e56717e49c9004d P 32d706e2535f4fa19a09382d4edac677 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.302776  2677 tablet_replica.cc:333] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.313792  2677 raft_consensus.cc:2243] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.315476  2677 raft_consensus.cc:2272] T ce77a1e41f7b43cc965d6fd6976759cd P 32d706e2535f4fa19a09382d4edac677 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.319939  2677 tablet_replica.cc:333] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.320992  2677 raft_consensus.cc:2243] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.322441  2677 raft_consensus.cc:2272] T c95cac50f4de4720ab08d1d1e49d71b5 P 32d706e2535f4fa19a09382d4edac677 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.326191  2677 tablet_replica.cc:333] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.327090  2677 raft_consensus.cc:2243] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.330574  2677 raft_consensus.cc:2272] T fdd5ceb511e74bc7a94d43444ea1d35e P 32d706e2535f4fa19a09382d4edac677 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.334820  2677 tablet_replica.cc:333] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.335776  2677 raft_consensus.cc:2243] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.337451  2677 raft_consensus.cc:2272] T ac719796849e490f935d71c2a43cd7d6 P 32d706e2535f4fa19a09382d4edac677 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.340639  2677 tablet_replica.cc:333] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.341645  2677 raft_consensus.cc:2243] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.342516  2677 raft_consensus.cc:2272] T 108e3004fd4341f78b24caefdf2ef63f P 32d706e2535f4fa19a09382d4edac677 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.345892  2677 tablet_replica.cc:333] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.346838  2677 raft_consensus.cc:2243] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.349138  2677 raft_consensus.cc:2272] T 2ba6f4e278ba4a6daa236e0b38b36cc0 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.353271  2677 tablet_replica.cc:333] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.354169  2677 raft_consensus.cc:2243] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.357367  2677 raft_consensus.cc:2272] T a7d019c5856041bca1afab26bbc6c7a6 P 32d706e2535f4fa19a09382d4edac677 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.361405  2677 tablet_replica.cc:333] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.362502  2677 raft_consensus.cc:2243] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.363698  2677 raft_consensus.cc:2272] T 982a62c46cea46f2b2e381471e7e080c P 32d706e2535f4fa19a09382d4edac677 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.368510  2677 tablet_replica.cc:333] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677: stopping tablet replica
I20260709 12:24:18.369508  2677 raft_consensus.cc:2243] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.372589  2677 raft_consensus.cc:2272] T 138b76e837f84a518585fccdcf9ff6d4 P 32d706e2535f4fa19a09382d4edac677 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:18.428225  4548 consensus_peers.cc:597] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Couldn't send request to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:18.633164  4546 consensus_peers.cc:597] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:24:18.721163 11459 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:18.722069 11459 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:18.725313 11459 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:18.732410  4546 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:18.733729  4548 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:18.734170  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:18.734942 11459 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:19.836180 11476 raft_consensus.cc:493] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.837051 11476 raft_consensus.cc:515] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.839771 11476 leader_election.cc:290] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.841398 11477 raft_consensus.cc:493] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.842425 11477 raft_consensus.cc:515] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.860251 11476 raft_consensus.cc:493] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:19.861102 11476 raft_consensus.cc:515] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.872416 11477 leader_election.cc:290] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.893507 11480 raft_consensus.cc:493] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:19.894367 11480 raft_consensus.cc:515] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.895401 11477 raft_consensus.cc:493] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.896188 11477 raft_consensus.cc:515] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.897394 11480 leader_election.cc:290] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:19.898524 11477 leader_election.cc:290] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.905067 11476 leader_election.cc:290] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:19.907235 11476 raft_consensus.cc:493] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:19.908001 11476 raft_consensus.cc:515] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.908878 11483 raft_consensus.cc:493] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.914047 11483 raft_consensus.cc:515] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.915226 11478 raft_consensus.cc:493] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.920751 11478 raft_consensus.cc:515] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.923904 11478 leader_election.cc:290] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.915832 11480 raft_consensus.cc:493] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.924973 11480 raft_consensus.cc:515] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
W20260709 12:24:19.917790  4547 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
I20260709 12:24:19.925892 11478 raft_consensus.cc:493] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:19.929520 11481 raft_consensus.cc:493] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.930276 11478 raft_consensus.cc:515] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } attrs { replace: true } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.931313 11480 leader_election.cc:290] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.918886 11476 leader_election.cc:290] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:19.933568 11486 raft_consensus.cc:493] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.901418 11477 raft_consensus.cc:493] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:19.933684 11478 leader_election.cc:290] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.930356 11481 raft_consensus.cc:515] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.938680 11486 raft_consensus.cc:515] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.941454 11481 leader_election.cc:290] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.934002 11483 leader_election.cc:290] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.934350 11482 raft_consensus.cc:493] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.942137 11486 leader_election.cc:290] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.929587 11487 raft_consensus.cc:493] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
W20260709 12:24:19.934576  4547 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.943933  4547 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
I20260709 12:24:19.943701 11487 raft_consensus.cc:515] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.942672 11482 raft_consensus.cc:515] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.946674 11482 leader_election.cc:290] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:19.950212  4546 leader_election.cc:336] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:19.950850  4546 leader_election.cc:304] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:19.953159 11481 raft_consensus.cc:493] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.953891 11481 raft_consensus.cc:515] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.954355 11488 raft_consensus.cc:493] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 32d706e2535f4fa19a09382d4edac677)
I20260709 12:24:19.955003 11487 leader_election.cc:290] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.955399 11488 raft_consensus.cc:515] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "32d706e2535f4fa19a09382d4edac677" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35865 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.956532 11481 leader_election.cc:290] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
I20260709 12:24:19.958074 11488 leader_election.cc:290] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865)
W20260709 12:24:19.960270  4548 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:19.960901  4548 leader_election.cc:304] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:19.939280 11477 raft_consensus.cc:515] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:19.965024 11477 leader_election.cc:290] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
I20260709 12:24:19.952494 11482 raft_consensus.cc:2749] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:19.966876  4548 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:19.967460 11488 raft_consensus.cc:2749] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:19.967859  4546 leader_election.cc:336] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:19.974285  4547 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.975111  4547 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.975703  4547 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.976323  4547 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.976914  4547 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.977556  4547 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.977852  4546 leader_election.cc:336] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:19.978134  4547 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
I20260709 12:24:19.978770  4546 leader_election.cc:304] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:19.979682 11488 raft_consensus.cc:2749] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:19.979946  4546 consensus_peers.cc:597] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:19.980511  4546 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:19.991125  4547 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
W20260709 12:24:19.992302  4548 leader_election.cc:336] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:19.992862  4548 leader_election.cc:304] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:19.993708 11488 raft_consensus.cc:2749] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:19.993978  4548 leader_election.cc:336] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:19.994481  4548 leader_election.cc:304] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:19.995270 11488 raft_consensus.cc:2749] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:19.998319  4546 leader_election.cc:336] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:19.998437  4547 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
I20260709 12:24:19.998942  4546 leader_election.cc:304] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:19.999157  4547 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 32d706e2535f4fa19a09382d4edac677 (127.2.157.67:35865): Network error: Client connection negotiation failed: client connection to 127.2.157.67:35865: connect: Connection refused (error 111)
I20260709 12:24:19.999886 11488 raft_consensus.cc:2749] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:20.000560  4546 leader_election.cc:336] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.001035  4546 leader_election.cc:304] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.001796 11488 raft_consensus.cc:2749] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:20.002626  4546 leader_election.cc:336] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.003378  4546 leader_election.cc:304] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.004410 11488 raft_consensus.cc:2749] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:24:20.005434  4548 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.006111  4548 leader_election.cc:304] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
W20260709 12:24:20.007007  4548 leader_election.cc:336] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.007018 11488 raft_consensus.cc:2749] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:20.007490  4548 leader_election.cc:304] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:20.008430 11488 raft_consensus.cc:2749] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:20.012972  4548 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
W20260709 12:24:20.012918  4546 leader_election.cc:336] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:20.013830  4548 leader_election.cc:336] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.014029  4546 leader_election.cc:304] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.014331  4548 leader_election.cc:304] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.015295 11482 raft_consensus.cc:2749] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:20.015514  4548 leader_election.cc:336] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.016007  4548 leader_election.cc:304] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, 32d706e2535f4fa19a09382d4edac677
I20260709 12:24:20.016160 11482 raft_consensus.cc:2749] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:20.016734 11477 raft_consensus.cc:2749] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:20.017400  4546 leader_election.cc:336] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:20.017858  4548 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.017998  4546 leader_election.cc:304] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.019090 11477 raft_consensus.cc:2749] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:24:20.020076  4546 leader_election.cc:336] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.020484  4546 leader_election.cc:304] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
W20260709 12:24:20.021533  4546 leader_election.cc:336] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.021414 11477 raft_consensus.cc:2749] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:20.022172  4546 leader_election.cc:304] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.023025 11477 raft_consensus.cc:2749] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:20.023204  4546 leader_election.cc:336] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.023768  4546 leader_election.cc:304] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 32d706e2535f4fa19a09382d4edac677, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.024562 11477 raft_consensus.cc:2749] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:20.024839  4546 leader_election.cc:336] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:20.392774  3737 maintenance_manager.cc:419] P 8bd543252a59424d81c6f755d59f4ddf: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033340
W20260709 12:24:20.410298  4546 consensus_peers.cc:597] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:24:20.456835  3736 maintenance_manager.cc:643] P 8bd543252a59424d81c6f755d59f4ddf: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.061s	user 0.037s	sys 0.015s Metrics: {"bytes_written":7473,"delete_count":0,"lbm_write_time_us":1232,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":9261,"threads_started":1,"update_count":272,"wal-append.queue_time_us":7596}
I20260709 12:24:20.464118  3737 maintenance_manager.cc:419] P 8bd543252a59424d81c6f755d59f4ddf: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.362224
W20260709 12:24:20.497987  4546 consensus_peers.cc:597] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:20.502322  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
I20260709 12:24:20.572885  3736 maintenance_manager.cc:643] P 8bd543252a59424d81c6f755d59f4ddf: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.108s	user 0.082s	sys 0.020s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28461,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":2896,"dirs.run_cpu_time_us":468,"dirs.run_wall_time_us":1144,"lbm_read_time_us":2100,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1624,"lbm_writes_lt_1ms":11,"mutex_wait_us":161,"peak_mem_usage":301358,"reinsert_count":0,"thread_start_us":1886,"threads_started":2,"update_count":282}
I20260709 12:24:20.575587  3737 maintenance_manager.cc:419] P 8bd543252a59424d81c6f755d59f4ddf: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:24:20.576309  3736 maintenance_manager.cc:643] P 8bd543252a59424d81c6f755d59f4ddf: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:24:20.610589 11488 raft_consensus.cc:493] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 146eb0cb8a2f4846ae6ef2b8758dd6a6)
I20260709 12:24:20.611210 11488 raft_consensus.cc:515] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bd47d64594f743eba2922d79251c1c5c" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 37307 } } peers { permanent_uuid: "146eb0cb8a2f4846ae6ef2b8758dd6a6" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 38799 } } peers { permanent_uuid: "328b0b7296c545ff8ea6f7c70f93f2c5" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 38173 } attrs { promote: false } }
I20260709 12:24:20.613497 11488 leader_election.cc:290] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307), 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799)
W20260709 12:24:20.619073  4546 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
W20260709 12:24:20.619796  4548 leader_election.cc:336] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 146eb0cb8a2f4846ae6ef2b8758dd6a6 (127.2.157.66:38799): Network error: Client connection negotiation failed: client connection to 127.2.157.66:38799: connect: Connection refused (error 111)
I20260709 12:24:20.620213  4548 leader_election.cc:304] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 328b0b7296c545ff8ea6f7c70f93f2c5; no voters: 146eb0cb8a2f4846ae6ef2b8758dd6a6, bd47d64594f743eba2922d79251c1c5c
I20260709 12:24:20.620903 11488 raft_consensus.cc:2749] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:20.678685  2677 tablet_server.cc:179] TabletServer@127.2.157.68:0 shutting down...
W20260709 12:24:20.689083  4546 consensus_peers.cc:597] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 -> Peer bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): Couldn't send request to peer bd47d64594f743eba2922d79251c1c5c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:24:20.729915  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:20.731097  2677 tablet_replica.cc:333] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.732432  2677 raft_consensus.cc:2243] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.733443  2677 raft_consensus.cc:2272] T 88805767597d4bf9bed095ba7d4f4a76 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.736804  2677 tablet_replica.cc:333] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.737779  2677 raft_consensus.cc:2243] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.739046  2677 raft_consensus.cc:2272] T e029f255cf96482eb49b53e7dc7ed25d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.741824  2677 tablet_replica.cc:333] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.742724  2677 raft_consensus.cc:2243] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.743652  2677 raft_consensus.cc:2272] T 2dbe9e57610c4d9b92c97966fbbfc00d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.747378  2677 tablet_replica.cc:333] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.748592  2677 raft_consensus.cc:2243] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.750201  2677 raft_consensus.cc:2272] T 610ee9fca78e4559ab9cde25d14edade P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.753145  2677 tablet_replica.cc:333] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.754069  2677 raft_consensus.cc:2243] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.755820  2677 raft_consensus.cc:2272] T e7012fd3393d4b19bd0d25e82fc612df P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.759407  2677 tablet_replica.cc:333] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.760329  2677 raft_consensus.cc:2243] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.761101  2677 raft_consensus.cc:2272] T c68343b8d5be4269b4b588c1b34d01e0 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.764246  2677 tablet_replica.cc:333] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.764931  2677 raft_consensus.cc:2243] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.766168  2677 raft_consensus.cc:2272] T 2bf551f0b2a843aa8a6b0ebdf7ba8fef P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.769272  2677 tablet_replica.cc:333] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.769968  2677 raft_consensus.cc:2243] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.771031  2677 raft_consensus.cc:2272] T e693a63f62764df9a01acfa82fed09e8 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.774724  2677 tablet_replica.cc:333] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.775902  2677 raft_consensus.cc:2243] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.777429  2677 raft_consensus.cc:2272] T 67af26a7a42843f6855950af7a5b7781 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.781066  2677 tablet_replica.cc:333] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.781862  2677 raft_consensus.cc:2243] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.782455  2677 raft_consensus.cc:2272] T f3bacd87db564c3ba5256af726514f84 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.785499  2677 tablet_replica.cc:333] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.786330  2677 raft_consensus.cc:2243] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.787065  2677 raft_consensus.cc:2272] T 99966b4924ae49f889200899350931bb P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.791301  2677 tablet_replica.cc:333] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.792258  2677 raft_consensus.cc:2243] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.793540  2677 raft_consensus.cc:2272] T 9b32e0bc8a63482a89916840eae42f8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.796114  2677 tablet_replica.cc:333] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.796737  2677 raft_consensus.cc:2243] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.797457  2677 raft_consensus.cc:2272] T 58188a85c5c940b2a6a6d9e2640f3b18 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.800158  2677 tablet_replica.cc:333] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.800787  2677 raft_consensus.cc:2243] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.801875  2677 raft_consensus.cc:2272] T 108e3004fd4341f78b24caefdf2ef63f P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.804415  2677 tablet_replica.cc:333] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.805142  2677 raft_consensus.cc:2243] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.806272  2677 raft_consensus.cc:2272] T ac719796849e490f935d71c2a43cd7d6 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.808848  2677 tablet_replica.cc:333] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.809634  2677 raft_consensus.cc:2243] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.810307  2677 raft_consensus.cc:2272] T a29f44dfd3d24dccaa224167c983a5a4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.813124  2677 tablet_replica.cc:333] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.813813  2677 raft_consensus.cc:2243] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.814463  2677 raft_consensus.cc:2272] T ff4bdec26d3e4879bd33a92daad5d607 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.816983  2677 tablet_replica.cc:333] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.817616  2677 raft_consensus.cc:2243] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.818778  2677 raft_consensus.cc:2272] T 63ac059d92404e2aa8792e1c5b02ae88 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.821507  2677 tablet_replica.cc:333] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.822160  2677 raft_consensus.cc:2243] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.823242  2677 raft_consensus.cc:2272] T 6bfc9dfe4d724180a29bd9c8bf9e16d4 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.826099  2677 tablet_replica.cc:333] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.826824  2677 raft_consensus.cc:2243] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.828184  2677 raft_consensus.cc:2272] T dfad3fb2927f45958c4a0cf0768a8b53 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.831132  2677 tablet_replica.cc:333] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.831844  2677 raft_consensus.cc:2243] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.832409  2677 raft_consensus.cc:2272] T 07eac049e3fe41bf98d28d3d572dcb8a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.834797  2677 tablet_replica.cc:333] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.835412  2677 raft_consensus.cc:2243] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.836477  2677 raft_consensus.cc:2272] T 722124affb914f0496100070a9582045 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.838917  2677 tablet_replica.cc:333] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.839653  2677 raft_consensus.cc:2243] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.840808  2677 raft_consensus.cc:2272] T a66f6f6f296148d9b3b0931f1c94d49a P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.843317  2677 tablet_replica.cc:333] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.844004  2677 raft_consensus.cc:2243] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.844583  2677 raft_consensus.cc:2272] T c9cb9cc431d048dd8cfea736da6af5fa P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.847488  2677 tablet_replica.cc:333] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.848156  2677 raft_consensus.cc:2243] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.848824  2677 raft_consensus.cc:2272] T 07eb7068067d45559c8b38061e7c8808 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.851334  2677 tablet_replica.cc:333] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.852164  2677 raft_consensus.cc:2243] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.853000  2677 raft_consensus.cc:2272] T 271f08ec28384c99b6dd3fb41fb92ebf P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.856225  2677 tablet_replica.cc:333] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.857084  2677 raft_consensus.cc:2243] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.858244  2677 raft_consensus.cc:2272] T 3d61667a526f478f888a20a9619a1e2b P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.860843  2677 tablet_replica.cc:333] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.861531  2677 raft_consensus.cc:2243] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.862380  2677 raft_consensus.cc:2272] T f9a206840e1648aeb4571019fa4ca639 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.865598  2677 tablet_replica.cc:333] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.866390  2677 raft_consensus.cc:2243] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.867807  2677 raft_consensus.cc:2272] T 83b1a4f620064a52bb4a2fb284f00276 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.870201  2677 tablet_replica.cc:333] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.870821  2677 raft_consensus.cc:2243] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.871856  2677 raft_consensus.cc:2272] T 7abd4286feba432697849b5bcf582f63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.874361  2677 tablet_replica.cc:333] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.875047  2677 raft_consensus.cc:2243] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.876183  2677 raft_consensus.cc:2272] T 918f90de47bb48d493e4dd0737810b63 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.878692  2677 tablet_replica.cc:333] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.879335  2677 raft_consensus.cc:2243] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:24:20.881110  2677 raft_consensus.cc:2272] T ba989d98d508441a9e56717e49c9004d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.883926  2677 tablet_replica.cc:333] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.884570  2677 raft_consensus.cc:2243] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.885272  2677 raft_consensus.cc:2272] T d96631b804304cddb7995664610e592d P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.887687  2677 tablet_replica.cc:333] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.888243  2677 raft_consensus.cc:2243] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:20.888957  2677 raft_consensus.cc:2272] T 2900e71c0212466e8be300d30595c609 P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.891366  2677 tablet_replica.cc:333] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5: stopping tablet replica
I20260709 12:24:20.891948  2677 raft_consensus.cc:2243] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:20.892589  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08001170c0 after lost signal to thread 2680
I20260709 12:24:20.892593  2677 raft_consensus.cc:2272] T c1565e90e2094af9b0891393186e41da P 328b0b7296c545ff8ea6f7c70f93f2c5 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:20.893910  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08003372c0 after lost signal to thread 3782
W20260709 12:24:20.895131  4605 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2900 after lost signal to thread 4608
I20260709 12:24:22.085803  2677 tablet_server.cc:196] TabletServer@127.2.157.68:0 shutdown complete.
I20260709 12:24:22.159417  2677 master.cc:562] Master@127.2.157.126:36337 shutting down...
W20260709 12:24:22.188482  3796 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:24:22.188818  3796 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:22.189009  3796 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:31.235540  3732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111) [suppressed 288 similar messages]
W20260709 12:24:31.239759  3732 catalog_manager.cc:4755] TS bd47d64594f743eba2922d79251c1c5c (127.2.157.65:37307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e029f255cf96482eb49b53e7dc7ed25d: Network error: Client connection negotiation failed: client connection to 127.2.157.65:37307: connect: Connection refused (error 111)
I20260709 12:24:33.091665  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:33.092823  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:33.093264  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8bd543252a59424d81c6f755d59f4ddf: stopping tablet replica
I20260709 12:24:33.321139  2677 master.cc:584] Master@127.2.157.126:36337 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (256281 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:24:33.446269  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:41099
I20260709 12:24:33.447780  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:33.455392 11496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.455550 11497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.456024 11499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.456588  2677 server_base.cc:1061] running on GCE node
I20260709 12:24:33.460963  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:33.461212  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:33.461330  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599873461320 us; error 0 us; skew 500 ppm
I20260709 12:24:33.461836  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:33.464617  2677 webserver.cc:533] Webserver started at http://127.2.157.126:33777/ using document root <none> and password file <none>
I20260709 12:24:33.465134  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:33.465292  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:33.465514  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:33.466791  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "f5be24357a09446eacbc482ffe0031fc"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.471691  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:24:33.475371 11504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.476382  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:33.476727  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "f5be24357a09446eacbc482ffe0031fc"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.477067  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:33.516072  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:33.517405  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:33.560263  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:41099
I20260709 12:24:33.560361 11556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:41099 every 8 connection(s)
I20260709 12:24:33.564664 11557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:33.576354 11557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: Bootstrap starting.
I20260709 12:24:33.581871 11557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:33.586441 11557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: No bootstrap required, opened a new log
I20260709 12:24:33.588912 11557 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER }
I20260709 12:24:33.589397 11557 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:33.589619 11557 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5be24357a09446eacbc482ffe0031fc, State: Initialized, Role: FOLLOWER
I20260709 12:24:33.590229 11557 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER }
I20260709 12:24:33.590732 11557 raft_consensus.cc:399] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:33.591058 11557 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:33.591341 11557 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:33.596268 11557 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER }
I20260709 12:24:33.596868 11557 leader_election.cc:304] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5be24357a09446eacbc482ffe0031fc; no voters: 
I20260709 12:24:33.598141 11557 leader_election.cc:290] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:33.598533 11560 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:33.600039 11560 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 1 LEADER]: Becoming Leader. State: Replica: f5be24357a09446eacbc482ffe0031fc, State: Running, Role: LEADER
I20260709 12:24:33.600800 11560 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER }
I20260709 12:24:33.601362 11557 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:33.608505 11561 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5be24357a09446eacbc482ffe0031fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER } }
I20260709 12:24:33.609201 11561 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:33.608836 11562 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5be24357a09446eacbc482ffe0031fc. Latest consensus state: current_term: 1 leader_uuid: "f5be24357a09446eacbc482ffe0031fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5be24357a09446eacbc482ffe0031fc" member_type: VOTER } }
I20260709 12:24:33.609822 11562 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:33.611572 11569 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:33.620131 11569 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:33.621289  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:33.630292 11569 catalog_manager.cc:1383] Generated new cluster ID: 8913a6fa840b4f35a284c68a379a3864
I20260709 12:24:33.630594 11569 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:33.646123 11569 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:33.647542 11569 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:33.662389 11569 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: Generated new TSK 0
I20260709 12:24:33.663241 11569 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:33.688215  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:33.695228 11578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.696592 11579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.697933 11581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.699622  2677 server_base.cc:1061] running on GCE node
I20260709 12:24:33.701918  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:33.702113  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:33.702309  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599873702292 us; error 0 us; skew 500 ppm
I20260709 12:24:33.702939  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:33.705624  2677 webserver.cc:533] Webserver started at http://127.2.157.65:43383/ using document root <none> and password file <none>
I20260709 12:24:33.706169  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:33.706336  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:33.706660  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:33.708103  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.713094  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:33.716805 11586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.717653  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:24:33.717984  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.718309  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:33.734772  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:33.736191  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:33.737815  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:33.740366  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:33.740624  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.740869  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:33.741060  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.786881  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:42455
I20260709 12:24:33.787034 11648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:42455 every 8 connection(s)
I20260709 12:24:33.792732  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:33.800457 11653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.803164 11654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.806353  2677 server_base.cc:1061] running on GCE node
W20260709 12:24:33.807071 11656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.809509  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:33.809767  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:33.809952  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599873809937 us; error 0 us; skew 500 ppm
I20260709 12:24:33.810583  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:33.812901 11649 heartbeater.cc:344] Connected to a master server at 127.2.157.126:41099
I20260709 12:24:33.813302 11649 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:33.813859  2677 webserver.cc:533] Webserver started at http://127.2.157.66:42141/ using document root <none> and password file <none>
I20260709 12:24:33.814281 11649 heartbeater.cc:507] Master 127.2.157.126:41099 requested a full tablet report, sending...
I20260709 12:24:33.814442  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:33.814746  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:33.815022  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:33.816569  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "141a039ea83140368c7d19efb49a48bc"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.816789 11521 ts_manager.cc:194] Registered new tserver with Master: a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:33.818778 11521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36700
I20260709 12:24:33.822184  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:33.826189 11661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.827317  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:24:33.827759  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "141a039ea83140368c7d19efb49a48bc"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.828184  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:33.859417  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:33.860919  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:33.862638  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:33.865216  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:33.865473  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.865756  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:33.865953  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.914451  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:41227
I20260709 12:24:33.914583 11724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:41227 every 8 connection(s)
I20260709 12:24:33.920357  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:33.930513 11728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:33.930826 11729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.934603  2677 server_base.cc:1061] running on GCE node
I20260709 12:24:33.935062 11725 heartbeater.cc:344] Connected to a master server at 127.2.157.126:41099
I20260709 12:24:33.935617 11725 heartbeater.cc:461] Registering TS with master...
W20260709 12:24:33.935526 11731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:33.936884 11725 heartbeater.cc:507] Master 127.2.157.126:41099 requested a full tablet report, sending...
I20260709 12:24:33.936985  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:33.937305  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:33.937549  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599873937528 us; error 0 us; skew 500 ppm
I20260709 12:24:33.938405  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:33.939672 11521 ts_manager.cc:194] Registered new tserver with Master: 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:33.941433 11521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36716
I20260709 12:24:33.941501  2677 webserver.cc:533] Webserver started at http://127.2.157.67:45239/ using document root <none> and password file <none>
I20260709 12:24:33.942282  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:33.942552  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:33.942917  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:33.944696  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.951644  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:33.956792 11736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.958214  2677 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:33.958673  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:33.959036  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:33.973078  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:33.974927  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:33.976598  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:33.980202  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:33.980501  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:33.980814  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:33.981014  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:34.030392  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:37587
I20260709 12:24:34.030473 11798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:37587 every 8 connection(s)
I20260709 12:24:34.035719  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:34.044203 11802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:34.046355 11803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:34.047611 11805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:34.050119 11799 heartbeater.cc:344] Connected to a master server at 127.2.157.126:41099
I20260709 12:24:34.050635  2677 server_base.cc:1061] running on GCE node
I20260709 12:24:34.050637 11799 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:34.051819  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:24:34.052021 11799 heartbeater.cc:507] Master 127.2.157.126:41099 requested a full tablet report, sending...
W20260709 12:24:34.052022  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:34.052631  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599874052601 us; error 0 us; skew 500 ppm
I20260709 12:24:34.053304  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:34.054875 11521 ts_manager.cc:194] Registered new tserver with Master: 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:34.056180  2677 webserver.cc:533] Webserver started at http://127.2.157.68:36229/ using document root <none> and password file <none>
I20260709 12:24:34.056810  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:34.056826 11521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36730
I20260709 12:24:34.057152  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:34.057566  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:34.058892  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-3-root/instance:
uuid: "ed4262e8a41a45cebe0b2587d48e1135"
format_stamp: "Formatted at 2026-07-09 12:24:34 on dist-test-slave-sx71"
I20260709 12:24:34.063809  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:24:34.067632 11810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:34.068543  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:24:34.068888  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
uuid: "ed4262e8a41a45cebe0b2587d48e1135"
format_stamp: "Formatted at 2026-07-09 12:24:34 on dist-test-slave-sx71"
I20260709 12:24:34.069202  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:34.097170  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:34.098537  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:34.099963  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:34.102430  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:34.102690  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:34.102937  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:34.103114  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:34.149314  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.68:43831
I20260709 12:24:34.149444 11873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.68:43831 every 8 connection(s)
I20260709 12:24:34.165437 11874 heartbeater.cc:344] Connected to a master server at 127.2.157.126:41099
I20260709 12:24:34.165961 11874 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:34.166942 11874 heartbeater.cc:507] Master 127.2.157.126:41099 requested a full tablet report, sending...
I20260709 12:24:34.169250 11521 ts_manager.cc:194] Registered new tserver with Master: ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:34.170259  2677 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017433353s
I20260709 12:24:34.170933 11521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36738
I20260709 12:24:34.198585 11521 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36746:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:24:34.488395 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 93a33d2febb741e6840067d443720a5a (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:34.490258 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a33d2febb741e6840067d443720a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.496632 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 93a33d2febb741e6840067d443720a5a (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:34.498288 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a33d2febb741e6840067d443720a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.499007 11763 tablet_service.cc:1511] Processing CreateTablet for tablet d6b59f3bf0bd4720a292c993753e9535 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:34.500780 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b59f3bf0bd4720a292c993753e9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.501703 11688 tablet_service.cc:1511] Processing CreateTablet for tablet d6b59f3bf0bd4720a292c993753e9535 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:34.503592 11688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b59f3bf0bd4720a292c993753e9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.503262 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 412607e4f40b48cb9d7d91c15c2f0d1c (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:34.505045 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412607e4f40b48cb9d7d91c15c2f0d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.508903 11761 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7553e005f3406698c40ed7d949f864 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:34.510596 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7553e005f3406698c40ed7d949f864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.513314 11762 tablet_service.cc:1511] Processing CreateTablet for tablet 40d00c475c524bf09cb644cdbd0d6765 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:34.514986 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d00c475c524bf09cb644cdbd0d6765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.516924 11759 tablet_service.cc:1511] Processing CreateTablet for tablet 826145f71fd94539864327f8c9f806ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:34.517200 11687 tablet_service.cc:1511] Processing CreateTablet for tablet 891213c70e5a40d085c955386f620b0f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:34.517457 11758 tablet_service.cc:1511] Processing CreateTablet for tablet 48afc51fa9e34dc0a796be2dcaf58501 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:34.518743 11687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891213c70e5a40d085c955386f620b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.518759 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826145f71fd94539864327f8c9f806ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.519727 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48afc51fa9e34dc0a796be2dcaf58501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.525714 11686 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7553e005f3406698c40ed7d949f864 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:34.528720 11685 tablet_service.cc:1511] Processing CreateTablet for tablet 22be73ed83804329a321f34cba74e33d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:34.531291 11684 tablet_service.cc:1511] Processing CreateTablet for tablet 826145f71fd94539864327f8c9f806ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:34.532909 11757 tablet_service.cc:1511] Processing CreateTablet for tablet 43ec9bad6eb04d448bbfb563a7675db2 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:34.533839 11683 tablet_service.cc:1511] Processing CreateTablet for tablet 48afc51fa9e34dc0a796be2dcaf58501 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:34.534566 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ec9bad6eb04d448bbfb563a7675db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.536252 11682 tablet_service.cc:1511] Processing CreateTablet for tablet ba98915c34f347fdb7e429eef931c7ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:34.538810 11681 tablet_service.cc:1511] Processing CreateTablet for tablet ddf12fde1d684537ae6ffc7c071107a7 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:34.541597 11756 tablet_service.cc:1511] Processing CreateTablet for tablet ddf12fde1d684537ae6ffc7c071107a7 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:34.527349 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7553e005f3406698c40ed7d949f864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.543229 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf12fde1d684537ae6ffc7c071107a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.548728 11835 tablet_service.cc:1511] Processing CreateTablet for tablet 412607e4f40b48cb9d7d91c15c2f0d1c (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:34.549160 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 22be73ed83804329a321f34cba74e33d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:34.550263 11835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412607e4f40b48cb9d7d91c15c2f0d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.551931 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98915c34f347fdb7e429eef931c7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.552723 11834 tablet_service.cc:1511] Processing CreateTablet for tablet 826145f71fd94539864327f8c9f806ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:34.554157 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826145f71fd94539864327f8c9f806ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.556824 11614 tablet_service.cc:1511] Processing CreateTablet for tablet d6b59f3bf0bd4720a292c993753e9535 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:34.557566 11831 tablet_service.cc:1511] Processing CreateTablet for tablet 43ec9bad6eb04d448bbfb563a7675db2 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:34.558629 11614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b59f3bf0bd4720a292c993753e9535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.559136 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ec9bad6eb04d448bbfb563a7675db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.559947 11685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be73ed83804329a321f34cba74e33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.561014 11613 tablet_service.cc:1511] Processing CreateTablet for tablet 891213c70e5a40d085c955386f620b0f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:34.561304 11830 tablet_service.cc:1511] Processing CreateTablet for tablet ddf12fde1d684537ae6ffc7c071107a7 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:34.562409 11613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891213c70e5a40d085c955386f620b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.563850 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be73ed83804329a321f34cba74e33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.564741 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 40d00c475c524bf09cb644cdbd0d6765 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:34.567318 11611 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7553e005f3406698c40ed7d949f864 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:34.569893 11610 tablet_service.cc:1511] Processing CreateTablet for tablet 22be73ed83804329a321f34cba74e33d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:34.571630 11681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf12fde1d684537ae6ffc7c071107a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.572427 11833 tablet_service.cc:1511] Processing CreateTablet for tablet ba98915c34f347fdb7e429eef931c7ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:34.549187 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 40d00c475c524bf09cb644cdbd0d6765 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:34.546864 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 93a33d2febb741e6840067d443720a5a (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:34.574721 11683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48afc51fa9e34dc0a796be2dcaf58501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.547115 11838 tablet_service.cc:1511] Processing CreateTablet for tablet 891213c70e5a40d085c955386f620b0f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:34.577430 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826145f71fd94539864327f8c9f806ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.580828 11608 tablet_service.cc:1511] Processing CreateTablet for tablet 48afc51fa9e34dc0a796be2dcaf58501 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:34.584092 11607 tablet_service.cc:1511] Processing CreateTablet for tablet ba98915c34f347fdb7e429eef931c7ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:34.587203 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 43ec9bad6eb04d448bbfb563a7675db2 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:34.578945 11609 tablet_service.cc:1511] Processing CreateTablet for tablet 412607e4f40b48cb9d7d91c15c2f0d1c (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:34.567837 11830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf12fde1d684537ae6ffc7c071107a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.600109 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a33d2febb741e6840067d443720a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.603636 11838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 891213c70e5a40d085c955386f620b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.605278 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98915c34f347fdb7e429eef931c7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.606662 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d00c475c524bf09cb644cdbd0d6765. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:34.613807 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:34.617659 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d00c475c524bf09cb644cdbd0d6765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.619433 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412607e4f40b48cb9d7d91c15c2f0d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.621028 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be73ed83804329a321f34cba74e33d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.622541 11607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba98915c34f347fdb7e429eef931c7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.624095 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ec9bad6eb04d448bbfb563a7675db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.625639 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7553e005f3406698c40ed7d949f864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.627207 11608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48afc51fa9e34dc0a796be2dcaf58501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.634831 11680 tablet_service.cc:1511] Processing CreateTablet for tablet 80b3401de6ec4056b042aa09ec1abaa8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:34.638216 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3401de6ec4056b042aa09ec1abaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.643337 11894 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:34.660971 11605 tablet_service.cc:1511] Processing CreateTablet for tablet 80b3401de6ec4056b042aa09ec1abaa8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:34.662258 11763 tablet_service.cc:1511] Processing CreateTablet for tablet 80b3401de6ec4056b042aa09ec1abaa8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:34.663816 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3401de6ec4056b042aa09ec1abaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.666345 11605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3401de6ec4056b042aa09ec1abaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.681979 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 08646ea4ad114214a14c66377f11e4be (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:34.683619 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08646ea4ad114214a14c66377f11e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.706264 11894 tablet_bootstrap.cc:654] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:34.716511 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 08646ea4ad114214a14c66377f11e4be (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:34.718075 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08646ea4ad114214a14c66377f11e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.725967 11611 tablet_service.cc:1511] Processing CreateTablet for tablet 08646ea4ad114214a14c66377f11e4be (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:34.731159 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 07a473b2d6004593b4924bce2b7af51f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:34.731906 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08646ea4ad114214a14c66377f11e4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.762272 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a473b2d6004593b4924bce2b7af51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.772445 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 07a473b2d6004593b4924bce2b7af51f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:34.784245 11895 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:34.794312 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 07a473b2d6004593b4924bce2b7af51f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:34.799858 11684 tablet_service.cc:1511] Processing CreateTablet for tablet b742388171e940eabb3e896f3946f3c3 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:34.801401 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b742388171e940eabb3e896f3946f3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.802780 11895 tablet_bootstrap.cc:654] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:34.804143 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7089136bb8430a80f9cb95512704ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:34.805745 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7089136bb8430a80f9cb95512704ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.805490 11764 tablet_service.cc:1511] Processing CreateTablet for tablet b742388171e940eabb3e896f3946f3c3 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:34.807113 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b742388171e940eabb3e896f3946f3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.811863 11829 tablet_service.cc:1511] Processing CreateTablet for tablet b742388171e940eabb3e896f3946f3c3 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:34.813454 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b742388171e940eabb3e896f3946f3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.822219 11649 heartbeater.cc:499] Master 127.2.157.126:41099 was elected leader, sending a full tablet report...
I20260709 12:24:34.823786 11897 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:34.823957 11896 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:34.831748 11896 tablet_bootstrap.cc:654] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:34.839784 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a473b2d6004593b4924bce2b7af51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.857707 11897 tablet_bootstrap.cc:654] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:34.859611 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a473b2d6004593b4924bce2b7af51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.879401 11680 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7089136bb8430a80f9cb95512704ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:34.880968 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7089136bb8430a80f9cb95512704ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.880681 11756 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7089136bb8430a80f9cb95512704ad (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:34.882094 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7089136bb8430a80f9cb95512704ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.883915 11894 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:34.884476 11894 ts_tablet_manager.cc:1403] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.242s	user 0.010s	sys 0.009s
I20260709 12:24:34.894244 11833 tablet_service.cc:1511] Processing CreateTablet for tablet 97353355e64b4a2baa32282604facc78 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:34.895764 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97353355e64b4a2baa32282604facc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.905757 11611 tablet_service.cc:1511] Processing CreateTablet for tablet 97353355e64b4a2baa32282604facc78 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:34.907191 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97353355e64b4a2baa32282604facc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.909430 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 97353355e64b4a2baa32282604facc78 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:34.910800 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97353355e64b4a2baa32282604facc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.915760 11894 raft_consensus.cc:359] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:34.916582 11894 raft_consensus.cc:385] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:34.916893 11894 raft_consensus.cc:740] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:34.917735 11894 consensus_queue.cc:260] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:34.924062 11895 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:34.923784 11609 tablet_service.cc:1511] Processing CreateTablet for tablet fd301d1462624fbf813790e481f7aced (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:34.924614 11895 ts_tablet_manager.cc:1403] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.021s
I20260709 12:24:34.925293 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd301d1462624fbf813790e481f7aced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.925882 11760 tablet_service.cc:1511] Processing CreateTablet for tablet fd301d1462624fbf813790e481f7aced (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:34.927217 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd301d1462624fbf813790e481f7aced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.928273 11895 raft_consensus.cc:359] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:34.929090 11895 raft_consensus.cc:385] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:34.929395 11895 raft_consensus.cc:740] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:34.930188 11895 consensus_queue.cc:260] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:34.934512 11897 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:34.935058 11897 ts_tablet_manager.cc:1403] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.112s	user 0.005s	sys 0.011s
I20260709 12:24:34.942132 11837 tablet_service.cc:1511] Processing CreateTablet for tablet fd301d1462624fbf813790e481f7aced (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:34.943934 11684 tablet_service.cc:1511] Processing CreateTablet for tablet 8272e93c7c9c428d9d914614986ff95d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:34.944550 11725 heartbeater.cc:499] Master 127.2.157.126:41099 was elected leader, sending a full tablet report...
I20260709 12:24:34.944816 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd301d1462624fbf813790e481f7aced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.945308 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8272e93c7c9c428d9d914614986ff95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.947935 11897 raft_consensus.cc:359] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:34.948765 11897 raft_consensus.cc:385] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:34.949077 11897 raft_consensus.cc:740] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:34.954380 11894 ts_tablet_manager.cc:1434] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.010s
I20260709 12:24:34.955377 11799 heartbeater.cc:499] Master 127.2.157.126:41099 was elected leader, sending a full tablet report...
I20260709 12:24:34.955807 11894 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:34.958981 11896 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:34.959630 11896 ts_tablet_manager.cc:1403] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.136s	user 0.017s	sys 0.019s
I20260709 12:24:34.961971 11763 tablet_service.cc:1511] Processing CreateTablet for tablet 8272e93c7c9c428d9d914614986ff95d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:34.963160 11896 raft_consensus.cc:359] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:34.964017 11896 raft_consensus.cc:385] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:34.964327 11896 raft_consensus.cc:740] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:34.965834 11897 consensus_queue.cc:260] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:34.966703 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8272e93c7c9c428d9d914614986ff95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.970206 11894 tablet_bootstrap.cc:654] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:34.972074 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 8272e93c7c9c428d9d914614986ff95d (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:34.990833 11610 tablet_service.cc:1511] Processing CreateTablet for tablet f2ec367784484300bff9019d060541ca (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:34.991539 11902 raft_consensus.cc:493] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.991945 11760 tablet_service.cc:1511] Processing CreateTablet for tablet f2ec367784484300bff9019d060541ca (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:34.992928 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ec367784484300bff9019d060541ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.992353 11902 raft_consensus.cc:515] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:34.980042 11680 tablet_service.cc:1511] Processing CreateTablet for tablet f2ec367784484300bff9019d060541ca (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:35.001124 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ec367784484300bff9019d060541ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:34.982980 11896 consensus_queue.cc:260] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.005455 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ec367784484300bff9019d060541ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.006927 11902 leader_election.cc:290] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:35.007619 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8272e93c7c9c428d9d914614986ff95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.038524 11897 ts_tablet_manager.cc:1434] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.102s	user 0.016s	sys 0.014s
I20260709 12:24:35.039844 11897 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:35.041407 11800 tablet.cc:2406] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:35.041082 11833 tablet_service.cc:1511] Processing CreateTablet for tablet b6631247217f4eb9b8113265bfd7ef14 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:35.042557 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6631247217f4eb9b8113265bfd7ef14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.044391 11606 tablet_service.cc:1511] Processing CreateTablet for tablet b6631247217f4eb9b8113265bfd7ef14 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:35.044320 11685 tablet_service.cc:1511] Processing CreateTablet for tablet b6631247217f4eb9b8113265bfd7ef14 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:35.046530 11894 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:35.046825 11685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6631247217f4eb9b8113265bfd7ef14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.047092 11894 ts_tablet_manager.cc:1403] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.009s
I20260709 12:24:35.047314 11905 raft_consensus.cc:493] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.047889 11905 raft_consensus.cc:515] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.050287 11831 tablet_service.cc:1511] Processing CreateTablet for tablet 224a9910fdc3406d86818fe98f0e8a0b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:35.064369 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224a9910fdc3406d86818fe98f0e8a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.060837 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6631247217f4eb9b8113265bfd7ef14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.066229 11895 ts_tablet_manager.cc:1434] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.141s	user 0.012s	sys 0.011s
I20260709 12:24:35.067520 11895 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:35.075414 11874 heartbeater.cc:499] Master 127.2.157.126:41099 was elected leader, sending a full tablet report...
I20260709 12:24:35.085657 11894 raft_consensus.cc:359] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.086550 11894 raft_consensus.cc:385] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.086858 11894 raft_consensus.cc:740] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.087194 11895 tablet_bootstrap.cc:654] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.106698 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 224a9910fdc3406d86818fe98f0e8a0b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:35.112697 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224a9910fdc3406d86818fe98f0e8a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.112409 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 224a9910fdc3406d86818fe98f0e8a0b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:35.113793 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224a9910fdc3406d86818fe98f0e8a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.099597 11905 leader_election.cc:290] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:35.123883 11896 ts_tablet_manager.cc:1434] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.164s	user 0.011s	sys 0.003s
I20260709 12:24:35.125141 11896 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:35.134521 11897 tablet_bootstrap.cc:654] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.107270 11894 consensus_queue.cc:260] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.140224 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:35.142323 11756 tablet_service.cc:1511] Processing CreateTablet for tablet 8979e35797a74681b5631a8b7b269607 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:35.143843 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8979e35797a74681b5631a8b7b269607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.145032 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 8979e35797a74681b5631a8b7b269607 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:35.146359 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8979e35797a74681b5631a8b7b269607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.149488 11609 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd102418f4a969650594d69177b7f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:35.150951 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd102418f4a969650594d69177b7f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.143716 11739 leader_election.cc:343] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.162096 11894 ts_tablet_manager.cc:1434] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.110s	user 0.004s	sys 0.003s
I20260709 12:24:35.170483 11896 tablet_bootstrap.cc:654] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.183213 11758 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd102418f4a969650594d69177b7f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:35.185681 11894 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:35.188148 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd102418f4a969650594d69177b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.192907 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:35.194670 11664 leader_election.cc:343] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.203833 11904 raft_consensus.cc:493] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.204669 11904 raft_consensus.cc:515] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.208483 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:35.216653 11904 leader_election.cc:290] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:35.233893 11896 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:35.235054 11896 ts_tablet_manager.cc:1403] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.000s
I20260709 12:24:35.237397 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:35.238636 11894 tablet_bootstrap.cc:654] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.233613 11684 tablet_service.cc:1511] Processing CreateTablet for tablet 8979e35797a74681b5631a8b7b269607 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:35.239259 11896 raft_consensus.cc:359] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.239939 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8979e35797a74681b5631a8b7b269607. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.229493 11740 leader_election.cc:343] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.241745 11895 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:35.247991 11895 ts_tablet_manager.cc:1403] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.001s
W20260709 12:24:35.248298 11663 leader_election.cc:343] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.248901 11663 leader_election.cc:304] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:35.249794 11905 raft_consensus.cc:2749] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.251616 11740 leader_election.cc:304] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:35.252457 11895 raft_consensus.cc:359] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.253330 11895 raft_consensus.cc:385] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.253640 11895 raft_consensus.cc:740] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.254485 11902 raft_consensus.cc:2749] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.258297 11895 consensus_queue.cc:260] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.262708 11680 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd102418f4a969650594d69177b7f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:35.264374 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd102418f4a969650594d69177b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.268358 11895 ts_tablet_manager.cc:1434] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:24:35.268525 11829 tablet_service.cc:1511] Processing CreateTablet for tablet fea76dbfd7d0485ab14a3eedef8a4ff1 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:35.270062 11895 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:35.258819 11896 raft_consensus.cc:385] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.274870 11896 raft_consensus.cc:740] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.277513 11896 consensus_queue.cc:260] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.289454 11896 ts_tablet_manager.cc:1434] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:24:35.290616 11896 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:35.290822 11837 tablet_service.cc:1511] Processing CreateTablet for tablet c8f52aa43c6f4920af39015011c44a84 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:35.295423 11909 raft_consensus.cc:493] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.296083 11909 raft_consensus.cc:515] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.296450 11689 tablet_service.cc:1511] Processing CreateTablet for tablet fea76dbfd7d0485ab14a3eedef8a4ff1 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:35.297955 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea76dbfd7d0485ab14a3eedef8a4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.313642 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 451a1a4e56614af883d9ce0b87370816 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:35.314320 11681 tablet_service.cc:1511] Processing CreateTablet for tablet 451a1a4e56614af883d9ce0b87370816 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:35.307327 11909 leader_election.cc:290] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:35.315610 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451a1a4e56614af883d9ce0b87370816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.316505 11681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451a1a4e56614af883d9ce0b87370816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.270426 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea76dbfd7d0485ab14a3eedef8a4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.327860 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f52aa43c6f4920af39015011c44a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.337863 11897 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:35.338837 11897 ts_tablet_manager.cc:1403] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.299s	user 0.026s	sys 0.007s
I20260709 12:24:35.348928 11606 tablet_service.cc:1511] Processing CreateTablet for tablet fea76dbfd7d0485ab14a3eedef8a4ff1 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:35.352144 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.354019 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:35.354178 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 451a1a4e56614af883d9ce0b87370816 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:35.360453 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea76dbfd7d0485ab14a3eedef8a4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.361371 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451a1a4e56614af883d9ce0b87370816. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.362839 11588 leader_election.cc:343] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.366770 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5912f7aa3418da40210943458bf43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:35.368427 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5912f7aa3418da40210943458bf43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.370121 11588 leader_election.cc:343] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.352823 11609 tablet_service.cc:1511] Processing CreateTablet for tablet c8f52aa43c6f4920af39015011c44a84 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:35.371904 11682 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5912f7aa3418da40210943458bf43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:35.375954 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5912f7aa3418da40210943458bf43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.377672 11758 tablet_service.cc:1511] Processing CreateTablet for tablet c8f52aa43c6f4920af39015011c44a84 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:35.371289 11588 leader_election.cc:304] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:35.384320 11904 raft_consensus.cc:2749] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.387822 11756 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff5912f7aa3418da40210943458bf43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:35.389241 11902 raft_consensus.cc:493] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.389820 11902 raft_consensus.cc:515] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.389938 11833 tablet_service.cc:1511] Processing CreateTablet for tablet 58e3e708e6c145bc81691e6cbd7eb0a6 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:35.390782 11895 tablet_bootstrap.cc:654] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.391311 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e3e708e6c145bc81691e6cbd7eb0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.393219 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:35.394956 11740 leader_election.cc:343] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.395196 11902 leader_election.cc:290] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:35.399928 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.400959 11897 raft_consensus.cc:359] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.401830 11897 raft_consensus.cc:385] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.402125 11897 raft_consensus.cc:740] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.403321 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff5912f7aa3418da40210943458bf43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.403779 11897 consensus_queue.cc:260] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.405748 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:35.407666 11813 leader_election.cc:343] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.410305 11896 tablet_bootstrap.cc:654] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.411201 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:35.407727 11894 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
W20260709 12:24:35.415283 11738 leader_election.cc:343] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.415868 11738 leader_election.cc:304] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:35.416735 11902 raft_consensus.cc:2749] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.417186 11894 ts_tablet_manager.cc:1403] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.232s	user 0.028s	sys 0.026s
I20260709 12:24:35.420697 11894 raft_consensus.cc:359] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.421497 11894 raft_consensus.cc:385] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.421808 11894 raft_consensus.cc:740] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.422634 11894 consensus_queue.cc:260] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.423602 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f52aa43c6f4920af39015011c44a84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:35.423509 11812 leader_election.cc:343] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.430557 11895 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:35.430787 11812 leader_election.cc:304] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:35.430804 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 58e3e708e6c145bc81691e6cbd7eb0a6 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:35.432034 11909 raft_consensus.cc:2749] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.431196 11895 ts_tablet_manager.cc:1403] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.002s
I20260709 12:24:35.429390 11904 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.423537 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f52aa43c6f4920af39015011c44a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.434966 11904 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.437700 11904 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.442957 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.443768 11774 raft_consensus.cc:2468] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:35.445719 11588 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:35.446656 11904 raft_consensus.cc:2804] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:35.447044 11904 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.447502 11904 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.447111 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 58e3e708e6c145bc81691e6cbd7eb0a6 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:35.448571 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e3e708e6c145bc81691e6cbd7eb0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.450927 11894 ts_tablet_manager.cc:1434] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:24:35.445173 11895 raft_consensus.cc:359] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.451893 11895 raft_consensus.cc:385] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.452236 11895 raft_consensus.cc:740] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.453387 11895 consensus_queue.cc:260] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.455864 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e3e708e6c145bc81691e6cbd7eb0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.458717 11895 ts_tablet_manager.cc:1434] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:24:35.460004 11895 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:35.462801 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:35.464615 11897 ts_tablet_manager.cc:1434] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.003s
W20260709 12:24:35.464706 11590 leader_election.cc:343] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.452306 11894 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:35.473556 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd851065052495d9905854dd7e0d1f8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:35.475008 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd851065052495d9905854dd7e0d1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.477591 11896 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:35.478281 11896 ts_tablet_manager.cc:1403] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.188s	user 0.007s	sys 0.009s
I20260709 12:24:35.480067 11897 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:35.483009 11896 raft_consensus.cc:359] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.487246 11909 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.491317 11896 raft_consensus.cc:385] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.491806 11896 raft_consensus.cc:740] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.491555 11909 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.492846 11896 consensus_queue.cc:260] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.493347 11904 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.496814 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
W20260709 12:24:35.498467 11590 leader_election.cc:343] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.498520 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:35.494261 11909 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:35.490350 11905 raft_consensus.cc:493] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.500450 11905 raft_consensus.cc:515] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:35.505182 11813 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.508584 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:35.510402 11814 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.510903 11814 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:35.502818 11897 tablet_bootstrap.cc:654] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.512027 11895 tablet_bootstrap.cc:654] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.512521 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:35.514241 11664 leader_election.cc:343] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.503161 11905 leader_election.cc:290] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.518415 11909 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:35.519943 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.520943 11774 raft_consensus.cc:2468] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:35.521281 11904 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.522444 11663 leader_election.cc:304] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:35.522660 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:35.524225 11774 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.525146 11894 tablet_bootstrap.cc:654] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.527786 11905 raft_consensus.cc:2804] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:35.528331 11905 raft_consensus.cc:493] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.528754 11905 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.529640 11896 ts_tablet_manager.cc:1434] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:24:35.529881 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd851065052495d9905854dd7e0d1f8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:35.530853 11896 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:35.532008 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd851065052495d9905854dd7e0d1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.540299 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 3bd851065052495d9905854dd7e0d1f8 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:35.542121 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd851065052495d9905854dd7e0d1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.546131 11774 raft_consensus.cc:2468] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:35.547832 11588 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:35.548812 11904 raft_consensus.cc:2804] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:35.556650 11680 tablet_service.cc:1511] Processing CreateTablet for tablet f8a60b4de2d84722b898bd80d5fed966 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:35.558300 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a60b4de2d84722b898bd80d5fed966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.558676 11905 raft_consensus.cc:515] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.556670 11895 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:35.564177 11895 ts_tablet_manager.cc:1403] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.002s
I20260709 12:24:35.585101 11760 tablet_service.cc:1511] Processing CreateTablet for tablet f8a60b4de2d84722b898bd80d5fed966 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:35.586580 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a60b4de2d84722b898bd80d5fed966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.586899 11896 tablet_bootstrap.cc:654] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.588795 11609 tablet_service.cc:1511] Processing CreateTablet for tablet feb74090705a402e9f360b6e9a2dfbee (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:35.589502 11682 tablet_service.cc:1511] Processing CreateTablet for tablet feb74090705a402e9f360b6e9a2dfbee (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:35.590231 11756 tablet_service.cc:1511] Processing CreateTablet for tablet feb74090705a402e9f360b6e9a2dfbee (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:35.590826 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb74090705a402e9f360b6e9a2dfbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.591653 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb74090705a402e9f360b6e9a2dfbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.593204 11833 tablet_service.cc:1511] Processing CreateTablet for tablet 0821f1ba5d454c60969fe784eb8f4587 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:35.594588 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821f1ba5d454c60969fe784eb8f4587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.590232 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb74090705a402e9f360b6e9a2dfbee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.596504 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 0821f1ba5d454c60969fe784eb8f4587 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:35.597391 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 93e850aa3e4f4123bb241a8c42c6fba4 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:35.597903 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821f1ba5d454c60969fe784eb8f4587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.598820 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e850aa3e4f4123bb241a8c42c6fba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.600194 11895 raft_consensus.cc:359] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.600520 11684 tablet_service.cc:1511] Processing CreateTablet for tablet 0821f1ba5d454c60969fe784eb8f4587 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:35.600987 11895 raft_consensus.cc:385] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.601366 11895 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.601881 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0821f1ba5d454c60969fe784eb8f4587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.602192 11895 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.603154 11894 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:35.603710 11894 ts_tablet_manager.cc:1403] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.152s	user 0.020s	sys 0.016s
I20260709 12:24:35.612952 11895 ts_tablet_manager.cc:1434] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:24:35.614248 11895 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
W20260709 12:24:35.616559 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:35.619597 11894 raft_consensus.cc:359] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.620241 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 93e850aa3e4f4123bb241a8c42c6fba4 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:35.620762 11829 tablet_service.cc:1511] Processing CreateTablet for tablet f8a60b4de2d84722b898bd80d5fed966 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:35.621716 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e850aa3e4f4123bb241a8c42c6fba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.582121 11904 raft_consensus.cc:697] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:35.622402 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8a60b4de2d84722b898bd80d5fed966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.622750 11904 consensus_queue.cc:237] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.620518 11894 raft_consensus.cc:385] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.624181 11894 raft_consensus.cc:740] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.626032 11894 consensus_queue.cc:260] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.621311 11897 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:35.631167 11894 ts_tablet_manager.cc:1434] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:24:35.631300 11929 raft_consensus.cc:493] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.641184 11894 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:35.640707 11929 raft_consensus.cc:515] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.644774 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:35.645159 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.646097 11774 raft_consensus.cc:2468] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
W20260709 12:24:35.646788 11814 leader_election.cc:343] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.647758 11812 leader_election.cc:304] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:35.648308 11894 tablet_bootstrap.cc:654] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.649001 11909 raft_consensus.cc:2804] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:35.649552 11909 raft_consensus.cc:493] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.649981 11909 raft_consensus.cc:3060] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.655604 11929 leader_election.cc:290] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.684439 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 93e850aa3e4f4123bb241a8c42c6fba4 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:35.686053 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e850aa3e4f4123bb241a8c42c6fba4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.696389 11905 leader_election.cc:290] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.698347 11689 tablet_service.cc:1511] Processing CreateTablet for tablet bffaa0a9d87c431ba2962fb1ba98a6b5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:35.699738 11897 ts_tablet_manager.cc:1403] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.220s	user 0.008s	sys 0.012s
I20260709 12:24:35.703789 11836 tablet_service.cc:1511] Processing CreateTablet for tablet bffaa0a9d87c431ba2962fb1ba98a6b5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:35.705365 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffaa0a9d87c431ba2962fb1ba98a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.707938 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffaa0a9d87c431ba2962fb1ba98a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.711971 11609 tablet_service.cc:1511] Processing CreateTablet for tablet 99eb28e8992c4572b48c7a6e40155938 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:35.713701 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb28e8992c4572b48c7a6e40155938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.728376 11905 raft_consensus.cc:493] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.729099 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:35.729002 11905 raft_consensus.cc:515] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.740240 11895 tablet_bootstrap.cc:654] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.741480 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:35.742182 11774 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:35.740276 11664 leader_election.cc:343] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.749198 11764 tablet_service.cc:1511] Processing CreateTablet for tablet bffaa0a9d87c431ba2962fb1ba98a6b5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:35.749354 11758 tablet_service.cc:1511] Processing CreateTablet for tablet 99eb28e8992c4572b48c7a6e40155938 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:35.750869 11774 raft_consensus.cc:2468] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:35.753329 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffaa0a9d87c431ba2962fb1ba98a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.732515 11897 raft_consensus.cc:359] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.760368 11906 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.761885 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb28e8992c4572b48c7a6e40155938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.762439 11897 raft_consensus.cc:385] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.771341 11610 tablet_service.cc:1511] Processing CreateTablet for tablet 28755e05e0c142a8a2e116e1c788f197 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:35.773022 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28755e05e0c142a8a2e116e1c788f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.772807 11831 tablet_service.cc:1511] Processing CreateTablet for tablet 28755e05e0c142a8a2e116e1c788f197 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:35.772370 11519 catalog_manager.cc:5697] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.774243 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28755e05e0c142a8a2e116e1c788f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.762949 11906 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.768743 11663 leader_election.cc:304] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:35.777228 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cbbcd57984472b9a0ffee2f76bb32 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:35.777873 11611 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cbbcd57984472b9a0ffee2f76bb32 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:35.778549 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:35.779232 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cbbcd57984472b9a0ffee2f76bb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.784017 11905 leader_election.cc:290] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:35.784679 11905 raft_consensus.cc:2804] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:35.785138 11905 raft_consensus.cc:697] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:35.780825 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cbbcd57984472b9a0ffee2f76bb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.786031 11905 consensus_queue.cc:237] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.768951 11897 raft_consensus.cc:740] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.788189 11897 consensus_queue.cc:260] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.790552 11897 ts_tablet_manager.cc:1434] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.004s
W20260709 12:24:35.781342 11664 leader_election.cc:343] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.777663 11906 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.800593 11756 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8cbbcd57984472b9a0ffee2f76bb32 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:35.800997 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 94e944029a644ed2a0dd77f44e800a3b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:35.802299 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8cbbcd57984472b9a0ffee2f76bb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.803001 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e944029a644ed2a0dd77f44e800a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.805601 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 94e944029a644ed2a0dd77f44e800a3b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:35.807427 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e944029a644ed2a0dd77f44e800a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.808406 11680 tablet_service.cc:1511] Processing CreateTablet for tablet 99eb28e8992c4572b48c7a6e40155938 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:35.810101 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb28e8992c4572b48c7a6e40155938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.814075 11896 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:35.814774 11896 ts_tablet_manager.cc:1403] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.284s	user 0.008s	sys 0.041s
I20260709 12:24:35.824575 11897 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:35.831591 11902 raft_consensus.cc:493] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.832219 11902 raft_consensus.cc:515] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.834442 11902 leader_election.cc:290] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:35.841220 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:35.841658 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:35.842041 11624 raft_consensus.cc:2468] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
W20260709 12:24:35.843420 11738 leader_election.cc:343] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.843720 11896 raft_consensus.cc:359] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.844158 11739 leader_election.cc:304] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:35.844547 11896 raft_consensus.cc:385] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.844918 11896 raft_consensus.cc:740] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.845455 11902 raft_consensus.cc:2804] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:35.845877 11902 raft_consensus.cc:493] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.850287 11902 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.851364 11894 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:35.851984 11894 ts_tablet_manager.cc:1403] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.211s	user 0.017s	sys 0.007s
I20260709 12:24:35.855335 11894 raft_consensus.cc:359] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.845775 11896 consensus_queue.cc:260] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.875039 11896 ts_tablet_manager.cc:1434] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.005s
I20260709 12:24:35.875193 11894 raft_consensus.cc:385] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.888557 11610 tablet_service.cc:1511] Processing CreateTablet for tablet 910c074d754749b9b864ab7017c2a8db (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:35.891620 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910c074d754749b9b864ab7017c2a8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.893294 11895 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:35.893854 11895 ts_tablet_manager.cc:1403] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.280s	user 0.009s	sys 0.019s
I20260709 12:24:35.896296 11897 tablet_bootstrap.cc:654] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.896994 11895 raft_consensus.cc:359] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.897893 11895 raft_consensus.cc:385] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:35.897202 11518 catalog_manager.cc:5697] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.898211 11895 raft_consensus.cc:740] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:35.899091 11895 consensus_queue.cc:260] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:35.899832 11896 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:35.901662 11895 ts_tablet_manager.cc:1434] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:35.902895 11895 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:35.903864 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 910c074d754749b9b864ab7017c2a8db (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:35.874964 11909 raft_consensus.cc:515] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:35.885550 11894 raft_consensus.cc:740] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
W20260709 12:24:35.882977 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 115836us
I20260709 12:24:35.920022 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 4efa13ea53b04377b4e94d50ebd901c5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:35.915943 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910c074d754749b9b864ab7017c2a8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.908548 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 4efa13ea53b04377b4e94d50ebd901c5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:35.926774 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efa13ea53b04377b4e94d50ebd901c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.928473 11896 tablet_bootstrap.cc:654] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:35.931525 11894 consensus_queue.cc:260] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.935084 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.936180 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:35.938285 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efa13ea53b04377b4e94d50ebd901c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.938689 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:35.941479 11684 tablet_service.cc:1511] Processing CreateTablet for tablet 28755e05e0c142a8a2e116e1c788f197 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:35.942965 11684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28755e05e0c142a8a2e116e1c788f197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.946301 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
W20260709 12:24:35.948181 11814 leader_election.cc:343] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.949155 11682 tablet_service.cc:1511] Processing CreateTablet for tablet 94e944029a644ed2a0dd77f44e800a3b (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:35.950876 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e944029a644ed2a0dd77f44e800a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.950995 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826145f71fd94539864327f8c9f806ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:35.951670 11773 raft_consensus.cc:3060] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:35.954252 11680 tablet_service.cc:1511] Processing CreateTablet for tablet 910c074d754749b9b864ab7017c2a8db (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:35.954506 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 4efa13ea53b04377b4e94d50ebd901c5 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:24:35.954727 11663 leader_election.cc:343] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:35.955600 11663 leader_election.cc:343] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:35.955681 11909 leader_election.cc:290] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:35.956115 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efa13ea53b04377b4e94d50ebd901c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.961347 11909 raft_consensus.cc:493] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.962066 11941 raft_consensus.cc:493] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.962356 11909 raft_consensus.cc:515] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:35.962724 11941 raft_consensus.cc:515] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.965422 11894 ts_tablet_manager.cc:1434] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.113s	user 0.005s	sys 0.007s
I20260709 12:24:35.966670 11894 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:35.969920 11680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910c074d754749b9b864ab7017c2a8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.976054 11609 tablet_service.cc:1511] Processing CreateTablet for tablet 7c50f3c984bc40b78d55050ae3394346 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:35.977545 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c50f3c984bc40b78d55050ae3394346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.956121 11663 leader_election.cc:304] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:35.984134 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 7c50f3c984bc40b78d55050ae3394346 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:35.984490 11763 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9c065d47b4da99521736c33b51839 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:35.985234 11831 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9c065d47b4da99521736c33b51839 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:35.984490 11611 tablet_service.cc:1511] Processing CreateTablet for tablet e90b4bac88844df4a5d19f0f05135c60 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:35.985910 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c50f3c984bc40b78d55050ae3394346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.985975 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9c065d47b4da99521736c33b51839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.987917 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90b4bac88844df4a5d19f0f05135c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.989526 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9c065d47b4da99521736c33b51839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.990038 11902 raft_consensus.cc:515] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:35.997213 11905 raft_consensus.cc:2749] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:36.000516 11909 leader_election.cc:290] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:36.001142 11897 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:36.001825 11897 ts_tablet_manager.cc:1403] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.210s	user 0.018s	sys 0.011s
I20260709 12:24:35.996498 11895 tablet_bootstrap.cc:654] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.002705 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:36.005399 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:36.009025 11813 leader_election.cc:343] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:36.009936 11814 leader_election.cc:343] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.010419 11814 leader_election.cc:304] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:36.012487 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 56923.6us
W20260709 12:24:36.013355 11663 leader_election.cc:343] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.013756 11663 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:36.014550 11905 raft_consensus.cc:2749] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:36.015646 11909 raft_consensus.cc:2749] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:36.021184 11681 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9c065d47b4da99521736c33b51839 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:36.022054 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:36.022656 11681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9c065d47b4da99521736c33b51839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.015300 11773 raft_consensus.cc:2468] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
W20260709 12:24:36.023802 11738 leader_election.cc:343] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.021184 11685 tablet_service.cc:1511] Processing CreateTablet for tablet e90b4bac88844df4a5d19f0f05135c60 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:36.031836 11902 leader_election.cc:290] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:36.038496 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:36.039269 11624 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.040730 11896 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:36.041304 11896 ts_tablet_manager.cc:1403] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.010s
I20260709 12:24:36.041503 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:36.042059 11685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90b4bac88844df4a5d19f0f05135c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.042208 11849 raft_consensus.cc:2468] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:36.044153 11758 tablet_service.cc:1511] Processing CreateTablet for tablet e90b4bac88844df4a5d19f0f05135c60 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:36.045609 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90b4bac88844df4a5d19f0f05135c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.051224 11839 tablet_service.cc:1511] Processing CreateTablet for tablet cad92fece50d444cb8e4841eb7f23518 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:36.052002 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 7c50f3c984bc40b78d55050ae3394346 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:36.052762 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad92fece50d444cb8e4841eb7f23518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.053519 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c50f3c984bc40b78d55050ae3394346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.056072 11738 leader_election.cc:304] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:36.057034 11902 raft_consensus.cc:2804] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:36.057457 11902 raft_consensus.cc:493] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.057816 11902 raft_consensus.cc:3060] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.061789 11700 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.068759 11896 raft_consensus.cc:359] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.050977 11624 raft_consensus.cc:2468] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:36.069654 11896 raft_consensus.cc:385] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.071208 11739 leader_election.cc:304] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:36.071837 11897 raft_consensus.cc:359] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.075537 11897 raft_consensus.cc:385] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.075904 11897 raft_consensus.cc:740] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.076761 11943 raft_consensus.cc:2804] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:36.077170 11812 leader_election.cc:304] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:36.076855 11897 consensus_queue.cc:260] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.080365 11909 raft_consensus.cc:2804] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:36.083693 11909 raft_consensus.cc:697] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:36.084625 11909 consensus_queue.cc:237] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.071529 11941 leader_election.cc:290] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:36.077684 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:36.081533 11606 tablet_service.cc:1511] Processing CreateTablet for tablet cad92fece50d444cb8e4841eb7f23518 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:36.072535 11896 raft_consensus.cc:740] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
W20260709 12:24:36.099102 11739 leader_election.cc:343] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.101712 11686 tablet_service.cc:1511] Processing CreateTablet for tablet cad92fece50d444cb8e4841eb7f23518 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:36.103331 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad92fece50d444cb8e4841eb7f23518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.105710 11896 consensus_queue.cc:260] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.106312 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad92fece50d444cb8e4841eb7f23518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.099159 11756 tablet_service.cc:1511] Processing CreateTablet for tablet 91a124cf3dea44f39e82b7b9a5e9d64f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:36.108210 11896 ts_tablet_manager.cc:1434] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.002s
I20260709 12:24:36.108899 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a124cf3dea44f39e82b7b9a5e9d64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.111037 11895 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:36.112767 11895 ts_tablet_manager.cc:1403] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.018s
I20260709 12:24:36.124913 11904 consensus_queue.cc:1048] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:36.132818 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 91a124cf3dea44f39e82b7b9a5e9d64f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:36.134454 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a124cf3dea44f39e82b7b9a5e9d64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.135567 11610 tablet_service.cc:1511] Processing CreateTablet for tablet 91a124cf3dea44f39e82b7b9a5e9d64f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:36.137048 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a124cf3dea44f39e82b7b9a5e9d64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.136807 11682 tablet_service.cc:1511] Processing CreateTablet for tablet 7d410c3744a2471289fb0620248a0598 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:36.138054 11897 ts_tablet_manager.cc:1434] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.001s
I20260709 12:24:36.138185 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d410c3744a2471289fb0620248a0598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.111109 11894 tablet_bootstrap.cc:654] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.149881 11902 raft_consensus.cc:515] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:36.152514 11902 leader_election.cc:290] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:36.116648 11896 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:36.095721 11943 raft_consensus.cc:697] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:36.139393 11897 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:36.170082 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
W20260709 12:24:36.171943 11739 leader_election.cc:343] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.172323 11904 consensus_queue.cc:1048] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:36.172710 11929 raft_consensus.cc:493] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.173286 11929 raft_consensus.cc:515] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.172766 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:36.174512 11849 raft_consensus.cc:3060] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.176741 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:36.178710 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:36.179562 11700 raft_consensus.cc:2468] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
W20260709 12:24:36.180243 11813 leader_election.cc:343] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.182976 11814 leader_election.cc:304] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:36.175395 11929 leader_election.cc:290] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:36.191274 11929 raft_consensus.cc:2804] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:36.191751 11929 raft_consensus.cc:493] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.192090 11929 raft_consensus.cc:3060] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.193436 11943 consensus_queue.cc:237] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:36.195921 11895 raft_consensus.cc:359] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.204272 11895 raft_consensus.cc:385] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.208766 11895 raft_consensus.cc:740] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.209753 11895 consensus_queue.cc:260] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.210553 11611 tablet_service.cc:1511] Processing CreateTablet for tablet bb409dacde4a45fd956e729c49b4a978 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:36.212428 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 7d410c3744a2471289fb0620248a0598 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:36.213763 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb409dacde4a45fd956e729c49b4a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.214768 11836 tablet_service.cc:1511] Processing CreateTablet for tablet 7d410c3744a2471289fb0620248a0598 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:36.216490 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d410c3744a2471289fb0620248a0598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.213883 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d410c3744a2471289fb0620248a0598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.212865 11895 ts_tablet_manager.cc:1434] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.003s
I20260709 12:24:36.235687 11895 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:36.241492 11849 raft_consensus.cc:2468] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:36.244098 11894 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:36.244726 11894 ts_tablet_manager.cc:1403] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.278s	user 0.011s	sys 0.009s
I20260709 12:24:36.223127 11929 raft_consensus.cc:515] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.250608 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
W20260709 12:24:36.252852 11813 leader_election.cc:343] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.239384 11896 tablet_bootstrap.cc:654] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.253690 11686 tablet_service.cc:1511] Processing CreateTablet for tablet bb409dacde4a45fd956e729c49b4a978 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:36.255306 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb409dacde4a45fd956e729c49b4a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.250923 11897 tablet_bootstrap.cc:654] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.264686 11895 tablet_bootstrap.cc:654] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.274693 11929 leader_election.cc:290] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:36.240968 11814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 58103.6us
I20260709 12:24:36.280968 11894 raft_consensus.cc:359] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.281876 11894 raft_consensus.cc:385] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.282209 11894 raft_consensus.cc:740] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.282110 11758 tablet_service.cc:1511] Processing CreateTablet for tablet bb409dacde4a45fd956e729c49b4a978 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:36.284158 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb409dacde4a45fd956e729c49b4a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.285539 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf7dd33493f4ea39e190ab6f2eacf45 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:36.287978 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf7dd33493f4ea39e190ab6f2eacf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.291289 11738 leader_election.cc:304] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:36.293155 11946 raft_consensus.cc:2804] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:36.293838 11946 raft_consensus.cc:697] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:36.295003 11946 consensus_queue.cc:237] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:36.283380 11894 consensus_queue.cc:260] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.302106 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:36.302980 11699 raft_consensus.cc:3060] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.316401 11894 ts_tablet_manager.cc:1434] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.003s
I20260709 12:24:36.339494 11681 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf7dd33493f4ea39e190ab6f2eacf45 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:36.340361 11896 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:36.341094 11681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf7dd33493f4ea39e190ab6f2eacf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.341193 11896 ts_tablet_manager.cc:1403] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.009s
I20260709 12:24:36.346390 11896 raft_consensus.cc:359] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.380349 11957 raft_consensus.cc:493] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.382570 11957 raft_consensus.cc:515] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.386991 11763 tablet_service.cc:1511] Processing CreateTablet for tablet 99b354e318924ecaae70882105f1d00f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:36.388599 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b354e318924ecaae70882105f1d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.394110 11520 catalog_manager.cc:5697] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.373948 11896 raft_consensus.cc:385] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.385038 11957 leader_election.cc:290] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:36.370959 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 62331.8us
I20260709 12:24:36.399905 11894 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:36.410552 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 99b354e318924ecaae70882105f1d00f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:36.412245 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b354e318924ecaae70882105f1d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.415692 11895 tablet_bootstrap.cc:492] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:36.416275 11895 ts_tablet_manager.cc:1403] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.004s
I20260709 12:24:36.419942 11895 raft_consensus.cc:359] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.420827 11905 consensus_queue.cc:1048] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:36.421738 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:36.420877 11895 raft_consensus.cc:385] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.422458 11895 raft_consensus.cc:740] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.423434 11895 consensus_queue.cc:260] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:36.425015 11590 leader_election.cc:343] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.430711 11895 ts_tablet_manager.cc:1434] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:36.431088 11521 catalog_manager.cc:5697] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.424144 11686 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b08c8ab84410da9b69d5236dc4c9e (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:36.427434 11699 raft_consensus.cc:2468] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:36.437116 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b08c8ab84410da9b69d5236dc4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.440167 11814 leader_election.cc:304] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:36.441524 11929 raft_consensus.cc:2804] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:36.442083 11929 raft_consensus.cc:697] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:36.442550 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:36.442946 11929 consensus_queue.cc:237] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.448468 11895 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:36.461549 11836 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b08c8ab84410da9b69d5236dc4c9e (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 12:24:36.462599 11664 consensus_peers.cc:597] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.462941 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b08c8ab84410da9b69d5236dc4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.464270 11606 tablet_service.cc:1511] Processing CreateTablet for tablet 99b354e318924ecaae70882105f1d00f (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:36.465627 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b354e318924ecaae70882105f1d00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.402128 11896 raft_consensus.cc:740] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.471745 11894 tablet_bootstrap.cc:654] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.466104 11610 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf7dd33493f4ea39e190ab6f2eacf45 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:36.487496 11610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf7dd33493f4ea39e190ab6f2eacf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.475849 11905 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.491761 11905 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.494128 11905 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:36.483533 11897 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:36.495350 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:36.495435 11897 ts_tablet_manager.cc:1403] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.356s	user 0.012s	sys 0.013s
W20260709 12:24:36.498371 11663 leader_election.cc:343] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.499264 11896 consensus_queue.cc:260] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.500420 11897 raft_consensus.cc:359] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.501276 11897 raft_consensus.cc:385] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.501591 11897 raft_consensus.cc:740] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.502600 11896 ts_tablet_manager.cc:1434] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.004s
I20260709 12:24:36.502333 11897 consensus_queue.cc:260] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:36.476733 11588 leader_election.cc:343] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.509840 11682 tablet_service.cc:1511] Processing CreateTablet for tablet fe475402ebb54fed9985713a50767b22 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:36.515967 11758 tablet_service.cc:1511] Processing CreateTablet for tablet fa4b08c8ab84410da9b69d5236dc4c9e (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:36.517491 11831 tablet_service.cc:1511] Processing CreateTablet for tablet 09abbb280def4e0d95c1a6ba90635571 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:36.520314 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe475402ebb54fed9985713a50767b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.520628 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09abbb280def4e0d95c1a6ba90635571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.523072 11588 leader_election.cc:304] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:36.525557 11955 raft_consensus.cc:2749] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:36.522536 11764 tablet_service.cc:1511] Processing CreateTablet for tablet fe475402ebb54fed9985713a50767b22 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:36.544725 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4b08c8ab84410da9b69d5236dc4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.557658 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe475402ebb54fed9985713a50767b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.559134 11897 ts_tablet_manager.cc:1434] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:24:36.560621 11897 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:36.560851 11895 tablet_bootstrap.cc:654] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.562678 11894 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:36.563498 11894 ts_tablet_manager.cc:1403] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.190s	user 0.010s	sys 0.005s
I20260709 12:24:36.564138 11896 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:36.535986 11520 catalog_manager.cc:5697] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.577442 11897 tablet_bootstrap.cc:654] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:36.557206 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 83620.1us
I20260709 12:24:36.577176 11894 raft_consensus.cc:359] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.588141 11685 tablet_service.cc:1511] Processing CreateTablet for tablet 09abbb280def4e0d95c1a6ba90635571 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:36.599166 11685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09abbb280def4e0d95c1a6ba90635571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.601209 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:36.590051 11756 tablet_service.cc:1511] Processing CreateTablet for tablet ea4131857eb24e4887659e33e75df237 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:36.603807 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4131857eb24e4887659e33e75df237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.604686 11611 tablet_service.cc:1511] Processing CreateTablet for tablet 09abbb280def4e0d95c1a6ba90635571 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:24:36.605881 11664 leader_election.cc:343] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.606227 11611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09abbb280def4e0d95c1a6ba90635571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.591662 11829 tablet_service.cc:1511] Processing CreateTablet for tablet ea4131857eb24e4887659e33e75df237 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:36.606835 11606 tablet_service.cc:1511] Processing CreateTablet for tablet fe475402ebb54fed9985713a50767b22 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:36.607674 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4131857eb24e4887659e33e75df237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.608176 11606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe475402ebb54fed9985713a50767b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.606478 11664 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:36.611850 11905 raft_consensus.cc:2749] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:36.617239 11896 tablet_bootstrap.cc:654] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.623346 11609 tablet_service.cc:1511] Processing CreateTablet for tablet ea4131857eb24e4887659e33e75df237 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:36.625054 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4131857eb24e4887659e33e75df237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.633270 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 6a78e8a37cdc46b2918da1716ded8a01 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:36.634824 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a78e8a37cdc46b2918da1716ded8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.634922 11519 catalog_manager.cc:5697] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.646194 11895 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:36.646790 11895 ts_tablet_manager.cc:1403] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.006s
I20260709 12:24:36.648604 11686 tablet_service.cc:1511] Processing CreateTablet for tablet 6a78e8a37cdc46b2918da1716ded8a01 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:36.649688 11897 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:36.650039 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a78e8a37cdc46b2918da1716ded8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.650207 11897 ts_tablet_manager.cc:1403] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 12:24:36.651041 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 6a78e8a37cdc46b2918da1716ded8a01 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:36.652464 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a78e8a37cdc46b2918da1716ded8a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.652259 11612 tablet_service.cc:1511] Processing CreateTablet for tablet 2a366e09e3a54815b5bb446e20e8bf08 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:36.653774 11897 raft_consensus.cc:359] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.654583 11897 raft_consensus.cc:385] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.654889 11897 raft_consensus.cc:740] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.657647 11895 raft_consensus.cc:359] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.658429 11895 raft_consensus.cc:385] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.658700 11895 raft_consensus.cc:740] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
W20260709 12:24:36.662923 11738 consensus_peers.cc:597] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Couldn't send request to peer ed4262e8a41a45cebe0b2587d48e1135. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.659418 11895 consensus_queue.cc:260] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.671569 11894 raft_consensus.cc:385] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.671974 11894 raft_consensus.cc:740] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.672287 11700 raft_consensus.cc:3060] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.672778 11894 consensus_queue.cc:260] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.675729 11894 ts_tablet_manager.cc:1434] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 12:24:36.676779 11894 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:36.677241 11608 tablet_service.cc:1511] Processing CreateTablet for tablet f67d4fdb6dd444feae249f74e1ac29bc (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:36.676211 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 2a366e09e3a54815b5bb446e20e8bf08 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:36.679200 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a366e09e3a54815b5bb446e20e8bf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.682303 11929 consensus_queue.cc:1048] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:36.683061 11681 tablet_service.cc:1511] Processing CreateTablet for tablet f67d4fdb6dd444feae249f74e1ac29bc (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:36.684448 11681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d4fdb6dd444feae249f74e1ac29bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.686933 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 04157ec411b241028d32c3555200ab43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:36.690106 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04157ec411b241028d32c3555200ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.692265 11831 tablet_service.cc:1511] Processing CreateTablet for tablet f67d4fdb6dd444feae249f74e1ac29bc (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:36.694403 11612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a366e09e3a54815b5bb446e20e8bf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.699127 11929 consensus_queue.cc:1048] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:36.701303 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:36.702272 11608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d4fdb6dd444feae249f74e1ac29bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.703415 11895 ts_tablet_manager.cc:1434] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.056s	user 0.000s	sys 0.009s
I20260709 12:24:36.704329 11895 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:36.684934 11682 tablet_service.cc:1511] Processing CreateTablet for tablet 2a366e09e3a54815b5bb446e20e8bf08 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:36.720885 11943 raft_consensus.cc:493] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.745136 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 04157ec411b241028d32c3555200ab43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:36.746155 11609 tablet_service.cc:1511] Processing CreateTablet for tablet 04157ec411b241028d32c3555200ab43 (DEFAULT_TABLE table=test-workload [id=fd1228b8214f4ce09c126a29fe7a631d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:36.749343 11609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04157ec411b241028d32c3555200ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.744975 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d4fdb6dd444feae249f74e1ac29bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.751875 11682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a366e09e3a54815b5bb446e20e8bf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.730101 11897 consensus_queue.cc:260] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.739987 11943 raft_consensus.cc:515] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.759389 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04157ec411b241028d32c3555200ab43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.778767 11943 leader_election.cc:290] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:36.779755 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:36.781716 11738 leader_election.cc:343] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.779292 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:36.784263 11624 raft_consensus.cc:2468] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:36.785934 11739 leader_election.cc:304] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:36.786800 11894 tablet_bootstrap.cc:654] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.791900 11943 raft_consensus.cc:2804] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:36.792562 11943 raft_consensus.cc:493] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.793072 11943 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.795145 11895 tablet_bootstrap.cc:654] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.781622 11897 ts_tablet_manager.cc:1434] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.000s
I20260709 12:24:36.798143 11897 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:36.834246 11946 consensus_queue.cc:1048] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:36.835511 11896 tablet_bootstrap.cc:492] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:36.839588 11896 ts_tablet_manager.cc:1403] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.276s	user 0.015s	sys 0.033s
I20260709 12:24:36.848882 11946 consensus_queue.cc:1048] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:36.850929 11951 raft_consensus.cc:493] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.851869 11951 raft_consensus.cc:515] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.854626 11951 leader_election.cc:290] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:36.855902 11896 raft_consensus.cc:359] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.856387 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:36.856777 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:36.857199 11739 consensus_peers.cc:597] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:36.865286 11699 raft_consensus.cc:2468] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:36.866077 11896 raft_consensus.cc:385] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.866978 11896 raft_consensus.cc:740] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.867898 11814 leader_election.cc:304] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
W20260709 12:24:36.877754 11812 leader_election.cc:343] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.877889 11943 raft_consensus.cc:515] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.878001 11896 consensus_queue.cc:260] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.880604 11951 raft_consensus.cc:2804] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:36.872769 11897 tablet_bootstrap.cc:654] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.881901 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:36.884905 11623 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.885735 11896 ts_tablet_manager.cc:1434] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:24:36.881211 11951 raft_consensus.cc:493] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.888155 11951 raft_consensus.cc:3060] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.891151 11896 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:36.899048 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
W20260709 12:24:36.904160 11738 leader_election.cc:343] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.905911 11943 leader_election.cc:290] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:36.914419 11623 raft_consensus.cc:2468] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:36.915742 11622 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.916507 11739 leader_election.cc:304] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:36.917917 11943 raft_consensus.cc:2804] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:36.918466 11943 raft_consensus.cc:697] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:36.919489 11943 consensus_queue.cc:237] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.924101 11895 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:36.924827 11895 ts_tablet_manager.cc:1403] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.221s	user 0.013s	sys 0.002s
I20260709 12:24:36.925432 11894 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:36.925997 11894 ts_tablet_manager.cc:1403] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.249s	user 0.015s	sys 0.004s
I20260709 12:24:36.927639 11904 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.927739 11895 raft_consensus.cc:359] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.928565 11895 raft_consensus.cc:385] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.928314 11904 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.931787 11895 raft_consensus.cc:740] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.933276 11895 consensus_queue.cc:260] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.937084 11904 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:36.937985 11894 raft_consensus.cc:359] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.938546 11894 raft_consensus.cc:385] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:36.940045 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:36.940811 11699 raft_consensus.cc:2468] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:36.938777 11894 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:36.942092 11590 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:36.942667 11894 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:36.943089 11904 raft_consensus.cc:2804] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:36.943655 11904 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.944237 11904 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:36.943563 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:36.945003 11894 ts_tablet_manager.cc:1434] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:24:36.950384 11895 ts_tablet_manager.cc:1434] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
W20260709 12:24:36.951591 11588 leader_election.cc:343] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.954794 11975 consensus_queue.cc:1048] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:36.959692 11895 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:36.952808 11894 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:36.952486 11896 tablet_bootstrap.cc:654] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.979316 11895 tablet_bootstrap.cc:654] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.984632 11517 catalog_manager.cc:5697] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.985811 11904 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.988760 11894 tablet_bootstrap.cc:654] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:36.990033 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:36.990129 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:36.990973 11700 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:36.992082 11588 leader_election.cc:343] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:36.993355 11983 raft_consensus.cc:493] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.993546 11975 raft_consensus.cc:493] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.994107 11975 raft_consensus.cc:515] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:36.999815 11700 raft_consensus.cc:2468] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:37.001823 11590 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.002832 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.003211 11958 raft_consensus.cc:2804] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.000131 11904 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.004058 11958 raft_consensus.cc:697] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:37.005106 11958 consensus_queue.cc:237] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:36.994110 11983 raft_consensus.cc:515] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.007411 11951 raft_consensus.cc:515] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.011065 11773 raft_consensus.cc:2468] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:37.020671 11975 leader_election.cc:290] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.022352 11983 leader_election.cc:290] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:37.024634 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.025440 11849 raft_consensus.cc:2468] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:37.027096 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.027971 11700 raft_consensus.cc:2468] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:37.033372 11738 leader_election.cc:304] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:37.034837 11983 raft_consensus.cc:2804] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.035276 11983 raft_consensus.cc:493] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.035691 11983 raft_consensus.cc:3060] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:37.045722 11813 consensus_peers.cc:597] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:37.048874 11812 leader_election.cc:304] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:37.049916 11975 raft_consensus.cc:2804] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.050323 11975 raft_consensus.cc:493] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.050655 11975 raft_consensus.cc:3060] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.051738 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.052412 11700 raft_consensus.cc:3060] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.054625 11951 leader_election.cc:290] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.055423 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.055824 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:37.056175 11699 raft_consensus.cc:2468] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
W20260709 12:24:37.057196 11812 leader_election.cc:343] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.060667 11895 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.061245 11895 ts_tablet_manager.cc:1403] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.003s
I20260709 12:24:37.080116 11895 raft_consensus.cc:359] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.081763 11895 raft_consensus.cc:385] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.082206 11895 raft_consensus.cc:740] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.083248 11895 consensus_queue.cc:260] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.085552 11983 raft_consensus.cc:515] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.088747 11894 tablet_bootstrap.cc:492] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:37.089365 11894 ts_tablet_manager.cc:1403] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.014s
I20260709 12:24:37.091259 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.092005 11699 raft_consensus.cc:3060] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.091984 11983 leader_election.cc:290] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:37.093286 11894 raft_consensus.cc:359] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.094170 11894 raft_consensus.cc:385] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.094473 11894 raft_consensus.cc:740] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.095381 11894 consensus_queue.cc:260] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.097731 11894 ts_tablet_manager.cc:1434] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:37.098905 11894 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:37.092096 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:37.101691 11896 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.102319 11896 ts_tablet_manager.cc:1403] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.000s
I20260709 12:24:37.104125 11897 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:37.104736 11897 ts_tablet_manager.cc:1403] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.307s	user 0.014s	sys 0.003s
W20260709 12:24:37.105394 11988 log.cc:927] Time spent T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:24:37.105787 11896 raft_consensus.cc:359] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.106575 11896 raft_consensus.cc:385] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.106863 11896 raft_consensus.cc:740] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.086009 11895 ts_tablet_manager.cc:1434] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 12:24:37.108851 11895 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:37.111393 11897 raft_consensus.cc:359] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.112390 11897 raft_consensus.cc:385] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.112818 11897 raft_consensus.cc:740] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.112581 11896 consensus_queue.cc:260] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.116758 11896 ts_tablet_manager.cc:1434] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:24:37.117179 11895 tablet_bootstrap.cc:654] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.117391 11897 consensus_queue.cc:260] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.118239 11699 raft_consensus.cc:2468] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:37.120988 11896 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.123386 11740 leader_election.cc:304] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:37.124434 11943 raft_consensus.cc:2804] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.125013 11943 raft_consensus.cc:697] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:37.121730 11983 raft_consensus.cc:493] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.126113 11983 raft_consensus.cc:515] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.126035 11943 consensus_queue.cc:237] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.121028 11975 raft_consensus.cc:515] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.130223 11896 tablet_bootstrap.cc:654] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.138621 11897 ts_tablet_manager.cc:1434] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:24:37.138727 11521 catalog_manager.cc:5697] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.122246 11700 raft_consensus.cc:2468] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:37.141553 11814 leader_election.cc:304] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:37.143656 11993 raft_consensus.cc:2804] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.144344 11993 raft_consensus.cc:697] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:37.145207 11993 consensus_queue.cc:237] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.150120 11849 raft_consensus.cc:2393] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:37.150341 11975 leader_election.cc:290] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.150467 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:37.150772 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93a33d2febb741e6840067d443720a5a" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.151772 11700 raft_consensus.cc:2393] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 1: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:37.152949 11897 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:37.154174 11814 leader_election.cc:304] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:37.154628 11946 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.155272 11946 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.157930 11993 raft_consensus.cc:2749] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.159724 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.160053 11946 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.161206 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:37.161610 11739 leader_election.cc:343] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.162179 11700 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:37.163434 11740 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.164034 11896 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.164120 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.164806 11896 ts_tablet_manager.cc:1403] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.004s
I20260709 12:24:37.165427 11699 raft_consensus.cc:2393] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:37.165705 11976 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.166204 11976 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.166646 11976 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.168587 11896 raft_consensus.cc:359] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.169579 11896 raft_consensus.cc:385] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.169986 11896 raft_consensus.cc:740] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.171005 11896 consensus_queue.cc:260] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.173874 11897 tablet_bootstrap.cc:654] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.174199 11896 ts_tablet_manager.cc:1434] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:24:37.176895 11896 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.178208 11976 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.182309 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:37.182739 11983 leader_election.cc:290] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:37.185040 11739 leader_election.cc:343] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.186264 11896 tablet_bootstrap.cc:654] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.186707 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf12fde1d684537ae6ffc7c071107a7" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.188438 11738 leader_election.cc:304] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.190549 11976 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.191370 11983 raft_consensus.cc:3060] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.192560 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.193426 11700 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.193984 11521 catalog_manager.cc:5697] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:37.201669 11895 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.204108 11700 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:37.210144 11517 catalog_manager.cc:5697] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.211573 11740 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.212865 11943 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.213482 11943 raft_consensus.cc:697] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:37.213625 11895 ts_tablet_manager.cc:1403] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.015s
I20260709 12:24:37.214480 11943 consensus_queue.cc:237] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.208658 11983 raft_consensus.cc:2749] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.217903 11895 raft_consensus.cc:359] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.208554 11896 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.218981 11895 raft_consensus.cc:385] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.219579 11896 ts_tablet_manager.cc:1403] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.009s
I20260709 12:24:37.219406 11895 raft_consensus.cc:740] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.221074 11895 consensus_queue.cc:260] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.209671 11894 tablet_bootstrap.cc:654] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.223191 11895 ts_tablet_manager.cc:1434] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:24:37.225260 11895 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:37.227025 11896 raft_consensus.cc:359] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.228029 11896 raft_consensus.cc:385] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.228432 11896 raft_consensus.cc:740] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.229408 11896 consensus_queue.cc:260] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.232095 11896 ts_tablet_manager.cc:1434] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 12:24:37.232340 11895 tablet_bootstrap.cc:654] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.233536 11896 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.243841 11897 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:37.243928 11896 tablet_bootstrap.cc:654] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.244897 11897 ts_tablet_manager.cc:1403] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.005s
I20260709 12:24:37.254679 11521 catalog_manager.cc:5697] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.269299 11896 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.269928 11896 ts_tablet_manager.cc:1403] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.008s
I20260709 12:24:37.272683 11896 raft_consensus.cc:359] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.273330 11896 raft_consensus.cc:385] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.273589 11896 raft_consensus.cc:740] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.273736 11897 raft_consensus.cc:359] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.274430 11896 consensus_queue.cc:260] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.274794 11897 raft_consensus.cc:385] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.276597 11896 ts_tablet_manager.cc:1434] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:24:37.277515 11896 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.278343 11894 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:37.279210 11894 ts_tablet_manager.cc:1403] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.000s
I20260709 12:24:37.282500 11896 tablet_bootstrap.cc:654] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.275243 11897 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.283250 11894 raft_consensus.cc:359] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.285676 11894 raft_consensus.cc:385] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.286193 11894 raft_consensus.cc:740] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.284878 11897 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.289227 11897 ts_tablet_manager.cc:1434] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 12:24:37.291363 11897 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:37.293166 11894 consensus_queue.cc:260] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.295382 11895 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.295995 11895 ts_tablet_manager.cc:1403] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.071s	user 0.031s	sys 0.029s
I20260709 12:24:37.295967 11894 ts_tablet_manager.cc:1434] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:24:37.300905 11896 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.301477 11896 ts_tablet_manager.cc:1403] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.004s
I20260709 12:24:37.299181 11895 raft_consensus.cc:359] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.304571 11896 raft_consensus.cc:359] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.305136 11895 raft_consensus.cc:385] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.305514 11896 raft_consensus.cc:385] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.305586 11895 raft_consensus.cc:740] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.305909 11896 raft_consensus.cc:740] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.306603 11895 consensus_queue.cc:260] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.299181 11894 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:37.309304 11895 ts_tablet_manager.cc:1434] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 12:24:37.306629 11896 consensus_queue.cc:260] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.311546 11896 ts_tablet_manager.cc:1434] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:24:37.312942 11895 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:37.314325 11894 tablet_bootstrap.cc:654] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.316393 11896 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.318892 11905 raft_consensus.cc:493] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.319536 11905 raft_consensus.cc:515] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.322280 11905 leader_election.cc:290] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.323813 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.324455 11897 tablet_bootstrap.cc:654] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.325353 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.326133 11849 raft_consensus.cc:2468] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:37.327862 11663 leader_election.cc:304] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
W20260709 12:24:37.329553 11664 leader_election.cc:343] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.331032 11905 raft_consensus.cc:2804] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.331578 11905 raft_consensus.cc:493] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.332129 11905 raft_consensus.cc:3060] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.337611 11894 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:37.338236 11894 ts_tablet_manager.cc:1403] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.012s
I20260709 12:24:37.340348 11896 tablet_bootstrap.cc:654] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.342023 11894 raft_consensus.cc:359] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.342867 11894 raft_consensus.cc:385] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.343209 11894 raft_consensus.cc:740] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.344303 11895 tablet_bootstrap.cc:654] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.346601 11894 consensus_queue.cc:260] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.349706 11894 ts_tablet_manager.cc:1434] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:37.351050 11894 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:37.358469 11894 tablet_bootstrap.cc:654] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.362699 11895 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.363246 11895 ts_tablet_manager.cc:1403] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 12:24:37.363329 11897 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:37.365769 11897 ts_tablet_manager.cc:1403] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.006s
I20260709 12:24:37.366012 11895 raft_consensus.cc:359] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.366894 11895 raft_consensus.cc:385] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.367271 11895 raft_consensus.cc:740] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.368397 11895 consensus_queue.cc:260] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.372400 11897 raft_consensus.cc:359] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.372462 11905 raft_consensus.cc:515] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.373176 11958 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.374059 11958 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.373425 11897 raft_consensus.cc:385] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.375690 11897 raft_consensus.cc:740] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.376637 11897 consensus_queue.cc:260] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.377548 11958 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.378614 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.379140 12009 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.379894 11700 raft_consensus.cc:2393] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:37.379971 12009 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.381901 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.387074 11897 ts_tablet_manager.cc:1434] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:24:37.394183 11897 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:37.395205 11896 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.396037 11896 ts_tablet_manager.cc:1403] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.017s
I20260709 12:24:37.397166 11975 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.397488 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:37.397800 11975 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.398488 11622 raft_consensus.cc:3060] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.399928 11905 leader_election.cc:290] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.402359 11993 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.402385 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.403117 11993 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.404462 11699 raft_consensus.cc:2468] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:37.399353 11896 raft_consensus.cc:359] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.408494 11896 raft_consensus.cc:385] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.408818 11896 raft_consensus.cc:740] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.408957 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.409256 11814 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:37.409639 11896 consensus_queue.cc:260] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.391078 11590 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:37.410696 11848 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.411616 11958 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:37.411830 11813 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.412328 12009 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.412118 11896 ts_tablet_manager.cc:1434] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:24:37.414469 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.415414 11896 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.415927 11929 raft_consensus.cc:2804] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.421334 11929 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.421748 11929 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:37.417773 11664 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.416045 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.424993 11847 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:37.425235 11896 tablet_bootstrap.cc:654] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.426492 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.427240 11699 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:37.428262 11663 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.428992 11814 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.430315 12011 raft_consensus.cc:2804] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.431142 12011 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.435061 12011 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.390048 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:37.435777 11849 raft_consensus.cc:3060] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.442516 11951 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.443367 11951 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.450766 11622 raft_consensus.cc:2468] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:37.457374 11895 ts_tablet_manager.cc:1434] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.094s	user 0.016s	sys 0.024s
I20260709 12:24:37.458637 11895 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:37.460974 11993 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.400681 11975 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.460093 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:37.464072 11812 leader_election.cc:343] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.466212 11895 tablet_bootstrap.cc:654] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.467024 11943 consensus_queue.cc:1048] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:37.467864 11975 raft_consensus.cc:2804] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.468493 11975 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.468994 11975 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.474643 11894 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:37.451472 12011 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.453112 11951 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.475574 12009 raft_consensus.cc:493] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.475630 11894 ts_tablet_manager.cc:1403] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.003s
I20260709 12:24:37.476503 12009 raft_consensus.cc:515] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.456090 11849 raft_consensus.cc:2468] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:37.480283 11664 leader_election.cc:304] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:37.482648 12009 leader_election.cc:290] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.482934 11905 raft_consensus.cc:2804] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.483994 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.455425 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.487039 11773 raft_consensus.cc:2468] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:37.485214 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.488514 11663 leader_election.cc:304] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:37.489094 11624 raft_consensus.cc:2468] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:37.489773 11849 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.496248 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.500213 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:37.498411 12009 raft_consensus.cc:2804] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.503759 12009 raft_consensus.cc:493] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.502408 11664 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.503042 11699 raft_consensus.cc:2393] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:37.505002 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:37.504575 11904 consensus_queue.cc:1048] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:37.518967 11943 consensus_queue.cc:1048] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:37.511817 12009 raft_consensus.cc:3060] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.535455 12011 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.539994 11905 raft_consensus.cc:697] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:37.541762 11905 consensus_queue.cc:237] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.534345 11894 raft_consensus.cc:359] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.575121 11894 raft_consensus.cc:385] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.575495 11894 raft_consensus.cc:740] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.553426 11814 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.554296 11622 raft_consensus.cc:3060] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.595093 11981 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.595697 11981 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.598065 11981 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.601227 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:37.603916 11813 leader_election.cc:343] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.606415 11929 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.608656 11958 raft_consensus.cc:2749] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.616044 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.616444 12014 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.617023 12014 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:37.623867 11814 leader_election.cc:343] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.625173 11814 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.625799 11976 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:37.628051 11993 raft_consensus.cc:2749] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.628772 11993 raft_consensus.cc:493] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.629230 11993 raft_consensus.cc:515] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.632863 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.636525 11896 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.637879 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.638415 11896 ts_tablet_manager.cc:1403] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.223s	user 0.099s	sys 0.097s
I20260709 12:24:37.638945 11894 consensus_queue.cc:260] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.639737 11993 leader_election.cc:290] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.641592 11896 raft_consensus.cc:359] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.642333 11896 raft_consensus.cc:385] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.642724 11896 raft_consensus.cc:740] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.643615 11812 leader_election.cc:304] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.643517 11896 consensus_queue.cc:260] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.645709 11981 raft_consensus.cc:2749] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.646102 12009 raft_consensus.cc:515] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.642103 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.645805 11951 raft_consensus.cc:2749] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.645695 12019 consensus_queue.cc:1048] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:37.651537 11958 raft_consensus.cc:493] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:37.652104 11958 raft_consensus.cc:515] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.645709 11896 ts_tablet_manager.cc:1434] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:37.653841 11896 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
W20260709 12:24:37.655337 11664 leader_election.cc:343] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.648495 12014 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.649406 11894 ts_tablet_manager.cc:1434] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.172s	user 0.009s	sys 0.000s
I20260709 12:24:37.649807 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.648993 11943 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:37.657580 11894 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:37.657739 11897 tablet_bootstrap.cc:654] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.667706 11975 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.669036 11847 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:37.672428 11663 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.675884 11896 tablet_bootstrap.cc:654] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.677138 11847 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.679889 11951 raft_consensus.cc:493] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.680460 11951 raft_consensus.cc:515] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.665792 11976 raft_consensus.cc:493] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.681639 11976 raft_consensus.cc:515] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.682683 11951 leader_election.cc:290] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.683828 11976 leader_election.cc:290] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.684129 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.685045 11773 raft_consensus.cc:2468] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:37.685951 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:37.686609 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:37.688371 11813 leader_election.cc:343] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:37.674559 11663 leader_election.cc:343] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.694185 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
W20260709 12:24:37.688639 11739 leader_election.cc:343] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.694473 11895 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.695361 11895 ts_tablet_manager.cc:1403] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.237s	user 0.047s	sys 0.066s
I20260709 12:24:37.695117 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.694872 11624 raft_consensus.cc:3060] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.689400 11905 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.684542 11976 consensus_queue.cc:1048] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:24:37.703898 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:37.704762 12009 leader_election.cc:290] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.691578 11663 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:37.708993 11738 leader_election.cc:343] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.709184 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.709599 11738 leader_election.cc:304] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.709905 11699 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.712734 11983 raft_consensus.cc:2749] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.712793 11895 raft_consensus.cc:359] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.702708 11929 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:37.713917 11895 raft_consensus.cc:385] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.714402 11895 raft_consensus.cc:740] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.715298 11895 consensus_queue.cc:260] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:37.715191 11521 catalog_manager.cc:5697] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:37.694832 11812 leader_election.cc:304] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:37.724138 11813 leader_election.cc:343] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:37.724393 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 50572us
I20260709 12:24:37.724292 11951 raft_consensus.cc:2804] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:37.727490 11951 raft_consensus.cc:493] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.727573 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:37.727944 11951 raft_consensus.cc:3060] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.727599 11943 consensus_queue.cc:1048] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:37.729812 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:37.730481 11772 raft_consensus.cc:3060] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:37.731861 11812 leader_election.cc:343] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.740674 11981 consensus_queue.cc:1048] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:37.744066 12024 log.cc:927] Time spent T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:24:37.749876 11895 ts_tablet_manager.cc:1434] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:24:37.753499 11895 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:37.718694 11905 raft_consensus.cc:2749] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:37.762765 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:37.763025 11772 raft_consensus.cc:2468] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:37.764609 11929 consensus_queue.cc:1048] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:37.770056 11894 tablet_bootstrap.cc:654] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.767606 11975 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.776790 11958 leader_election.cc:290] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:37.778905 11663 leader_election.cc:304] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:37.781661 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:37.782181 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.782639 11696 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:37.784386 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "891213c70e5a40d085c955386f620b0f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:37.784473 11814 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.785441 11975 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.786623 11590 leader_election.cc:304] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.787092 11896 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.787606 11896 ts_tablet_manager.cc:1403] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.134s	user 0.021s	sys 0.011s
I20260709 12:24:37.788057 11958 raft_consensus.cc:2749] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:37.788214 12009 raft_consensus.cc:2804] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.789050 12009 raft_consensus.cc:697] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:37.790442 11896 raft_consensus.cc:359] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.790270 12009 consensus_queue.cc:237] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:37.791144 11896 raft_consensus.cc:385] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.791697 11895 tablet_bootstrap.cc:654] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.806074 11896 raft_consensus.cc:740] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.801800 11699 raft_consensus.cc:2468] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:37.802655 11951 raft_consensus.cc:515] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.817695 11896 consensus_queue.cc:260] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.836077 11896 ts_tablet_manager.cc:1434] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:24:37.843008 11896 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.835716 11814 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:37.849231 11929 raft_consensus.cc:2804] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.867538 11896 tablet_bootstrap.cc:654] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.880527 11897 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:37.881309 11897 ts_tablet_manager.cc:1403] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.488s	user 0.019s	sys 0.005s
I20260709 12:24:37.882376 11624 raft_consensus.cc:2468] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:37.886124 11897 raft_consensus.cc:359] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.887387 11897 raft_consensus.cc:385] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.887708 11897 raft_consensus.cc:740] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.887987 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:37.887730 11951 leader_election.cc:290] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.888634 11773 raft_consensus.cc:3060] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.871829 11929 raft_consensus.cc:697] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:37.889089 11897 consensus_queue.cc:260] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.889966 11929 consensus_queue.cc:237] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.891551 11897 ts_tablet_manager.cc:1434] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:37.892823 11897 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:37.900377 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:37.901320 11958 raft_consensus.cc:493] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.936484 11894 tablet_bootstrap.cc:492] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:37.936944 11894 ts_tablet_manager.cc:1403] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.280s	user 0.009s	sys 0.014s
I20260709 12:24:37.930024 11981 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.926607 11958 raft_consensus.cc:515] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:37.935365 11813 leader_election.cc:343] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.940598 11981 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:37.959586 11896 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:37.960264 11896 ts_tablet_manager.cc:1403] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.118s	user 0.027s	sys 0.003s
I20260709 12:24:37.962191 11897 tablet_bootstrap.cc:654] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.966676 11958 leader_election.cc:290] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:37.967622 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.964413 11896 raft_consensus.cc:359] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.971374 11896 raft_consensus.cc:385] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.974077 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:37.976258 11895 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:37.977069 11895 ts_tablet_manager.cc:1403] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.226s	user 0.011s	sys 0.034s
I20260709 12:24:37.971906 11896 raft_consensus.cc:740] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.978612 11896 consensus_queue.cc:260] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.979228 11588 leader_election.cc:304] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:37.982501 11896 ts_tablet_manager.cc:1434] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:24:37.983135 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:37.983696 11896 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:37.983719 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:37.988080 11813 leader_election.cc:343] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:37.988775 11812 leader_election.cc:343] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:37.989228 11812 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.989945 11894 raft_consensus.cc:359] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.990703 11894 raft_consensus.cc:385] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.990978 11894 raft_consensus.cc:740] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.992508 11951 raft_consensus.cc:2749] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:37.986858 11929 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.993564 11894 consensus_queue.cc:260] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:37.986253 11981 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:37.996295 11894 ts_tablet_manager.cc:1434] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:24:37.996618 11773 raft_consensus.cc:2468] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:38.000466 11895 raft_consensus.cc:359] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.001286 11895 raft_consensus.cc:385] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.001591 11895 raft_consensus.cc:740] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.002323 11895 consensus_queue.cc:260] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.005822 11895 ts_tablet_manager.cc:1434] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:24:38.006690 11897 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.006908 11895 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.007355 11897 ts_tablet_manager.cc:1403] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.115s	user 0.038s	sys 0.004s
I20260709 12:24:38.010749 11896 tablet_bootstrap.cc:654] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.011099 11897 raft_consensus.cc:359] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.012069 11897 raft_consensus.cc:385] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.012241 11812 leader_election.cc:304] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:37.987528 11958 raft_consensus.cc:2749] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.014082 11895 tablet_bootstrap.cc:654] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.014163 11981 raft_consensus.cc:2804] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:38.014773 11981 raft_consensus.cc:697] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:37.993623 11929 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.017510 11929 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:38.019519 11981 consensus_queue.cc:237] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.021394 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:38.023180 11814 leader_election.cc:343] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.012454 11897 raft_consensus.cc:740] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.024614 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.025887 11897 consensus_queue.cc:260] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:38.026928 11812 leader_election.cc:343] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.027576 11812 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:38.028319 11895 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.028906 11895 ts_tablet_manager.cc:1403] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:24:38.028976 11897 ts_tablet_manager.cc:1434] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:24:38.030359 11897 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.031698 11896 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.032184 11896 ts_tablet_manager.cc:1403] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.006s
I20260709 12:24:38.034741 11981 raft_consensus.cc:2749] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.038902 11897 tablet_bootstrap.cc:654] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.997488 11894 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:38.039391 11896 raft_consensus.cc:359] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.040354 11895 raft_consensus.cc:359] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.041155 11896 raft_consensus.cc:385] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.041303 11895 raft_consensus.cc:385] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.041697 11896 raft_consensus.cc:740] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.041797 11895 raft_consensus.cc:740] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.042631 11895 consensus_queue.cc:260] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.042500 11896 consensus_queue.cc:260] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.042737 11624 raft_consensus.cc:3060] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.048435 11896 ts_tablet_manager.cc:1434] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:24:38.040763 12009 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.051764 12009 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.054297 12009 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.055711 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:38.058485 11664 leader_election.cc:343] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.060333 11895 ts_tablet_manager.cc:1434] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:24:38.061743 11895 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.061177 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.063110 11847 raft_consensus.cc:2468] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:38.064651 11663 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:38.065449 11896 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.065804 12009 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.067719 11905 raft_consensus.cc:2804] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.068253 11905 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.068655 11905 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.069140 12009 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.075588 12009 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.076100 11894 tablet_bootstrap.cc:654] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.076603 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.077422 11847 raft_consensus.cc:2468] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:38.078776 11663 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:38.079270 11895 tablet_bootstrap.cc:654] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.080214 12009 raft_consensus.cc:2804] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.080832 12009 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.081357 11896 tablet_bootstrap.cc:654] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.081308 12009 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.097577 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:38.101296 11663 leader_election.cc:343] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.101807 11519 catalog_manager.cc:5697] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.096678 12009 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.125140 12009 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.145520 11958 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.148099 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:38.159539 11958 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.161964 11847 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.167068 12009 consensus_queue.cc:1048] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.168618 12014 consensus_queue.cc:1048] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:38.169786 11897 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.170499 11897 ts_tablet_manager.cc:1403] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.140s	user 0.007s	sys 0.029s
I20260709 12:24:38.177021 11897 raft_consensus.cc:359] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.178013 11897 raft_consensus.cc:385] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.178339 11897 raft_consensus.cc:740] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.156951 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
W20260709 12:24:38.181357 11663 leader_election.cc:343] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.183256 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.184319 11848 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:38.186542 11896 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.187283 11896 ts_tablet_manager.cc:1403] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.122s	user 0.026s	sys 0.028s
I20260709 12:24:38.189762 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:38.190780 11697 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:38.179214 11897 consensus_queue.cc:260] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.183662 11905 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.191401 11896 raft_consensus.cc:359] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.199786 11896 raft_consensus.cc:385] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.200127 11896 raft_consensus.cc:740] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.199883 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:38.200402 11847 raft_consensus.cc:2468] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:38.200878 11848 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.191967 11590 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:38.192505 11520 catalog_manager.cc:5697] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.202132 11955 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.200909 11896 consensus_queue.cc:260] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.206025 11663 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:38.194072 11897 ts_tablet_manager.cc:1434] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:24:38.207558 12009 raft_consensus.cc:2804] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:38.208356 12009 raft_consensus.cc:697] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:38.209087 11897 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.209249 12009 consensus_queue.cc:237] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.210189 11896 ts_tablet_manager.cc:1434] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:24:38.193956 11958 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:38.211913 11929 raft_consensus.cc:493] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.212426 11929 raft_consensus.cc:515] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.214846 11929 leader_election.cc:290] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.211213 11896 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.217168 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.217897 11773 raft_consensus.cc:2468] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:38.218030 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:38.220484 11812 leader_election.cc:304] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:38.221693 11929 raft_consensus.cc:2804] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.222262 11929 raft_consensus.cc:493] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.222671 11929 raft_consensus.cc:3060] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.224952 11955 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.226963 12014 consensus_queue.cc:1048] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.226948 11897 tablet_bootstrap.cc:654] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.235807 11896 tablet_bootstrap.cc:654] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:38.235918 11813 leader_election.cc:343] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.211243 11848 raft_consensus.cc:2468] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:38.240075 11897 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.240713 11897 ts_tablet_manager.cc:1403] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.004s
I20260709 12:24:38.240585 11663 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:38.241796 12014 raft_consensus.cc:2804] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:38.243564 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
W20260709 12:24:38.245169 11664 leader_election.cc:343] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.246186 11951 raft_consensus.cc:493] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.246722 11951 raft_consensus.cc:515] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.248818 11951 leader_election.cc:290] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:38.250501 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:38.252288 11814 leader_election.cc:343] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.254350 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.255558 11943 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.256357 11812 leader_election.cc:343] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.256102 11943 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.256989 11812 leader_election.cc:304] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:38.257754 11897 raft_consensus.cc:359] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.258237 11951 raft_consensus.cc:2749] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.258524 11943 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.261008 11929 raft_consensus.cc:515] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.261232 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:38.274709 11895 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.275256 11895 ts_tablet_manager.cc:1403] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.214s	user 0.027s	sys 0.043s
I20260709 12:24:38.275156 11697 raft_consensus.cc:2393] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:38.262264 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.262799 11905 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.264060 11896 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.268739 12014 raft_consensus.cc:697] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:38.278309 11896 ts_tablet_manager.cc:1403] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.010s
I20260709 12:24:38.278352 11738 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:38.278693 12014 consensus_queue.cc:237] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.279917 11943 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.281996 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:38.281785 11896 raft_consensus.cc:359] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.282691 11773 raft_consensus.cc:3060] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.258735 11897 raft_consensus.cc:385] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.272372 11894 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:38.283313 11897 raft_consensus.cc:740] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.283609 11894 ts_tablet_manager.cc:1403] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.286s	user 0.036s	sys 0.037s
I20260709 12:24:38.284087 11897 consensus_queue.cc:260] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.282841 11896 raft_consensus.cc:385] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.285631 11896 raft_consensus.cc:740] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.286317 11896 consensus_queue.cc:260] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.287926 11519 catalog_manager.cc:5697] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.289145 11895 raft_consensus.cc:359] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.289989 11895 raft_consensus.cc:385] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.290258 11895 raft_consensus.cc:740] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.291275 11773 raft_consensus.cc:2468] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:38.289177 11943 raft_consensus.cc:2749] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.292560 11812 leader_election.cc:304] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:38.293402 11896 ts_tablet_manager.cc:1434] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:38.293469 11951 raft_consensus.cc:2804] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:38.294361 11951 raft_consensus.cc:697] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:38.295033 11896 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.295662 11981 consensus_queue.cc:1048] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:38.296883 11894 raft_consensus.cc:359] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.297739 11894 raft_consensus.cc:385] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.298082 11894 raft_consensus.cc:740] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.300079 11894 consensus_queue.cc:260] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.286214 11897 ts_tablet_manager.cc:1434] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:24:38.303296 11897 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.295274 11951 consensus_queue.cc:237] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.291047 11895 consensus_queue.cc:260] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.307699 11895 ts_tablet_manager.cc:1434] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:24:38.308864 11895 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.310276 12014 consensus_queue.cc:1048] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:38.315021 11894 ts_tablet_manager.cc:1434] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:24:38.316377 11894 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:38.323184 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd301d1462624fbf813790e481f7aced" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:38.324150 11621 raft_consensus.cc:3060] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.332298 11897 tablet_bootstrap.cc:654] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.335610 11896 tablet_bootstrap.cc:654] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.323184 11929 leader_election.cc:290] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
W20260709 12:24:38.337550 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 62295.1us
I20260709 12:24:38.356117 11894 tablet_bootstrap.cc:654] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.367854 11895 tablet_bootstrap.cc:654] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.373577 11621 raft_consensus.cc:2468] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:38.358903 11517 catalog_manager.cc:5697] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.401798 11897 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.402412 11897 ts_tablet_manager.cc:1403] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.005s
I20260709 12:24:38.378913 11905 raft_consensus.cc:493] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.404049 11905 raft_consensus.cc:515] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.406358 11905 leader_election.cc:290] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:38.408556 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.409561 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:38.422106 11897 raft_consensus.cc:359] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.422912 11897 raft_consensus.cc:385] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.411553 11951 consensus_queue.cc:1048] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:24:38.425568 11951 consensus_queue.cc:1048] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.423188 11897 raft_consensus.cc:740] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.427870 11897 consensus_queue.cc:260] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.433024 11897 ts_tablet_manager.cc:1434] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
W20260709 12:24:38.441118 11663 leader_election.cc:343] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:38.444361 11664 leader_election.cc:343] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.444927 11664 leader_election.cc:304] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:38.446339 11905 raft_consensus.cc:2749] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.447113 11897 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.399267 11517 catalog_manager.cc:5697] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.456337 11896 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.457067 11896 ts_tablet_manager.cc:1403] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.004s
I20260709 12:24:38.460085 11897 tablet_bootstrap.cc:654] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.462342 11895 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.463269 11895 ts_tablet_manager.cc:1403] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.155s	user 0.020s	sys 0.014s
I20260709 12:24:38.466506 11896 raft_consensus.cc:359] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.469898 11896 raft_consensus.cc:385] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.470281 11896 raft_consensus.cc:740] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.472024 11895 raft_consensus.cc:359] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.472826 11895 raft_consensus.cc:385] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.473158 11895 raft_consensus.cc:740] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.473986 11895 consensus_queue.cc:260] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.476281 11895 ts_tablet_manager.cc:1434] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:38.477348 11895 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.477721 11896 consensus_queue.cc:260] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.478754 11894 tablet_bootstrap.cc:492] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:38.480170 11894 ts_tablet_manager.cc:1403] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.164s	user 0.023s	sys 0.008s
I20260709 12:24:38.484200 11895 tablet_bootstrap.cc:654] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.482944 11896 ts_tablet_manager.cc:1434] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:24:38.485546 11981 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.486333 11981 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.491008 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:38.491667 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:38.493479 11813 leader_election.cc:343] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:38.495342 11812 leader_election.cc:343] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.495793 11812 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:38.496532 11929 raft_consensus.cc:2749] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.497238 11621 raft_consensus.cc:3060] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.497557 11895 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.498098 11895 ts_tablet_manager.cc:1403] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:24:38.499728 11981 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.501941 11896 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.502888 11895 raft_consensus.cc:359] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.503964 11895 raft_consensus.cc:385] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.504319 11895 raft_consensus.cc:740] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.504673 11894 raft_consensus.cc:359] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.505764 11895 consensus_queue.cc:260] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.505800 11894 raft_consensus.cc:385] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.508482 11894 raft_consensus.cc:740] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.510051 11894 consensus_queue.cc:260] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.552685 11520 catalog_manager.cc:5697] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.566504 11896 tablet_bootstrap.cc:654] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.579258 12019 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.580524 12019 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.558404 11905 raft_consensus.cc:493] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.584137 11905 raft_consensus.cc:515] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.557823 11895 ts_tablet_manager.cc:1434] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:24:38.595633 11894 ts_tablet_manager.cc:1434] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.112s	user 0.013s	sys 0.001s
I20260709 12:24:38.596786 11895 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.611032 11905 leader_election.cc:290] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.613497 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.614851 11848 raft_consensus.cc:2468] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:38.616981 11663 leader_election.cc:304] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:38.618294 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:38.597680 11894 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:38.598376 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.620266 12062 raft_consensus.cc:2804] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.599550 12019 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:38.620913 11897 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.620360 11772 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:38.621102 12062 raft_consensus.cc:493] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.621714 12062 raft_consensus.cc:3060] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.621868 11897 ts_tablet_manager.cc:1403] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.018s
I20260709 12:24:38.623037 11588 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:38.624276 12019 raft_consensus.cc:2804] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.624898 12019 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.625275 12019 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.626082 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:38.628394 11897 raft_consensus.cc:359] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.629563 11897 raft_consensus.cc:385] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.629917 11897 raft_consensus.cc:740] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.631636 11895 tablet_bootstrap.cc:654] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.633076 11955 raft_consensus.cc:493] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.633944 11955 raft_consensus.cc:515] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:38.643028 11981 consensus_queue.cc:1048] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.644845 11955 leader_election.cc:290] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:38.646701 11664 leader_election.cc:343] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.649339 11897 consensus_queue.cc:260] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.650396 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.627311 11697 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:38.656837 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.660760 11588 leader_election.cc:304] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:38.666682 11897 ts_tablet_manager.cc:1434] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.009s
I20260709 12:24:38.668700 11897 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.689014 11896 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.690021 11896 ts_tablet_manager.cc:1403] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.046s
I20260709 12:24:38.694697 11896 raft_consensus.cc:359] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.696343 11896 raft_consensus.cc:385] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.696648 11896 raft_consensus.cc:740] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.697053 11897 tablet_bootstrap.cc:654] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.697449 11896 consensus_queue.cc:260] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.698017 11905 consensus_queue.cc:1048] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.709314 11895 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.715111 11905 raft_consensus.cc:493] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.715770 11905 raft_consensus.cc:515] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.717746 11896 ts_tablet_manager.cc:1434] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260709 12:24:38.718655 11905 leader_election.cc:290] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.721233 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.722759 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:38.723233 11663 leader_election.cc:343] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.723821 11849 raft_consensus.cc:2468] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:38.727209 12062 raft_consensus.cc:515] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.728505 11894 tablet_bootstrap.cc:654] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.730089 12019 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.733266 11895 ts_tablet_manager.cc:1403] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.004s
I20260709 12:24:38.737426 11895 raft_consensus.cc:359] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.738265 11895 raft_consensus.cc:385] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.739126 11896 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.738638 11895 raft_consensus.cc:740] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.753887 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:38.754689 11772 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.756675 11896 tablet_bootstrap.cc:654] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.759163 11895 consensus_queue.cc:260] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.765635 11929 consensus_queue.cc:1048] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:38.775581 11983 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.776239 11983 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.779455 12048 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.780144 12048 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.780671 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:38.782696 12048 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:38.784613 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.785413 11772 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:38.785735 11848 raft_consensus.cc:2393] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:38.789708 12060 raft_consensus.cc:493] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.790340 12060 raft_consensus.cc:515] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.796643 11895 ts_tablet_manager.cc:1434] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:24:38.799005 12062 leader_election.cc:290] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.738756 11663 leader_election.cc:304] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
W20260709 12:24:38.802103 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 63533.4us
I20260709 12:24:38.800791 11895 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:38.799576 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:38.802862 12062 raft_consensus.cc:2804] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:38.807387 11664 leader_election.cc:343] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.807724 12062 raft_consensus.cc:493] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.808120 12062 raft_consensus.cc:3060] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.810595 12060 leader_election.cc:290] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:38.759954 12019 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:38.821097 12009 raft_consensus.cc:493] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.821702 12009 raft_consensus.cc:515] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.815768 11929 consensus_queue.cc:1048] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:38.833554 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:38.850343 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:38.852205 11848 raft_consensus.cc:3060] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.852819 11894 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:38.853374 11894 ts_tablet_manager.cc:1403] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.256s	user 0.011s	sys 0.006s
I20260709 12:24:38.833293 11588 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:38.862397 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.862772 12019 raft_consensus.cc:2804] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:38.863300 12009 leader_election.cc:290] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.857573 11955 raft_consensus.cc:2749] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:38.866143 12019 raft_consensus.cc:697] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:38.865166 11894 raft_consensus.cc:359] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.867126 11896 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:38.869712 11738 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:38.867533 11894 raft_consensus.cc:385] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.871882 11896 ts_tablet_manager.cc:1403] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.153s	user 0.031s	sys 0.012s
I20260709 12:24:38.872381 11894 raft_consensus.cc:740] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
W20260709 12:24:38.871197 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:38.856544 11983 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:38.875130 11664 leader_election.cc:343] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.875773 12019 consensus_queue.cc:237] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.876471 11897 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:38.877106 11897 ts_tablet_manager.cc:1403] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.209s	user 0.042s	sys 0.035s
I20260709 12:24:38.881610 11897 raft_consensus.cc:359] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.882654 11897 raft_consensus.cc:385] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.882874 11897 raft_consensus.cc:740] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.885470 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.887550 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:38.888324 11697 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.893167 11897 consensus_queue.cc:260] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.888496 11894 consensus_queue.cc:260] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:38.887943 11976 raft_consensus.cc:2749] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:38.899408 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:38.914171 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:38.915405 12062 raft_consensus.cc:515] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:38.917667 12062 leader_election.cc:290] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:38.919324 11772 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.917411 11896 raft_consensus.cc:359] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.921240 11896 raft_consensus.cc:385] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:38.921383 11895 tablet_bootstrap.cc:654] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.921380 11897 ts_tablet_manager.cc:1434] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 12:24:38.921613 11896 raft_consensus.cc:740] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:38.923303 11896 consensus_queue.cc:260] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:38.925968 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:38.926188 11896 ts_tablet_manager.cc:1434] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.003s
I20260709 12:24:38.926952 11849 raft_consensus.cc:2468] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:38.926306 11897 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:38.927789 11896 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:38.930466 11848 raft_consensus.cc:2468] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:38.944159 11894 ts_tablet_manager.cc:1434] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.090s	user 0.010s	sys 0.001s
I20260709 12:24:38.938661 11847 raft_consensus.cc:2468] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
W20260709 12:24:38.930987 11663 leader_election.cc:343] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:38.945398 11624 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.975049 11897 tablet_bootstrap.cc:654] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.977609 11896 tablet_bootstrap.cc:654] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.984819 11894 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:38.985162 11663 leader_election.cc:304] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:38.986130 12060 consensus_queue.cc:1048] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:38.988030 12060 raft_consensus.cc:2804] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:38.988374 12060 raft_consensus.cc:493] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.988694 12060 raft_consensus.cc:3060] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:38.992489 11894 tablet_bootstrap.cc:654] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:38.993330 11663 leader_election.cc:304] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:38.994520 11895 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:38.996546 11895 ts_tablet_manager.cc:1403] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.196s	user 0.028s	sys 0.010s
I20260709 12:24:38.998414 12062 raft_consensus.cc:2804] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.002676 12062 raft_consensus.cc:697] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:39.003305 12083 consensus_queue.cc:1048] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:39.004451 12062 consensus_queue.cc:237] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.011792 11663 leader_election.cc:304] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.013257 12083 raft_consensus.cc:2804] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.013628 12083 raft_consensus.cc:493] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.014000 12083 raft_consensus.cc:3060] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.013861 11590 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:39.015556 11955 raft_consensus.cc:2749] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.020185 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.022107 12009 consensus_queue.cc:1048] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:39.034060 11895 raft_consensus.cc:359] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.035298 11895 raft_consensus.cc:385] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.035729 11895 raft_consensus.cc:740] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.036577 11895 consensus_queue.cc:260] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:39.026072 11663 leader_election.cc:343] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.042169 11897 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:39.042734 11897 ts_tablet_manager.cc:1403] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.010s
I20260709 12:24:39.027360 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.024942 11697 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:39.047991 11847 raft_consensus.cc:3060] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.049193 11897 raft_consensus.cc:359] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.052330 11897 raft_consensus.cc:385] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.052639 11897 raft_consensus.cc:740] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.056327 11897 consensus_queue.cc:260] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.059366 11897 ts_tablet_manager.cc:1434] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:24:39.060576 11895 ts_tablet_manager.cc:1434] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 12:24:39.066032 12083 raft_consensus.cc:515] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.067960 11895 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.076921 11897 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:39.083400 12060 raft_consensus.cc:515] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.083756 11519 catalog_manager.cc:5697] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.085243 11895 tablet_bootstrap.cc:654] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.093334 11894 tablet_bootstrap.cc:492] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:39.099006 11894 ts_tablet_manager.cc:1403] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.004s
I20260709 12:24:39.096509 11847 raft_consensus.cc:2468] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:39.098384 11897 tablet_bootstrap.cc:654] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.103343 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.104081 11849 raft_consensus.cc:3060] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.107944 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.113190 12083 leader_election.cc:290] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:39.114286 12060 leader_election.cc:290] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.116312 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:39.117380 11894 raft_consensus.cc:359] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:39.118093 11664 leader_election.cc:343] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.118114 11894 raft_consensus.cc:385] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.119203 11894 raft_consensus.cc:740] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.120065 11849 raft_consensus.cc:2468] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:39.120357 11894 consensus_queue.cc:260] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.122740 11773 raft_consensus.cc:3060] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.125617 11929 raft_consensus.cc:493] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.128096 11929 raft_consensus.cc:515] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.129658 11896 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.130273 11896 ts_tablet_manager.cc:1403] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.018s
I20260709 12:24:39.131006 11929 leader_election.cc:290] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.132205 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:39.133718 11814 leader_election.cc:343] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.134327 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.135219 11663 leader_election.cc:304] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
W20260709 12:24:39.135843 11813 leader_election.cc:343] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.136299 11813 leader_election.cc:304] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.136577 11663 leader_election.cc:304] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.137730 11929 raft_consensus.cc:2749] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.138437 12083 raft_consensus.cc:2804] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.138940 12083 raft_consensus.cc:697] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:39.139096 11905 raft_consensus.cc:2804] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.139658 11905 raft_consensus.cc:697] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:39.140049 12083 consensus_queue.cc:237] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.140641 11905 consensus_queue.cc:237] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.140666 11773 raft_consensus.cc:2468] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:39.148996 11896 raft_consensus.cc:359] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.151074 11896 raft_consensus.cc:385] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.151486 11896 raft_consensus.cc:740] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.153460 11896 consensus_queue.cc:260] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.152616 11894 ts_tablet_manager.cc:1434] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.002s
I20260709 12:24:39.152181 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8979e35797a74681b5631a8b7b269607" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.156013 11849 raft_consensus.cc:3060] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.158444 11894 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:39.160353 11896 ts_tablet_manager.cc:1434] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:24:39.161592 11895 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.162487 11896 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.164921 11663 leader_election.cc:304] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:39.165290 11895 ts_tablet_manager.cc:1403] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.016s
I20260709 12:24:39.165877 12060 raft_consensus.cc:2804] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.166394 12060 raft_consensus.cc:697] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:39.167291 12060 consensus_queue.cc:237] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.168341 11895 raft_consensus.cc:359] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.169064 11895 raft_consensus.cc:385] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.169339 11895 raft_consensus.cc:740] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.169900 11894 tablet_bootstrap.cc:654] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.173619 11849 raft_consensus.cc:2468] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:39.177527 11896 tablet_bootstrap.cc:654] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.170070 11895 consensus_queue.cc:260] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.182540 11895 ts_tablet_manager.cc:1434] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:24:39.188045 11895 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.189256 11897 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:39.190007 11897 ts_tablet_manager.cc:1403] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.017s
I20260709 12:24:39.193127 11897 raft_consensus.cc:359] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.193831 11897 raft_consensus.cc:385] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.193852 11896 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.194185 11897 raft_consensus.cc:740] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.194670 11896 ts_tablet_manager.cc:1403] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.003s
I20260709 12:24:39.197755 11896 raft_consensus.cc:359] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.198158 12060 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.198679 11896 raft_consensus.cc:385] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.199080 11896 raft_consensus.cc:740] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.200706 11896 consensus_queue.cc:260] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.198784 12060 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.201679 11895 tablet_bootstrap.cc:654] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.204041 12060 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.205027 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.205776 11896 ts_tablet_manager.cc:1434] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:24:39.194970 11897 consensus_queue.cc:260] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.207175 11896 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.208384 11897 ts_tablet_manager.cc:1434] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:24:39.209657 11897 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:39.213476 11895 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.214214 11895 ts_tablet_manager.cc:1403] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 12:24:39.214552 11896 tablet_bootstrap.cc:654] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.215940 11897 tablet_bootstrap.cc:654] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:39.217156 11663 leader_election.cc:343] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.217422 11895 raft_consensus.cc:359] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.218163 11895 raft_consensus.cc:385] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.218446 11895 raft_consensus.cc:740] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.219406 11895 consensus_queue.cc:260] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.220889 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.222074 11895 ts_tablet_manager.cc:1434] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 12:24:39.222641 11664 leader_election.cc:343] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.223296 11895 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.223171 11664 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.224462 12060 raft_consensus.cc:2749] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.229180 11896 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.229616 11897 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:39.229764 11896 ts_tablet_manager.cc:1403] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:24:39.230216 11897 ts_tablet_manager.cc:1403] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 12:24:39.230513 11895 tablet_bootstrap.cc:654] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.233108 11896 raft_consensus.cc:359] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.233304 11897 raft_consensus.cc:359] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.234083 11897 raft_consensus.cc:385] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.234087 11896 raft_consensus.cc:385] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.234501 11897 raft_consensus.cc:740] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.234623 11896 raft_consensus.cc:740] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.235847 11896 consensus_queue.cc:260] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.239863 11929 raft_consensus.cc:493] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.240502 11929 raft_consensus.cc:515] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.240832 11897 consensus_queue.cc:260] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.243482 11897 ts_tablet_manager.cc:1434] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:24:39.246059 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.248287 11897 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:39.251080 11813 leader_election.cc:343] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.252664 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:39.254361 11812 leader_election.cc:343] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.254877 11812 leader_election.cc:304] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.254554 11929 leader_election.cc:290] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:39.255856 11975 raft_consensus.cc:2749] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.256625 11897 tablet_bootstrap.cc:654] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.257323 11895 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.257866 11895 ts_tablet_manager.cc:1403] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:24:39.259398 11896 ts_tablet_manager.cc:1434] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:24:39.259794 11955 raft_consensus.cc:493] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.260392 11955 raft_consensus.cc:515] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.260972 11896 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.261998 11895 raft_consensus.cc:359] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.262833 11895 raft_consensus.cc:385] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.262799 11955 leader_election.cc:290] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.263533 11895 raft_consensus.cc:740] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.264638 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.264416 11895 consensus_queue.cc:260] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.266453 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:39.266968 11895 ts_tablet_manager.cc:1434] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:39.267292 11849 raft_consensus.cc:2393] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:39.268187 11895 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.269230 11588 leader_election.cc:304] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:39.270774 11955 raft_consensus.cc:3060] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.270963 11983 raft_consensus.cc:493] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.271740 11983 raft_consensus.cc:515] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.275787 11895 tablet_bootstrap.cc:654] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.285787 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.286562 11624 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:39.287209 11895 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.287722 11895 ts_tablet_manager.cc:1403] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:24:39.288043 11894 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:39.288697 11894 ts_tablet_manager.cc:1403] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.011s
I20260709 12:24:39.290607 11895 raft_consensus.cc:359] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.291334 11895 raft_consensus.cc:385] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.291620 11895 raft_consensus.cc:740] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.291550 11894 raft_consensus.cc:359] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.292373 11894 raft_consensus.cc:385] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.292086 11739 leader_election.cc:304] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:39.292743 11894 raft_consensus.cc:740] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.292476 11895 consensus_queue.cc:260] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.293324 11976 raft_consensus.cc:2804] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.293716 11976 raft_consensus.cc:493] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.294026 11976 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.295099 11895 ts_tablet_manager.cc:1434] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:39.296418 11895 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.296739 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.297780 11697 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:39.303150 11895 tablet_bootstrap.cc:654] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.303349 11955 raft_consensus.cc:2749] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.307381 11983 leader_election.cc:290] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.315698 11896 tablet_bootstrap.cc:654] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.322156 11521 catalog_manager.cc:5697] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.329986 11895 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.330614 11895 ts_tablet_manager.cc:1403] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 12:24:39.330878 11896 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.330130 11976 raft_consensus.cc:515] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.331389 11896 ts_tablet_manager.cc:1403] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.002s
I20260709 12:24:39.333993 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:39.334654 11624 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.334332 11895 raft_consensus.cc:359] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.335166 11895 raft_consensus.cc:385] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.334962 11896 raft_consensus.cc:359] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.335528 11895 raft_consensus.cc:740] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.335793 11896 raft_consensus.cc:385] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.336140 11896 raft_consensus.cc:740] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.336361 11895 consensus_queue.cc:260] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.339087 11895 ts_tablet_manager.cc:1434] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:24:39.339746 11896 consensus_queue.cc:260] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.343840 11896 ts_tablet_manager.cc:1434] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:39.344085 12019 consensus_queue.cc:1048] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.344978 11896 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.340269 11895 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.348958 12019 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.349534 12019 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.352029 12019 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.355473 11624 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:39.362172 11895 tablet_bootstrap.cc:654] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.358896 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:39.363170 11697 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.355705 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:39.364161 11849 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:39.364310 11739 leader_election.cc:304] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:39.365360 11983 raft_consensus.cc:2804] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.365962 11983 raft_consensus.cc:697] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:39.366972 11983 consensus_queue.cc:237] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.367414 11588 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:39.363093 12060 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.361153 11897 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:39.357270 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.372036 11897 ts_tablet_manager.cc:1403] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.124s	user 0.040s	sys 0.045s
I20260709 12:24:39.371176 12060 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.355924 11894 consensus_queue.cc:260] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.372874 11697 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:39.373275 11774 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:39.356900 11976 leader_election.cc:290] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.362188 11896 tablet_bootstrap.cc:654] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.376427 12060 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.376775 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:39.378528 11663 leader_election.cc:343] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.379196 12019 raft_consensus.cc:2804] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.379725 12019 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.380821 12019 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.385067 11894 ts_tablet_manager.cc:1434] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 12:24:39.386842 11894 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:39.388747 11897 raft_consensus.cc:359] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.393083 11895 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.400384 12060 raft_consensus.cc:493] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.403929 12060 raft_consensus.cc:515] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.404968 11894 tablet_bootstrap.cc:654] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.406687 12060 leader_election.cc:290] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.400784 11896 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.400856 12115 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.407858 11896 ts_tablet_manager.cc:1403] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.007s
I20260709 12:24:39.408058 12115 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.408990 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:39.410559 11663 leader_election.cc:343] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.410660 12115 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.401854 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.411684 11895 ts_tablet_manager.cc:1403] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.072s	user 0.002s	sys 0.026s
I20260709 12:24:39.402416 12019 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.407341 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:39.413733 11663 leader_election.cc:343] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.411218 11896 raft_consensus.cc:359] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.414222 11663 leader_election.cc:304] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:39.394769 11518 catalog_manager.cc:5697] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.420081 12062 raft_consensus.cc:2749] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.421193 11894 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:39.421756 11894 ts_tablet_manager.cc:1403] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 12:24:39.420953 11518 catalog_manager.cc:5697] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.421950 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.422641 11697 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:39.415158 11897 raft_consensus.cc:385] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.415530 12019 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.424301 11897 raft_consensus.cc:740] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:39.415913 11664 leader_election.cc:343] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.425063 11664 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.425096 11894 raft_consensus.cc:359] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.425205 11897 consensus_queue.cc:260] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.426040 11894 raft_consensus.cc:385] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.426380 11894 raft_consensus.cc:740] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.426512 12060 raft_consensus.cc:2749] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.423777 11590 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:39.427300 11894 consensus_queue.cc:260] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.415789 11896 raft_consensus.cc:385] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.428453 12019 raft_consensus.cc:2804] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.415042 11895 raft_consensus.cc:359] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.415848 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.423693 11518 catalog_manager.cc:5697] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.436764 12060 raft_consensus.cc:493] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.419101 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.427999 11897 ts_tablet_manager.cc:1434] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 12:24:39.442509 12115 consensus_queue.cc:1048] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:24:39.418632 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.466876 12019 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.473340 12019 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.455004 11517 catalog_manager.cc:5697] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.474813 11894 ts_tablet_manager.cc:1434] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 12:24:39.478121 11894 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:39.469746 11897 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:39.465849 11896 raft_consensus.cc:740] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.483024 11896 consensus_queue.cc:260] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.484146 11975 raft_consensus.cc:493] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.484617 11975 raft_consensus.cc:515] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.485245 11896 ts_tablet_manager.cc:1434] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.011s
I20260709 12:24:39.486419 11896 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.487028 11975 leader_election.cc:290] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.490765 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.492744 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:39.494398 11813 leader_election.cc:343] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.467092 11895 raft_consensus.cc:385] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.467479 11774 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:39.496233 11895 raft_consensus.cc:740] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.468024 12060 raft_consensus.cc:515] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.470645 11847 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.497062 11895 consensus_queue.cc:260] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.468662 11772 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.507038 12019 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.537882 11905 consensus_queue.cc:1048] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:39.542338 11896 tablet_bootstrap.cc:654] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.545079 12060 leader_election.cc:290] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:39.546554 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:39.548076 11664 leader_election.cc:343] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.549592 11847 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:39.551776 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:39.552636 11848 raft_consensus.cc:2468] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:39.554462 11897 tablet_bootstrap.cc:654] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.555491 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:39.556660 11588 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:39.552569 11772 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:39.556429 11975 raft_consensus.cc:493] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.557565 12115 raft_consensus.cc:2804] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.557111 11699 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.560983 12115 raft_consensus.cc:697] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:39.561990 12115 consensus_queue.cc:237] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.563182 11894 tablet_bootstrap.cc:654] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.570166 11697 raft_consensus.cc:2468] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:39.559077 11975 raft_consensus.cc:515] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.575264 11975 leader_election.cc:290] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:39.559522 12062 consensus_queue.cc:1048] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:24:39.577126 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:39.582422 11812 leader_election.cc:343] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.559334 11663 leader_election.cc:304] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.589087 12062 raft_consensus.cc:2804] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.589906 12062 raft_consensus.cc:493] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.592829 12060 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.595229 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.596098 12060 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:39.597891 11813 leader_election.cc:343] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.598536 11813 leader_election.cc:304] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.599846 11929 raft_consensus.cc:2749] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.599960 11975 raft_consensus.cc:493] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.600585 11975 raft_consensus.cc:515] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.601982 11814 leader_election.cc:304] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.603363 11929 raft_consensus.cc:2804] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.604025 11929 raft_consensus.cc:493] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.604383 11929 raft_consensus.cc:3060] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.604924 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:39.606936 11813 leader_election.cc:343] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.612303 11520 catalog_manager.cc:5697] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.617162 11929 raft_consensus.cc:515] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.595247 12062 raft_consensus.cc:3060] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.642966 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:39.645880 11699 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
W20260709 12:24:39.648316 11813 leader_election.cc:343] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.650216 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.650906 11772 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.651748 11975 leader_election.cc:290] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.639034 11929 leader_election.cc:290] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.639659 12019 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.659922 11895 ts_tablet_manager.cc:1434] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.248s	user 0.013s	sys 0.021s
W20260709 12:24:39.657114 11663 consensus_peers.cc:597] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.662272 11905 consensus_queue.cc:1048] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.663827 11590 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:39.664816 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.665071 12115 raft_consensus.cc:2804] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.665438 11929 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.665669 12115 raft_consensus.cc:697] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:39.665894 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.666656 12115 consensus_queue.cc:237] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:39.668114 11814 leader_election.cc:343] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.668668 11814 leader_election.cc:304] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.669556 11895 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:39.670938 11975 raft_consensus.cc:2749] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.665967 11929 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.680693 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.680972 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:39.681270 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.681841 11849 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:39.681887 11697 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:39.682440 11929 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:39.682590 11812 leader_election.cc:343] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.657346 12060 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.692117 11897 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:39.692786 11897 ts_tablet_manager.cc:1403] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.223s	user 0.016s	sys 0.034s
I20260709 12:24:39.693756 11896 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.694515 11896 ts_tablet_manager.cc:1403] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.208s	user 0.033s	sys 0.057s
I20260709 12:24:39.695575 11814 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:39.696815 12120 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.697319 12120 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.698573 12062 raft_consensus.cc:515] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.699378 11894 tablet_bootstrap.cc:492] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:39.699939 11894 ts_tablet_manager.cc:1403] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.005s
I20260709 12:24:39.700361 11975 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.700791 11975 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.701054 11975 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.701538 11772 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:39.703958 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:39.705246 11663 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:39.706264 12083 consensus_queue.cc:1048] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.708837 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.709590 11847 raft_consensus.cc:3060] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.699100 12120 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.713119 11895 tablet_bootstrap.cc:654] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.712353 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.686200 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:39.702893 11894 raft_consensus.cc:359] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.714874 11894 raft_consensus.cc:385] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.715512 11894 raft_consensus.cc:740] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.708910 12083 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.716862 11696 raft_consensus.cc:2468] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:39.720312 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:39.717168 11699 raft_consensus.cc:3060] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.703972 12062 leader_election.cc:290] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
W20260709 12:24:39.717183 11663 leader_election.cc:343] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:39.724066 11588 leader_election.cc:343] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.727303 11975 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.719805 12083 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.722952 11894 consensus_queue.cc:260] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:39.729938 11664 leader_election.cc:343] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.732054 12083 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.726192 11896 raft_consensus.cc:359] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.736688 11896 raft_consensus.cc:385] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.737028 11896 raft_consensus.cc:740] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.740149 11896 consensus_queue.cc:260] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.742594 11896 ts_tablet_manager.cc:1434] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.002s
I20260709 12:24:39.743788 11896 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.748023 11894 ts_tablet_manager.cc:1434] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:24:39.749326 11894 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:39.750924 11896 tablet_bootstrap.cc:654] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:39.758425 11664 consensus_peers.cc:597] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.760430 11590 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:39.763643 12115 raft_consensus.cc:2804] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.764083 12115 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.764434 12115 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.767959 11975 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.769500 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:39.762600 11517 catalog_manager.cc:5697] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.772089 12062 consensus_queue.cc:1048] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.773418 12083 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:39.774853 11696 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:39.776932 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.777869 12062 consensus_queue.cc:1048] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.778319 11983 consensus_queue.cc:1048] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:39.779433 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.781406 11894 tablet_bootstrap.cc:654] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:39.787593 11812 leader_election.cc:343] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.788529 12083 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:39.789013 11897 raft_consensus.cc:359] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.804936 11897 raft_consensus.cc:385] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.805372 11897 raft_consensus.cc:740] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:39.802718 11663 leader_election.cc:343] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.808866 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:39.809671 11848 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:39.806504 11897 consensus_queue.cc:260] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.790867 11975 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.811959 11975 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.812855 11897 ts_tablet_manager.cc:1434] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 12:24:39.814317 11897 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:39.831193 11894 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:39.832175 11894 ts_tablet_manager.cc:1403] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.001s
I20260709 12:24:39.816586 12009 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.811213 11847 raft_consensus.cc:2468] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:39.797111 11812 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:39.824265 11975 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:39.853158 11896 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:39.853637 11896 ts_tablet_manager.cc:1403] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.002s
I20260709 12:24:39.856966 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.863756 11622 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:39.864583 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:39.865167 11663 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:39.858354 12115 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.866662 11663 leader_election.cc:304] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:39.867610 12062 raft_consensus.cc:2749] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.868259 12062 raft_consensus.cc:2804] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.868713 12062 raft_consensus.cc:697] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:39.870131 11897 tablet_bootstrap.cc:654] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.869640 12062 consensus_queue.cc:237] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.845500 12009 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:39.872937 12115 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:39.874523 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:39.856540 11975 raft_consensus.cc:2749] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.884752 12009 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:39.887768 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:39.888824 11623 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
W20260709 12:24:39.876291 11812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 89554.2us
I20260709 12:24:39.890414 11664 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:39.881984 11697 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:39.895596 12083 raft_consensus.cc:2804] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.900350 11813 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:39.900835 11894 raft_consensus.cc:359] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.901682 11894 raft_consensus.cc:385] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.901960 11894 raft_consensus.cc:740] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.902680 11894 consensus_queue.cc:260] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.904621 11895 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:39.905189 11895 ts_tablet_manager.cc:1403] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.019s
I20260709 12:24:39.923094 11981 raft_consensus.cc:2804] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:39.923780 11981 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.924223 11981 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.924393 11772 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.929235 11896 raft_consensus.cc:359] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.930331 11896 raft_consensus.cc:385] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.930703 11896 raft_consensus.cc:740] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.933802 11896 consensus_queue.cc:260] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:39.940608 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:39.941352 11697 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.942363 12083 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.942829 12083 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:39.942869 11699 raft_consensus.cc:2468] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:39.950080 11896 ts_tablet_manager.cc:1434] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.001s
I20260709 12:24:39.951365 11896 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:39.959153 11895 raft_consensus.cc:359] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:39.959931 11895 raft_consensus.cc:385] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.960242 11895 raft_consensus.cc:740] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.969818 11894 ts_tablet_manager.cc:1434] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260709 12:24:39.976784 11895 consensus_queue.cc:260] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:39.968926 11813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 73342.6us
I20260709 12:24:39.988924 12139 raft_consensus.cc:493] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.002538 12139 raft_consensus.cc:515] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.006502 12139 leader_election.cc:290] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.006596 11976 raft_consensus.cc:493] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.007521 11976 raft_consensus.cc:515] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.011266 11814 leader_election.cc:304] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.012365 12142 raft_consensus.cc:2804] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.012900 12142 raft_consensus.cc:697] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:40.013787 12142 consensus_queue.cc:237] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.018292 11774 raft_consensus.cc:3060] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.019603 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:40.021220 11812 leader_election.cc:343] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:40.000795 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:40.026257 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.032764 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.033974 11699 raft_consensus.cc:2468] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:40.040488 11943 consensus_queue.cc:1048] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.042332 11896 tablet_bootstrap.cc:654] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.038654 11894 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:40.033123 11697 raft_consensus.cc:2468] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:40.044083 11520 catalog_manager.cc:5697] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.053143 11895 ts_tablet_manager.cc:1434] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.148s	user 0.009s	sys 0.001s
I20260709 12:24:40.054478 11814 leader_election.cc:304] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:40.055709 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.056622 11929 raft_consensus.cc:2804] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.057243 11929 raft_consensus.cc:493] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.057639 11929 raft_consensus.cc:3060] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.065212 11897 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.065871 11897 ts_tablet_manager.cc:1403] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.252s	user 0.033s	sys 0.049s
W20260709 12:24:40.070941 12141 log.cc:927] Time spent T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:40.011310 11976 leader_election.cc:290] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:40.083053 12019 consensus_queue.cc:1048] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.092721 11897 raft_consensus.cc:359] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.093684 11897 raft_consensus.cc:385] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.094028 11897 raft_consensus.cc:740] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.097584 11897 consensus_queue.cc:260] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.096004 11772 raft_consensus.cc:2468] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:40.096978 11929 raft_consensus.cc:515] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.129777 11929 leader_election.cc:290] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.118723 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451a1a4e56614af883d9ce0b87370816" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.119585 11590 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:40.131104 12120 consensus_queue.cc:1048] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.132333 12118 raft_consensus.cc:2804] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.133107 12118 raft_consensus.cc:697] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:40.134323 12118 consensus_queue.cc:237] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.145886 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:40.123984 11895 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:40.151247 11894 tablet_bootstrap.cc:654] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.138715 11981 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.157069 12019 consensus_queue.cc:1048] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.166913 11896 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.167598 11896 ts_tablet_manager.cc:1403] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.033s
I20260709 12:24:40.180485 11896 raft_consensus.cc:359] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.181128 11896 raft_consensus.cc:385] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.181389 11896 raft_consensus.cc:740] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.181981 11896 consensus_queue.cc:260] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.182845 11895 tablet_bootstrap.cc:654] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.184271 11896 ts_tablet_manager.cc:1434] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:40.184782 11981 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:40.184896 11897 ts_tablet_manager.cc:1434] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.119s	user 0.010s	sys 0.001s
I20260709 12:24:40.185549 11896 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.186129 11897 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.191828 11845 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:40.191629 12083 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.195525 11740 leader_election.cc:304] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:40.197825 11896 tablet_bootstrap.cc:654] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:40.170684 11812 leader_election.cc:343] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.201531 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.202286 11624 raft_consensus.cc:3060] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.205384 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:40.206195 11700 raft_consensus.cc:3060] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.218330 11976 raft_consensus.cc:2749] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.229872 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.231842 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:40.232776 11844 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:40.217198 12083 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.240880 11663 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:40.248812 11897 tablet_bootstrap.cc:654] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.249936 12083 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.249464 11520 catalog_manager.cc:5697] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.246693 11518 catalog_manager.cc:5697] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.252677 12115 consensus_queue.cc:1048] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.216779 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:40.261407 11700 raft_consensus.cc:2468] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:40.266093 11696 raft_consensus.cc:2393] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:40.266796 11814 leader_election.cc:304] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:40.268204 11929 raft_consensus.cc:2804] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.268852 11929 raft_consensus.cc:697] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:40.270061 11894 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:40.269788 11929 consensus_queue.cc:237] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.270635 11894 ts_tablet_manager.cc:1403] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.275s	user 0.013s	sys 0.008s
I20260709 12:24:40.261704 11624 raft_consensus.cc:2468] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 2.
I20260709 12:24:40.282032 11813 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:40.282887 12142 raft_consensus.cc:2804] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:40.283422 12142 raft_consensus.cc:697] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:40.284365 12142 consensus_queue.cc:237] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.278074 11894 raft_consensus.cc:359] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.287899 11894 raft_consensus.cc:385] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.288192 11894 raft_consensus.cc:740] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.289256 11894 consensus_queue.cc:260] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.292914 12115 raft_consensus.cc:493] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.293828 12115 raft_consensus.cc:515] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.294210 11981 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.294934 11981 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.299433 11981 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.301505 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:40.304509 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:40.305322 11812 leader_election.cc:343] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.301535 12115 leader_election.cc:290] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:40.306731 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:40.315086 11813 leader_election.cc:343] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.318449 11813 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.320358 12139 raft_consensus.cc:2749] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.312023 11981 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.321545 11981 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.323766 11981 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.332239 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:40.337252 11894 ts_tablet_manager.cc:1434] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
W20260709 12:24:40.345095 11812 leader_election.cc:343] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.349313 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea76dbfd7d0485ab14a3eedef8a4ff1" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.350359 11895 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:40.350922 11895 ts_tablet_manager.cc:1403] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.239s	user 0.011s	sys 0.003s
I20260709 12:24:40.351019 11590 leader_election.cc:304] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:40.353971 12115 raft_consensus.cc:2749] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.357743 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.359606 11623 raft_consensus.cc:3060] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.366966 12060 consensus_queue.cc:1048] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.372414 11895 raft_consensus.cc:359] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.373332 11895 raft_consensus.cc:385] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.373660 11895 raft_consensus.cc:740] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.374562 11895 consensus_queue.cc:260] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.378733 11895 ts_tablet_manager.cc:1434] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:24:40.380092 11895 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
W20260709 12:24:40.383381 11813 leader_election.cc:343] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.383963 11813 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.385579 11975 raft_consensus.cc:2749] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.393182 11895 tablet_bootstrap.cc:654] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.402576 12009 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.403687 12009 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.406342 11897 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.406876 11897 ts_tablet_manager.cc:1403] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.221s	user 0.040s	sys 0.034s
I20260709 12:24:40.409055 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:40.409927 11897 raft_consensus.cc:359] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.410681 11897 raft_consensus.cc:385] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.410943 11897 raft_consensus.cc:740] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:40.414158 11663 leader_election.cc:343] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.415261 11896 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.415828 11896 ts_tablet_manager.cc:1403] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.231s	user 0.016s	sys 0.006s
I20260709 12:24:40.418846 11896 raft_consensus.cc:359] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.419800 11896 raft_consensus.cc:385] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.420181 11896 raft_consensus.cc:740] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.421294 11896 consensus_queue.cc:260] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.424201 11896 ts_tablet_manager.cc:1434] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:40.424626 11897 consensus_queue.cc:260] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.425329 11896 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.425549 11521 catalog_manager.cc:5697] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 2, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.429668 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:40.431912 11664 leader_election.cc:343] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.432457 11664 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.406935 12009 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.433656 11897 ts_tablet_manager.cc:1434] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:24:40.433740 12060 raft_consensus.cc:2749] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.432705 11896 tablet_bootstrap.cc:654] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.434839 11897 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.354010 11894 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:40.448773 12142 consensus_queue.cc:1048] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.450623 11897 tablet_bootstrap.cc:654] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.460103 12115 raft_consensus.cc:493] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.459300 11521 catalog_manager.cc:5697] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.460711 12115 raft_consensus.cc:515] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.464845 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.466006 12115 leader_election.cc:290] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:40.465170 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.470927 11590 leader_election.cc:304] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:40.477604 12115 raft_consensus.cc:2749] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.478467 11896 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.479111 11896 ts_tablet_manager.cc:1403] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.007s
I20260709 12:24:40.481941 11895 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:40.482509 11895 ts_tablet_manager.cc:1403] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.103s	user 0.030s	sys 0.016s
I20260709 12:24:40.485420 11894 tablet_bootstrap.cc:654] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.491641 11895 raft_consensus.cc:359] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.492617 11895 raft_consensus.cc:385] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.492892 11895 raft_consensus.cc:740] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.493448 11896 raft_consensus.cc:359] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.493669 11895 consensus_queue.cc:260] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.494297 11896 raft_consensus.cc:385] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.494637 11896 raft_consensus.cc:740] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.495375 11896 consensus_queue.cc:260] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.496196 11895 ts_tablet_manager.cc:1434] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:24:40.497404 11895 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:40.497762 11896 ts_tablet_manager.cc:1434] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:24:40.498950 11896 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.502432 11897 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.509582 11897 ts_tablet_manager.cc:1403] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.005s
I20260709 12:24:40.511233 12139 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.514026 11622 raft_consensus.cc:3060] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.513348 12139 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.516662 12139 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:40.517885 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.520068 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.521879 11897 raft_consensus.cc:359] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:40.523114 11814 leader_election.cc:343] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.523532 11897 raft_consensus.cc:385] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.525218 11897 raft_consensus.cc:740] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.526098 11897 consensus_queue.cc:260] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:40.524008 11813 leader_election.cc:343] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.528568 11897 ts_tablet_manager.cc:1434] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:24:40.528923 11813 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.524894 11896 tablet_bootstrap.cc:654] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.531396 11897 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.535705 12142 raft_consensus.cc:2749] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.544919 12139 raft_consensus.cc:493] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.546128 12139 raft_consensus.cc:515] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:40.547370 11813 consensus_peers.cc:597] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.548483 12060 consensus_queue.cc:1048] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.549021 12139 leader_election.cc:290] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.550601 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:40.551168 11894 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:40.551745 11894 ts_tablet_manager.cc:1403] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.198s	user 0.011s	sys 0.006s
I20260709 12:24:40.552378 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:40.554060 11812 leader_election.cc:343] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.551340 11700 raft_consensus.cc:2468] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:40.554944 11894 raft_consensus.cc:359] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.555873 11894 raft_consensus.cc:385] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.555843 11814 leader_election.cc:304] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:40.556449 11894 raft_consensus.cc:740] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.557030 11981 raft_consensus.cc:2804] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.557430 11981 raft_consensus.cc:493] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.557868 11981 raft_consensus.cc:3060] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.557312 11894 consensus_queue.cc:260] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.558305 11897 tablet_bootstrap.cc:654] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.560294 11894 ts_tablet_manager.cc:1434] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:40.565260 11894 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:40.575356 11943 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.576122 11943 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.578877 11943 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.580853 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.581673 11624 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:40.581908 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.582907 11844 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:40.583276 11739 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:40.585114 11943 raft_consensus.cc:2804] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.585609 11943 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.586086 11943 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.586382 12115 consensus_queue.cc:1048] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.594139 11981 raft_consensus.cc:515] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.603531 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:40.606155 11895 tablet_bootstrap.cc:654] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:40.606040 11812 leader_election.cc:343] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.607775 12142 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.609130 12142 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.609915 11943 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.612929 12142 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.607515 11981 leader_election.cc:290] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.613528 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:40.614187 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.615928 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:40.597986 11894 tablet_bootstrap.cc:654] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.616871 11844 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.607771 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:40.621574 11699 raft_consensus.cc:3060] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.622246 11896 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
W20260709 12:24:40.615888 11813 leader_election.cc:343] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.622800 11896 ts_tablet_manager.cc:1403] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.038s
W20260709 12:24:40.623663 11812 leader_election.cc:343] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.625957 11896 raft_consensus.cc:359] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.626729 11896 raft_consensus.cc:385] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.627003 11896 raft_consensus.cc:740] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.627760 11896 consensus_queue.cc:260] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.630079 11896 ts_tablet_manager.cc:1434] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:24:40.631131 11896 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.653121 11894 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:40.647611 12060 raft_consensus.cc:493] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.657696 11894 ts_tablet_manager.cc:1403] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.000s
I20260709 12:24:40.660405 12060 raft_consensus.cc:515] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.664497 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.664497 11894 raft_consensus.cc:359] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.665822 11894 raft_consensus.cc:385] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.666193 11894 raft_consensus.cc:740] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.670136 11897 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.670701 11897 ts_tablet_manager.cc:1403] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.140s	user 0.004s	sys 0.011s
I20260709 12:24:40.671521 11896 tablet_bootstrap.cc:654] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:40.671972 11664 leader_election.cc:343] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.674916 11897 raft_consensus.cc:359] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.675734 11897 raft_consensus.cc:385] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.676124 11897 raft_consensus.cc:740] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.676975 11897 consensus_queue.cc:260] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.681433 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.682844 11622 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.644799 11812 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:40.686043 11812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 63750.1us
I20260709 12:24:40.687150 12142 raft_consensus.cc:2749] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.666896 12060 leader_election.cc:290] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.696549 11943 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.697346 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.698248 11846 raft_consensus.cc:2468] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:40.699715 11624 raft_consensus.cc:1275] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Refusing update from remote peer ed4262e8a41a45cebe0b2587d48e1135: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:40.709859 12142 consensus_queue.cc:1048] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.712805 11699 raft_consensus.cc:2468] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:40.714282 11894 consensus_queue.cc:260] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.724674 11814 leader_election.cc:304] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:40.715831 11897 ts_tablet_manager.cc:1434] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:24:40.716550 11663 leader_election.cc:304] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.718804 12118 consensus_queue.cc:1048] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.719516 11895 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:40.722288 11844 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:40.726179 12142 raft_consensus.cc:2804] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.728597 11895 ts_tablet_manager.cc:1403] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.003s
I20260709 12:24:40.731108 12142 raft_consensus.cc:697] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:40.731003 11738 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:40.731545 11622 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:40.734633 11894 ts_tablet_manager.cc:1434] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 12:24:40.732568 11943 raft_consensus.cc:2804] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.733814 12060 raft_consensus.cc:2804] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.735602 11943 raft_consensus.cc:697] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:40.736738 11943 consensus_queue.cc:237] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.738092 11897 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.745666 11894 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:40.747761 11896 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.748449 11896 ts_tablet_manager.cc:1403] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.028s
I20260709 12:24:40.750667 11983 raft_consensus.cc:493] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.751389 11983 raft_consensus.cc:515] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.751684 12142 consensus_queue.cc:237] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.751013 11895 raft_consensus.cc:359] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.753767 11895 raft_consensus.cc:385] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.755100 11983 leader_election.cc:290] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.754987 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.755892 11846 raft_consensus.cc:2468] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:40.757573 11738 leader_election.cc:304] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:40.758734 11976 raft_consensus.cc:2804] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.740088 12060 raft_consensus.cc:493] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.759202 11976 raft_consensus.cc:493] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.759639 12060 raft_consensus.cc:3060] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.759999 11976 raft_consensus.cc:3060] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.760205 11896 raft_consensus.cc:359] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.760982 11896 raft_consensus.cc:385] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.761240 11896 raft_consensus.cc:740] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.761991 11896 consensus_queue.cc:260] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.764882 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:40.766889 11622 raft_consensus.cc:2468] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:40.754158 11895 raft_consensus.cc:740] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.773813 11897 tablet_bootstrap.cc:654] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.779888 11894 tablet_bootstrap.cc:654] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.781375 11896 ts_tablet_manager.cc:1434] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:24:40.782712 11896 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.785421 11895 consensus_queue.cc:260] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.789577 11897 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.796489 11520 catalog_manager.cc:5697] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.811218 11897 ts_tablet_manager.cc:1403] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.006s
I20260709 12:24:40.789785 11700 raft_consensus.cc:1275] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer ed4262e8a41a45cebe0b2587d48e1135: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:40.814292 11897 raft_consensus.cc:359] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.815003 11897 raft_consensus.cc:385] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.806978 11521 catalog_manager.cc:5697] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.817456 11895 ts_tablet_manager.cc:1434] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.004s
I20260709 12:24:40.808107 11896 tablet_bootstrap.cc:654] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.815264 11897 raft_consensus.cc:740] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.816148 12142 consensus_queue.cc:1048] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.793184 11976 raft_consensus.cc:515] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.825141 11897 consensus_queue.cc:260] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:40.819281 11812 consensus_peers.cc:597] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.827256 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:40.828359 11895 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:40.834174 11844 raft_consensus.cc:3060] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.840704 11895 tablet_bootstrap.cc:654] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.828680 11976 leader_election.cc:290] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.831305 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.844127 11622 raft_consensus.cc:3060] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.845873 11844 raft_consensus.cc:2468] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:40.806419 12060 raft_consensus.cc:515] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.858129 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.859633 11622 raft_consensus.cc:2468] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
W20260709 12:24:40.860092 11664 leader_election.cc:343] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.860847 12060 leader_election.cc:290] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.861425 11739 leader_election.cc:304] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:40.862390 11943 raft_consensus.cc:2804] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.862843 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:40.863551 11846 raft_consensus.cc:3060] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.852145 11897 ts_tablet_manager.cc:1434] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:24:40.862884 11943 raft_consensus.cc:697] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:40.869908 11896 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.869668 11943 consensus_queue.cc:237] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.870422 11896 ts_tablet_manager.cc:1403] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 12:24:40.870712 12009 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.871222 12009 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.871915 11897 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.873445 11896 raft_consensus.cc:359] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.874146 11896 raft_consensus.cc:385] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.874416 11896 raft_consensus.cc:740] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.875231 11981 consensus_queue.cc:1048] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.875125 11896 consensus_queue.cc:260] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.881518 11897 tablet_bootstrap.cc:654] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.881551 11896 ts_tablet_manager.cc:1434] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:40.882977 11896 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.884305 11894 tablet_bootstrap.cc:492] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:40.884825 11894 ts_tablet_manager.cc:1403] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.009s
I20260709 12:24:40.885232 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:40.888242 11664 leader_election.cc:343] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.873481 12009 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.889153 11895 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:40.889812 11846 raft_consensus.cc:2468] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:40.890197 11895 ts_tablet_manager.cc:1403] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.004s
I20260709 12:24:40.905386 11663 leader_election.cc:304] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.906965 12009 raft_consensus.cc:2804] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.907127 11895 raft_consensus.cc:359] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.892791 11896 tablet_bootstrap.cc:654] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.896680 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:40.910023 11844 raft_consensus.cc:2468] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:40.912904 11663 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.914114 12083 raft_consensus.cc:2804] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.914494 12083 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.914796 12083 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.916723 11895 raft_consensus.cc:385] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.917092 11895 raft_consensus.cc:740] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.917887 11895 consensus_queue.cc:260] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.920322 11895 ts_tablet_manager.cc:1434] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:24:40.921619 11895 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:40.900614 11897 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:40.908177 12009 raft_consensus.cc:697] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:40.923934 11897 ts_tablet_manager.cc:1403] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 12:24:40.924378 12009 consensus_queue.cc:237] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.926597 12083 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.889844 11894 raft_consensus.cc:359] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.927114 11897 raft_consensus.cc:359] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.927897 11894 raft_consensus.cc:385] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.928404 11894 raft_consensus.cc:740] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.930188 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:40.930364 11894 consensus_queue.cc:260] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.930401 11896 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:40.931531 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
W20260709 12:24:40.931934 11664 leader_election.cc:343] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.932157 11896 ts_tablet_manager.cc:1403] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.005s
I20260709 12:24:40.932112 11844 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.927961 11897 raft_consensus.cc:385] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.933346 11897 raft_consensus.cc:740] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.934028 11518 catalog_manager.cc:5697] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.936304 11895 tablet_bootstrap.cc:654] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.937604 11894 ts_tablet_manager.cc:1434] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:24:40.938782 11894 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:40.936079 11896 raft_consensus.cc:359] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.939787 11896 raft_consensus.cc:385] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.940096 11896 raft_consensus.cc:740] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.939932 11897 consensus_queue.cc:260] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:40.940953 11896 consensus_queue.cc:260] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:40.928848 12083 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:40.941272 11844 raft_consensus.cc:2468] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:40.947227 11663 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.949617 11897 ts_tablet_manager.cc:1434] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:24:40.950858 11897 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:40.943318 11896 ts_tablet_manager.cc:1434] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 12:24:40.954794 11896 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:40.957540 11897 tablet_bootstrap.cc:654] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.958541 12062 raft_consensus.cc:2804] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.959515 12062 raft_consensus.cc:697] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:40.960610 12062 consensus_queue.cc:237] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.963382 12060 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.964046 12060 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:40.966482 12060 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:40.968395 11895 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:40.969087 11895 ts_tablet_manager.cc:1403] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 12:24:40.969058 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:40.971410 11664 leader_election.cc:343] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.978253 11895 raft_consensus.cc:359] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.979403 11895 raft_consensus.cc:385] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:40.979902 11895 raft_consensus.cc:740] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:40.958689 11894 tablet_bootstrap.cc:654] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.984045 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:40.985791 11663 leader_election.cc:343] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:40.986418 11663 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:40.990780 11895 consensus_queue.cc:260] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:40.989290 12062 raft_consensus.cc:2749] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.000130 11896 tablet_bootstrap.cc:654] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.001717 11895 ts_tablet_manager.cc:1434] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.006s
I20260709 12:24:41.007158 11895 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:41.008167 12142 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.008770 12142 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.010969 12142 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:41.015084 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.016435 11895 tablet_bootstrap.cc:654] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:41.017159 11812 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.018271 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:41.019694 11813 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.020172 11813 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.021199 12142 raft_consensus.cc:2749] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.028352 12142 raft_consensus.cc:493] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.029070 11897 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:41.028875 12142 raft_consensus.cc:515] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.029699 11897 ts_tablet_manager.cc:1403] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.005s
I20260709 12:24:41.032495 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.033377 11897 raft_consensus.cc:359] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.034040 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.034690 12142 leader_election.cc:290] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:41.034232 11812 leader_election.cc:343] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.034261 11897 raft_consensus.cc:385] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.035600 11897 raft_consensus.cc:740] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:41.036123 11814 leader_election.cc:343] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.036602 11814 leader_election.cc:304] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:41.036466 11897 consensus_queue.cc:260] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.036929 11894 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:41.037459 12142 raft_consensus.cc:2749] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.037696 11894 ts_tablet_manager.cc:1403] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.002s
I20260709 12:24:41.043804 11896 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:41.044013 12115 raft_consensus.cc:493] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.044458 11896 ts_tablet_manager.cc:1403] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.002s
I20260709 12:24:41.043893 11943 raft_consensus.cc:493] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.044626 12115 raft_consensus.cc:515] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.045413 11943 raft_consensus.cc:515] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.047242 12115 leader_election.cc:290] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.047940 11943 leader_election.cc:290] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:41.058316 11895 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:41.048075 11896 raft_consensus.cc:359] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.049955 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.072778 11896 raft_consensus.cc:385] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.050236 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0821f1ba5d454c60969fe784eb8f4587" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.052838 11897 ts_tablet_manager.cc:1434] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:24:41.052659 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:41.054068 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.074229 11622 raft_consensus.cc:2468] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:41.074651 11897 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:41.074774 11845 raft_consensus.cc:2468] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:41.075055 11590 leader_election.cc:304] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:41.064349 11520 catalog_manager.cc:5697] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:41.065778 11623 raft_consensus.cc:3060] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.075784 11739 leader_election.cc:304] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:41.076831 11943 raft_consensus.cc:2804] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.077368 11943 raft_consensus.cc:493] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.076766 11520 catalog_manager.cc:5697] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:41.077752 11943 raft_consensus.cc:3060] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.088744 11943 raft_consensus.cc:515] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.091594 11943 leader_election.cc:290] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:41.071743 11894 raft_consensus.cc:359] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.092283 11894 raft_consensus.cc:385] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.092660 11894 raft_consensus.cc:740] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.092967 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:41.093683 11622 raft_consensus.cc:3060] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.093506 11894 consensus_queue.cc:260] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.095904 11894 ts_tablet_manager.cc:1434] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.003s
I20260709 12:24:41.096055 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:41.096724 11845 raft_consensus.cc:3060] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.096853 11897 tablet_bootstrap.cc:654] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.097030 11894 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:41.073185 11896 raft_consensus.cc:740] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.100106 11896 consensus_queue.cc:260] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.107102 12120 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.107800 12120 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.110309 12120 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.112636 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.113425 11774 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:41.114620 11588 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:41.115623 12118 raft_consensus.cc:2804] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.116022 12118 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.116214 11896 ts_tablet_manager.cc:1434] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 12:24:41.061002 11895 ts_tablet_manager.cc:1403] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.006s
I20260709 12:24:41.129617 12189 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.130240 12189 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.132627 11895 raft_consensus.cc:359] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.117638 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.133523 11895 raft_consensus.cc:385] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.133831 11895 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.133965 11699 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:41.116932 12118 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.136219 12189 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.136746 11896 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:41.140743 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:41.134369 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:41.143326 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.144315 11770 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:41.134665 11895 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.152877 11895 ts_tablet_manager.cc:1434] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:24:41.154474 11895 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:41.161703 11981 raft_consensus.cc:493] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.162635 11895 tablet_bootstrap.cc:654] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.162355 11981 raft_consensus.cc:515] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.164665 11981 leader_election.cc:290] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.165475 11663 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:41.166599 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.168239 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.171031 12189 raft_consensus.cc:2804] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.172603 12189 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.173085 12189 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.173267 11896 tablet_bootstrap.cc:654] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.121399 11622 raft_consensus.cc:2468] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:41.177078 11739 leader_election.cc:304] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
W20260709 12:24:41.172601 11814 leader_election.cc:343] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.171790 11894 tablet_bootstrap.cc:654] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.143325 12118 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:41.178853 11812 leader_election.cc:343] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.180007 11812 leader_election.cc:304] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:41.181102 11981 raft_consensus.cc:2749] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.183336 11897 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:41.183969 11897 ts_tablet_manager.cc:1403] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.012s
I20260709 12:24:41.183763 12189 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.184551 12142 consensus_queue.cc:1048] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.186779 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:41.178124 11943 raft_consensus.cc:2804] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:41.189738 11943 raft_consensus.cc:697] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:41.191197 12189 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.191118 11943 consensus_queue.cc:237] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.191397 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:41.188956 11897 raft_consensus.cc:359] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.200870 11897 raft_consensus.cc:385] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.210268 12189 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.210907 12189 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.211045 11976 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.211931 11976 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.213241 12189 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.216156 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.218237 11976 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:41.220069 11663 leader_election.cc:343] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.222285 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.201383 11897 raft_consensus.cc:740] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.228055 11897 consensus_queue.cc:260] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.224723 11770 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.238958 11621 raft_consensus.cc:2393] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:41.246461 11897 ts_tablet_manager.cc:1434] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 12:24:41.252377 11844 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:41.258649 11894 tablet_bootstrap.cc:492] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:41.259284 11894 ts_tablet_manager.cc:1403] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.016s
I20260709 12:24:41.255924 11845 raft_consensus.cc:2468] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:41.251729 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:41.262171 11895 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
W20260709 12:24:41.262477 11664 leader_election.cc:343] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.262583 11897 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:41.263059 11664 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.269987 12189 raft_consensus.cc:2749] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.271098 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:41.274461 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:41.275727 11696 raft_consensus.cc:2393] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:41.262744 11895 ts_tablet_manager.cc:1403] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.009s
I20260709 12:24:41.277070 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.265902 12118 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.282074 11894 raft_consensus.cc:359] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.284003 11895 raft_consensus.cc:359] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.285269 11588 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:41.286468 11894 raft_consensus.cc:385] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.287029 11894 raft_consensus.cc:740] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.286681 11895 raft_consensus.cc:385] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.287976 11895 raft_consensus.cc:740] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.288942 11894 consensus_queue.cc:260] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.291565 12118 raft_consensus.cc:2749] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.295894 11770 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:41.296034 11895 consensus_queue.cc:260] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.298370 11894 ts_tablet_manager.cc:1434] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:24:41.294579 12115 raft_consensus.cc:2749] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.307701 11897 tablet_bootstrap.cc:654] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.308561 11895 ts_tablet_manager.cc:1434] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.006s
I20260709 12:24:41.305716 11700 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:41.312551 11894 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:41.305474 12142 raft_consensus.cc:493] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.318318 12142 raft_consensus.cc:515] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.320770 12142 leader_election.cc:290] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:41.316431 11812 consensus_peers.cc:597] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:41.321956 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad92fece50d444cb8e4841eb7f23518" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:41.322453 11895 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
W20260709 12:24:41.323915 11813 leader_election.cc:343] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.334991 11895 tablet_bootstrap.cc:654] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.337005 11663 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.340772 11976 consensus_queue.cc:1048] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.341740 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad92fece50d444cb8e4841eb7f23518" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.357403 11740 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:41.372725 12189 raft_consensus.cc:2804] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:41.366752 11894 tablet_bootstrap.cc:654] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.373724 11896 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:41.381830 11896 ts_tablet_manager.cc:1403] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.246s	user 0.030s	sys 0.031s
I20260709 12:24:41.376461 11983 consensus_queue.cc:1048] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:41.360703 11518 catalog_manager.cc:5697] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:41.386479 11700 raft_consensus.cc:2468] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:41.396864 11943 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.389737 12189 raft_consensus.cc:697] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:41.404068 12189 consensus_queue.cc:237] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.408612 11814 leader_election.cc:304] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.409582 11929 raft_consensus.cc:2804] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:41.409893 11664 consensus_peers.cc:597] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:41.407227 11896 raft_consensus.cc:359] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.411252 11896 raft_consensus.cc:385] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.411628 11896 raft_consensus.cc:740] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.409970 11929 raft_consensus.cc:493] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.412479 11896 consensus_queue.cc:260] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.414855 11929 raft_consensus.cc:3060] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:41.424633 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 62444.4us
I20260709 12:24:41.441135 11897 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:41.431003 12115 raft_consensus.cc:493] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.442492 11897 ts_tablet_manager.cc:1403] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.181s	user 0.025s	sys 0.013s
I20260709 12:24:41.442193 12115 raft_consensus.cc:515] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.444893 12115 leader_election.cc:290] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.445889 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.446874 11844 raft_consensus.cc:2393] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:41.454478 11896 ts_tablet_manager.cc:1434] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:24:41.431794 11983 raft_consensus.cc:493] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.458230 11983 raft_consensus.cc:515] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.460513 11983 leader_election.cc:290] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:41.462174 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28755e05e0c142a8a2e116e1c788f197" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.463642 11770 raft_consensus.cc:3060] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.454407 11897 raft_consensus.cc:359] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.467725 11897 raft_consensus.cc:385] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.468061 11897 raft_consensus.cc:740] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.468715 11897 consensus_queue.cc:260] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.479988 11897 ts_tablet_manager.cc:1434] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:24:41.476548 11929 raft_consensus.cc:515] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.483393 11896 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:41.439430 12205 consensus_queue.cc:1048] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:24:41.477451 11590 leader_election.cc:304] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
W20260709 12:24:41.485263 12202 log.cc:927] Time spent T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:24:41.517246 12083 consensus_queue.cc:1048] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.482944 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.520141 12115 raft_consensus.cc:3060] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:41.520396 11590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 48074us
I20260709 12:24:41.515674 12189 consensus_queue.cc:1048] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:24:41.524710 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad92fece50d444cb8e4841eb7f23518" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:41.525508 11696 raft_consensus.cc:3060] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.500311 11929 leader_election.cc:290] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.489769 11897 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:41.487579 11943 raft_consensus.cc:2749] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.510064 11521 catalog_manager.cc:5697] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:41.492910 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad92fece50d444cb8e4841eb7f23518" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:41.551011 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffaa0a9d87c431ba2962fb1ba98a6b5" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:41.559243 11813 leader_election.cc:343] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.552336 11981 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.566131 11981 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.568255 11896 tablet_bootstrap.cc:654] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.569450 12115 raft_consensus.cc:2749] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.591069 11897 tablet_bootstrap.cc:654] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.593416 11738 leader_election.cc:304] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:41.601029 12189 consensus_queue.cc:1048] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.603031 11981 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:41.605090 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:41.610380 11812 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.632877 11895 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:41.633471 11895 ts_tablet_manager.cc:1403] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.311s	user 0.022s	sys 0.007s
I20260709 12:24:41.639814 11983 consensus_queue.cc:1048] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.646122 12062 raft_consensus.cc:493] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.646704 12062 raft_consensus.cc:515] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.648030 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:41.650110 11813 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.650749 11813 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.650815 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.658797 11894 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:41.659557 11894 ts_tablet_manager.cc:1403] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.348s	user 0.020s	sys 0.008s
W20260709 12:24:41.659435 11663 leader_election.cc:343] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.661026 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.661949 11844 raft_consensus.cc:2468] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:41.667146 11663 leader_election.cc:304] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:41.668361 12009 raft_consensus.cc:2804] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.668814 12009 raft_consensus.cc:493] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.669199 12009 raft_consensus.cc:3060] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.669559 12142 raft_consensus.cc:2749] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.651434 12062 leader_election.cc:290] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:41.678990 12201 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.679661 12201 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:41.682006 12201 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:41.684239 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.637676 11895 raft_consensus.cc:359] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.700224 11895 raft_consensus.cc:385] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.700863 11895 raft_consensus.cc:740] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.714263 11895 consensus_queue.cc:260] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.719564 11895 ts_tablet_manager.cc:1434] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 12:24:41.720881 11895 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
W20260709 12:24:41.694015 11588 leader_election.cc:343] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.690167 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.692978 12201 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.710273 11894 raft_consensus.cc:359] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.730090 11894 raft_consensus.cc:385] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.730607 11894 raft_consensus.cc:740] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.682961 12009 raft_consensus.cc:515] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.733842 12201 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.736265 11845 raft_consensus.cc:2468] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:41.746681 11894 consensus_queue.cc:260] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.773325 11894 ts_tablet_manager.cc:1434] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.113s	user 0.010s	sys 0.001s
I20260709 12:24:41.771461 12201 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.780283 11894 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:41.786840 11897 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:41.787487 11897 ts_tablet_manager.cc:1403] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.298s	user 0.004s	sys 0.022s
I20260709 12:24:41.789304 11896 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:41.789878 11896 ts_tablet_manager.cc:1403] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.311s	user 0.011s	sys 0.011s
I20260709 12:24:41.764128 12223 consensus_queue.cc:1048] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:24:41.791759 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.795912 12206 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.796510 12206 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.801731 12206 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.803251 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.811836 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:41.798748 11700 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:41.794090 11588 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:41.819846 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:41.820386 11696 raft_consensus.cc:2468] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:41.820701 11623 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:41.821823 12201 raft_consensus.cc:2804] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.822254 12201 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.822582 12201 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.808616 12009 leader_election.cc:290] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:41.825497 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:41.826644 11739 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:41.826675 11845 raft_consensus.cc:3060] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.825788 11590 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:41.830082 11897 raft_consensus.cc:359] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.830972 11897 raft_consensus.cc:385] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.831337 11897 raft_consensus.cc:740] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.831880 11896 raft_consensus.cc:359] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.832906 11896 raft_consensus.cc:385] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.808871 11772 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:41.833204 11896 raft_consensus.cc:740] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.833300 11897 consensus_queue.cc:260] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.830137 12118 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.843899 12118 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.844331 12118 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.844048 11896 consensus_queue.cc:260] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.845396 11897 ts_tablet_manager.cc:1434] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.004s
I20260709 12:24:41.845732 11896 ts_tablet_manager.cc:1434] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 12:24:41.846665 11897 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:41.846912 11896 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:41.834791 12206 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:41.849198 12206 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.849592 12206 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:41.851132 12218 log.cc:927] Time spent T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:24:41.842319 11894 tablet_bootstrap.cc:654] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.834759 12222 consensus_queue.cc:1048] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:24:41.865711 12118 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:41.873335 11663 leader_election.cc:343] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:41.874495 12215 log.cc:927] Time spent T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:41.880689 11814 leader_election.cc:304] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.882517 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.883810 11981 raft_consensus.cc:493] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.884469 11981 raft_consensus.cc:515] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.885746 11897 tablet_bootstrap.cc:654] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.887014 11929 raft_consensus.cc:2804] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:41.887784 11929 raft_consensus.cc:697] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:41.888314 12206 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:41.888862 11929 consensus_queue.cc:237] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:41.887192 11981 leader_election.cc:290] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.883860 11700 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 0.
I20260709 12:24:41.889436 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:41.905858 11895 tablet_bootstrap.cc:654] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.907545 11896 tablet_bootstrap.cc:654] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.903395 12062 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.907115 11813 leader_election.cc:343] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.938690 11929 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.939189 12118 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.939222 11929 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.941557 11929 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:41.942684 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:41.943958 11700 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.944267 12206 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:41.944267 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:41.945497 11772 raft_consensus.cc:2393] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:41.946062 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:41.948447 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:41.948668 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.949532 11773 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:41.923096 12062 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.919847 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:41.951122 11623 raft_consensus.cc:2393] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:41.917717 11622 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:41.951776 12062 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:41.953016 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:41.953811 11844 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:41.929541 11976 raft_consensus.cc:2749] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:41.956113 11663 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:41.957458 12009 consensus_queue.cc:1048] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:41.957674 11845 raft_consensus.cc:2468] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:41.958417 11812 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:41.959262 12009 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.959784 12009 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.960390 12009 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.961162 11739 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.965664 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:41.969024 11773 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:41.970036 11663 leader_election.cc:304] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:41.970702 12206 raft_consensus.cc:2749] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:24:41.981232 11814 leader_election.cc:343] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.982318 12213 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.977451 12062 raft_consensus.cc:2804] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:41.982937 12213 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.983198 12062 raft_consensus.cc:697] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:41.983604 12213 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.984330 12062 consensus_queue.cc:237] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:41.982319 11814 leader_election.cc:304] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:41.998996 11894 tablet_bootstrap.cc:492] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:41.999703 11894 ts_tablet_manager.cc:1403] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.001s
I20260709 12:24:42.000571 11929 raft_consensus.cc:2749] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.002525 11929 raft_consensus.cc:493] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.003115 11929 raft_consensus.cc:515] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.006721 11929 leader_election.cc:290] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:42.007580 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.007746 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:42.014284 11813 leader_election.cc:343] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.021319 12189 consensus_queue.cc:1048] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.027391 11894 raft_consensus.cc:359] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.034874 11894 raft_consensus.cc:385] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.035246 11894 raft_consensus.cc:740] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.036314 11894 consensus_queue.cc:260] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.041533 12009 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.046574 11698 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:42.057680 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.019235 11700 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:42.078634 11894 ts_tablet_manager.cc:1434] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:24:42.032413 12201 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.077157 11518 catalog_manager.cc:5697] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.088526 11590 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.089639 12120 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.090270 12120 raft_consensus.cc:697] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
W20260709 12:24:42.094743 11814 leader_election.cc:343] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.095304 11814 leader_election.cc:304] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:42.116258 11895 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.117115 11895 ts_tablet_manager.cc:1403] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.397s	user 0.018s	sys 0.022s
I20260709 12:24:42.125028 11894 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:42.108361 11975 raft_consensus.cc:2749] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.091136 12120 consensus_queue.cc:237] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.135231 12009 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:42.137801 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.141199 11773 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:42.152664 12229 log.cc:927] Time spent T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:24:42.153586 12201 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:42.157083 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:42.157939 11844 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.169775 11896 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:42.170897 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.172523 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:42.159637 12009 raft_consensus.cc:493] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.173040 12213 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.173908 12009 raft_consensus.cc:515] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.176188 12009 leader_election.cc:290] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:42.187831 11845 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:42.182385 12213 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.189881 11896 ts_tablet_manager.cc:1403] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.343s	user 0.024s	sys 0.008s
I20260709 12:24:42.195307 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.199331 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.191344 11895 raft_consensus.cc:359] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.200907 11895 raft_consensus.cc:385] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.208582 11895 raft_consensus.cc:740] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.206640 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:42.207633 11774 raft_consensus.cc:3060] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:42.203030 11588 leader_election.cc:343] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:42.212230 11663 leader_election.cc:343] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.216820 11894 tablet_bootstrap.cc:654] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.215858 11521 catalog_manager.cc:5697] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.220244 11895 consensus_queue.cc:260] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.217324 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:42.224673 11698 raft_consensus.cc:2393] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:42.226284 11814 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:42.226962 11897 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:42.209837 11773 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:42.227718 12213 raft_consensus.cc:2749] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.213269 11844 raft_consensus.cc:2468] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:42.213982 11847 raft_consensus.cc:2468] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:42.236109 11895 ts_tablet_manager.cc:1434] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 12:24:42.230780 11663 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:42.238377 11663 leader_election.cc:304] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.227596 11897 ts_tablet_manager.cc:1403] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.381s	user 0.019s	sys 0.009s
I20260709 12:24:42.239703 12189 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.240151 11588 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.240284 12189 raft_consensus.cc:697] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:42.241394 12189 consensus_queue.cc:237] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.244899 11895 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.242550 11897 raft_consensus.cc:359] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.276392 11897 raft_consensus.cc:385] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.276746 11897 raft_consensus.cc:740] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.277604 11897 consensus_queue.cc:260] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.279139 11894 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:42.243625 12009 raft_consensus.cc:2804] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.281005 11897 ts_tablet_manager.cc:1434] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 12:24:42.243399 12120 raft_consensus.cc:2804] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.281714 12120 raft_consensus.cc:697] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:42.282284 11897 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:42.282693 12120 consensus_queue.cc:237] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.288674 11895 tablet_bootstrap.cc:654] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.246219 11896 raft_consensus.cc:359] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.289772 11896 raft_consensus.cc:385] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.290125 11896 raft_consensus.cc:740] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.290843 11896 consensus_queue.cc:260] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.287824 11521 catalog_manager.cc:5697] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.280972 12009 raft_consensus.cc:493] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.298702 12009 raft_consensus.cc:3060] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.293067 11896 ts_tablet_manager.cc:1434] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.001s
I20260709 12:24:42.308841 12201 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.309454 12201 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.310658 11895 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.311237 11895 ts_tablet_manager.cc:1403] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.067s	user 0.003s	sys 0.009s
I20260709 12:24:42.312011 11896 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:42.313012 11518 catalog_manager.cc:5697] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 2, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 2 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.314221 11895 raft_consensus.cc:359] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.314795 12201 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.315407 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.315869 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.314936 11895 raft_consensus.cc:385] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.316524 11698 raft_consensus.cc:2468] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:42.316548 11895 raft_consensus.cc:740] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
W20260709 12:24:42.316826 11588 leader_election.cc:343] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.317739 11895 consensus_queue.cc:260] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.318033 11590 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.320215 11895 ts_tablet_manager.cc:1434] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:24:42.321015 12201 raft_consensus.cc:2804] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.321478 12201 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.321573 11895 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.321877 12201 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.328272 11894 ts_tablet_manager.cc:1403] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.209s	user 0.031s	sys 0.008s
I20260709 12:24:42.335146 11897 tablet_bootstrap.cc:654] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.334524 12201 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.339742 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:42.340461 11698 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.343596 11895 tablet_bootstrap.cc:654] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.349968 12060 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.350632 12060 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.353345 12060 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.365825 11897 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:42.366438 11895 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.366997 11895 ts_tablet_manager.cc:1403] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:24:42.367937 12009 raft_consensus.cc:515] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.370003 11895 raft_consensus.cc:359] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.370836 11895 raft_consensus.cc:385] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.371620 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.373243 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
W20260709 12:24:42.373534 11663 leader_election.cc:343] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.373943 11844 raft_consensus.cc:3060] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.370069 12009 leader_election.cc:290] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:42.354745 11896 tablet_bootstrap.cc:654] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.354561 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.357502 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:42.358094 12201 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:42.378468 11663 leader_election.cc:343] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:42.379029 11664 leader_election.cc:343] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.379582 11664 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:42.382714 11518 catalog_manager.cc:5697] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.388331 11698 raft_consensus.cc:2468] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:42.391812 11590 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:42.392180 12009 raft_consensus.cc:2749] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.360178 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.393780 12201 raft_consensus.cc:2804] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.394557 12201 raft_consensus.cc:697] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:42.396042 12201 consensus_queue.cc:237] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:42.394629 11588 leader_election.cc:343] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.366446 11897 ts_tablet_manager.cc:1403] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.005s
I20260709 12:24:42.402704 11897 raft_consensus.cc:359] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.410668 11897 raft_consensus.cc:385] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.371089 11895 raft_consensus.cc:740] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.410997 11897 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.412596 11844 raft_consensus.cc:2468] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:42.412276 11897 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.424770 11897 ts_tablet_manager.cc:1434] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:24:42.426117 11897 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:42.430241 11663 leader_election.cc:304] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.433960 12009 raft_consensus.cc:2804] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.435904 12009 raft_consensus.cc:697] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
W20260709 12:24:42.436975 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:42.436858 12009 consensus_queue.cc:237] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.441135 11897 tablet_bootstrap.cc:654] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.446893 11521 catalog_manager.cc:5697] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.452227 11896 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:42.452839 11896 ts_tablet_manager.cc:1403] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.145s	user 0.031s	sys 0.020s
I20260709 12:24:42.359522 11894 raft_consensus.cc:359] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.455950 11894 raft_consensus.cc:385] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.456292 11894 raft_consensus.cc:740] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.457113 11894 consensus_queue.cc:260] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.464249 11975 raft_consensus.cc:493] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.465071 11894 ts_tablet_manager.cc:1434] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.000s
I20260709 12:24:42.464831 11975 raft_consensus.cc:515] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.466228 11894 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:42.467108 11975 leader_election.cc:290] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.468382 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:42.470155 11812 leader_election.cc:343] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.470561 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.463652 11896 raft_consensus.cc:359] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.472067 11896 raft_consensus.cc:385] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.472345 11896 raft_consensus.cc:740] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.473096 11896 consensus_queue.cc:260] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.481806 11896 ts_tablet_manager.cc:1434] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 12:24:42.495918 11813 consensus_peers.cc:597] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:42.496605 11894 tablet_bootstrap.cc:654] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.512121 12213 consensus_queue.cc:1048] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.515749 11895 consensus_queue.cc:260] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.527787 11700 raft_consensus.cc:2468] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:42.529739 11895 ts_tablet_manager.cc:1434] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.162s	user 0.009s	sys 0.004s
I20260709 12:24:42.519265 11896 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:42.539341 11897 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:42.539796 11896 tablet_bootstrap.cc:654] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.540023 11897 ts_tablet_manager.cc:1403] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.114s	user 0.033s	sys 0.040s
I20260709 12:24:42.542078 11895 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.543655 11897 raft_consensus.cc:359] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.544770 11897 raft_consensus.cc:385] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.545171 11897 raft_consensus.cc:740] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.546197 11897 consensus_queue.cc:260] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.549230 11814 leader_election.cc:304] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.549367 11897 ts_tablet_manager.cc:1434] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:24:42.550289 11929 raft_consensus.cc:2804] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.550673 11929 raft_consensus.cc:493] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.550981 11929 raft_consensus.cc:3060] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.518142 11521 catalog_manager.cc:5697] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.565049 11895 tablet_bootstrap.cc:654] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.571403 11896 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:42.572517 11896 ts_tablet_manager.cc:1403] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.012s
I20260709 12:24:42.573849 11895 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.574440 11895 ts_tablet_manager.cc:1403] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260709 12:24:42.576370 11897 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:42.578341 11894 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:42.578960 11894 ts_tablet_manager.cc:1403] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.017s
W20260709 12:24:42.579380 11663 consensus_peers.cc:597] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:42.582504 11929 raft_consensus.cc:515] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.584810 11929 leader_election.cc:290] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.586649 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
W20260709 12:24:42.588882 11812 leader_election.cc:343] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.590945 12120 consensus_queue.cc:1048] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.590047 11895 raft_consensus.cc:359] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.593366 11895 raft_consensus.cc:385] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.593726 11895 raft_consensus.cc:740] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.594533 11895 consensus_queue.cc:260] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.595870 11897 tablet_bootstrap.cc:654] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.597337 11895 ts_tablet_manager.cc:1434] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:24:42.598661 11895 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.599097 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:42.599812 11700 raft_consensus.cc:3060] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.605685 11895 tablet_bootstrap.cc:654] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.622001 11895 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.622640 11895 ts_tablet_manager.cc:1403] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 12:24:42.614778 11896 raft_consensus.cc:359] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.624577 11896 raft_consensus.cc:385] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.625061 11896 raft_consensus.cc:740] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.625402 11772 raft_consensus.cc:1275] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:42.626134 11895 raft_consensus.cc:359] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.627029 11895 raft_consensus.cc:385] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.627378 11895 raft_consensus.cc:740] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.632797 12062 consensus_queue.cc:1048] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.628244 11895 consensus_queue.cc:260] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.638593 11895 ts_tablet_manager.cc:1434] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:24:42.639732 11895 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.647902 11895 tablet_bootstrap.cc:654] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.665798 11975 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.666592 11975 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.669144 11975 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:42.670718 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:42.671850 11624 raft_consensus.cc:2468] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:42.673836 11813 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:42.675338 11975 raft_consensus.cc:2804] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.675940 11975 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.676362 11975 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.681713 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:42.684037 11812 leader_election.cc:343] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.626207 11896 consensus_queue.cc:260] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.687331 11896 ts_tablet_manager.cc:1434] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.002s
I20260709 12:24:42.688683 11896 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:42.696905 11896 tablet_bootstrap.cc:654] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.700258 11929 raft_consensus.cc:493] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.700949 11929 raft_consensus.cc:515] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.701912 11897 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:42.702528 11897 ts_tablet_manager.cc:1403] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.060s
I20260709 12:24:42.705785 11700 raft_consensus.cc:2468] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:42.708935 12083 raft_consensus.cc:493] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.709563 12083 raft_consensus.cc:515] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.712046 12083 leader_election.cc:290] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:42.714188 11896 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:42.714810 11896 ts_tablet_manager.cc:1403] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:24:42.714970 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.715377 11929 leader_election.cc:290] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.717358 11895 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.717948 11895 ts_tablet_manager.cc:1403] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.010s
W20260709 12:24:42.718802 11812 leader_election.cc:343] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.665674 11894 raft_consensus.cc:359] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.720103 11894 raft_consensus.cc:385] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.722728 11896 raft_consensus.cc:359] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.723609 11896 raft_consensus.cc:385] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.723661 12201 consensus_queue.cc:1048] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.724767 11975 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.723137 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.725569 11897 raft_consensus.cc:359] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.726392 11897 raft_consensus.cc:385] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.726730 11897 raft_consensus.cc:740] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.727603 11897 consensus_queue.cc:260] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.728884 11814 leader_election.cc:304] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.729573 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.727236 11975 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:42.730510 12226 raft_consensus.cc:2804] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.731066 11697 raft_consensus.cc:2468] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:42.733444 11897 ts_tablet_manager.cc:1434] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.008s
I20260709 12:24:42.734674 11897 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:42.731119 12226 raft_consensus.cc:697] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:42.736485 12226 consensus_queue.cc:237] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.741583 11897 tablet_bootstrap.cc:654] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.742151 11814 leader_election.cc:304] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.747828 12213 raft_consensus.cc:2804] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.748304 12213 raft_consensus.cc:493] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.748672 12213 raft_consensus.cc:3060] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.753237 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:42.720826 11894 raft_consensus.cc:740] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.763037 11894 consensus_queue.cc:260] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:42.754570 11663 leader_election.cc:343] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.724006 11896 raft_consensus.cc:740] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.784893 11895 raft_consensus.cc:359] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.785732 11895 raft_consensus.cc:385] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.786018 11895 raft_consensus.cc:740] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
W20260709 12:24:42.789033 11812 leader_election.cc:343] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.795748 12083 raft_consensus.cc:493] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.796495 12083 raft_consensus.cc:515] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.798841 12083 leader_election.cc:290] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:42.800007 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:42.801522 11664 leader_election.cc:343] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.803838 11894 ts_tablet_manager.cc:1434] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.225s	user 0.011s	sys 0.001s
I20260709 12:24:42.786957 11895 consensus_queue.cc:260] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.807657 12263 raft_consensus.cc:493] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.809839 11894 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:42.810017 12263 raft_consensus.cc:515] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.812661 11895 ts_tablet_manager.cc:1434] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.001s
I20260709 12:24:42.813877 11895 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:42.819852 12263 leader_election.cc:290] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:42.820559 12019 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.821219 12019 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.825276 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:42.825572 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:42.826285 11697 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:42.815796 12213 raft_consensus.cc:515] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:42.828310 11590 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:42.828733 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:42.829229 12019 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.829484 11847 raft_consensus.cc:2468] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:42.829607 12115 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.830245 12115 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.830637 11845 raft_consensus.cc:2393] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:42.830694 12115 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.840678 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:42.843560 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:42.844276 11773 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.844609 11697 raft_consensus.cc:3060] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.852524 12118 consensus_queue.cc:1048] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.853915 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:42.854923 11847 raft_consensus.cc:2468] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
W20260709 12:24:42.864413 11588 leader_election.cc:343] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.866016 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:42.872004 12213 leader_election.cc:290] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.880955 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:42.881932 11622 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.884572 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
W20260709 12:24:42.887173 11812 leader_election.cc:343] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.908082 11896 consensus_queue.cc:260] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.914356 11897 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:42.920989 11897 ts_tablet_manager.cc:1403] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.187s	user 0.077s	sys 0.077s
W20260709 12:24:42.914747 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 50422.9us
I20260709 12:24:42.924701 11897 raft_consensus.cc:359] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.934816 11897 raft_consensus.cc:385] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.935268 11897 raft_consensus.cc:740] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.930334 12009 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.942219 11623 raft_consensus.cc:3060] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.937700 11895 tablet_bootstrap.cc:654] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.942998 12115 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:42.944976 11622 raft_consensus.cc:2468] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:42.951295 12223 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.951975 12223 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.959409 11845 raft_consensus.cc:1275] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:24:42.932276 11664 leader_election.cc:343] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.932773 11894 tablet_bootstrap.cc:654] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.934145 11697 raft_consensus.cc:2468] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:42.926936 11896 ts_tablet_manager.cc:1434] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.212s	user 0.012s	sys 0.000s
I20260709 12:24:42.966449 11896 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: Bootstrap starting.
I20260709 12:24:42.937054 11897 consensus_queue.cc:260] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.969640 11897 ts_tablet_manager.cc:1434] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:24:42.970937 11897 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:42.975020 11894 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:42.975733 11894 ts_tablet_manager.cc:1403] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.001s
I20260709 12:24:42.976446 11896 tablet_bootstrap.cc:654] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.970934 11895 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:42.978762 11895 ts_tablet_manager.cc:1403] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.165s	user 0.014s	sys 0.020s
W20260709 12:24:42.982050 11814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 88310us
I20260709 12:24:42.938242 12009 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:42.985435 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 56432.2us
I20260709 12:24:42.974795 11813 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:42.986537 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:42.988157 12009 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:42.991636 11894 raft_consensus.cc:359] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:42.992417 11894 raft_consensus.cc:385] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.994427 12118 consensus_queue.cc:1048] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:42.994742 12263 consensus_queue.cc:1048] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.959550 12223 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:42.998590 11895 raft_consensus.cc:359] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:42.992707 11894 raft_consensus.cc:740] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.000844 11895 raft_consensus.cc:385] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.001179 11773 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.001302 11894 consensus_queue.cc:260] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.004397 11894 ts_tablet_manager.cc:1434] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:24:43.005761 11894 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:43.005949 11663 leader_election.cc:304] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.007071 12009 raft_consensus.cc:2804] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.001269 11895 raft_consensus.cc:740] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.007561 11663 leader_election.cc:304] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:43.007575 12009 raft_consensus.cc:493] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.008278 11897 tablet_bootstrap.cc:654] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.009640 12189 raft_consensus.cc:2749] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.009963 12118 consensus_queue.cc:1048] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.012480 11663 leader_election.cc:304] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.008915 12009 raft_consensus.cc:3060] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.020310 12189 raft_consensus.cc:2804] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.020768 12189 raft_consensus.cc:493] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.008100 12115 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:43.021140 12189 raft_consensus.cc:3060] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.023370 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.025506 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:43.028394 11814 leader_election.cc:304] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:43.030385 12268 raft_consensus.cc:2804] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.031174 12268 raft_consensus.cc:697] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:43.031304 11975 raft_consensus.cc:2804] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.032004 11975 raft_consensus.cc:697] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:43.032590 12268 consensus_queue.cc:237] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:43.036285 12189 raft_consensus.cc:515] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:43.044222 11588 leader_election.cc:343] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.017329 11894 tablet_bootstrap.cc:654] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.055315 11520 catalog_manager.cc:5697] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.008109 11895 consensus_queue.cc:260] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.053583 12213 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.068277 12213 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.068681 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:43.069181 11975 consensus_queue.cc:237] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.070639 12213 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.072537 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:43.073424 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:43.074031 11697 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.090781 11895 ts_tablet_manager.cc:1434] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.112s	user 0.003s	sys 0.006s
W20260709 12:24:43.096004 11664 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.054100 11813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 99108.6us
I20260709 12:24:43.115775 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.123926 12189 leader_election.cc:290] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.129654 11895 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: Bootstrap starting.
I20260709 12:24:43.157105 12009 raft_consensus.cc:515] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:43.159096 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 83754.5us
W20260709 12:24:43.160876 11663 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.161495 11663 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.174983 12062 raft_consensus.cc:2749] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.175716 12062 consensus_queue.cc:1048] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:43.176303 11896 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: No bootstrap required, opened a new log
I20260709 12:24:43.176997 12062 consensus_queue.cc:1048] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:43.178076 12276 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.179067 11813 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.184710 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:43.187659 11844 raft_consensus.cc:3060] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.177019 11896 ts_tablet_manager.cc:1403] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.040s
I20260709 12:24:43.183390 11895 tablet_bootstrap.cc:654] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.155011 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:43.204062 12009 leader_election.cc:290] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.214175 12205 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.217154 12009 raft_consensus.cc:493] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.217818 12009 raft_consensus.cc:515] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.210772 12019 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.224553 12019 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.225327 12009 leader_election.cc:290] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.226372 12118 consensus_queue.cc:1048] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:43.226984 12019 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:43.219794 12268 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.238056 11812 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.244169 11812 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.255033 11896 raft_consensus.cc:359] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.256980 11896 raft_consensus.cc:385] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.246120 11738 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:43.238993 12283 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.258833 11896 raft_consensus.cc:740] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.256178 12226 raft_consensus.cc:2749] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.274152 11896 consensus_queue.cc:260] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:43.260478 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 44711.4us
W20260709 12:24:43.278918 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 108805us
I20260709 12:24:43.178637 12276 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.214882 12205 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.249801 12268 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.296873 11929 consensus_queue.cc:1048] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.278610 12223 raft_consensus.cc:2749] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.299358 11896 ts_tablet_manager.cc:1434] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.001s
I20260709 12:24:43.300633 11897 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:43.301183 11897 ts_tablet_manager.cc:1403] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.331s	user 0.023s	sys 0.028s
I20260709 12:24:43.301498 11895 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: No bootstrap required, opened a new log
I20260709 12:24:43.302023 11895 ts_tablet_manager.cc:1403] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: Time spent bootstrapping tablet: real 0.173s	user 0.005s	sys 0.015s
I20260709 12:24:43.302717 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:43.333570 11894 tablet_bootstrap.cc:492] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:43.334203 11894 ts_tablet_manager.cc:1403] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.329s	user 0.023s	sys 0.019s
I20260709 12:24:43.338518 11897 raft_consensus.cc:359] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.339761 11897 raft_consensus.cc:385] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.340677 11897 raft_consensus.cc:740] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.341637 11897 consensus_queue.cc:260] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.300705 12268 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.273649 12283 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.360494 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:43.333597 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:43.381861 12285 log.cc:927] Time spent T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:43.384048 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:43.384833 11842 raft_consensus.cc:3060] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.384934 11895 raft_consensus.cc:359] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.385771 11895 raft_consensus.cc:385] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.386061 11895 raft_consensus.cc:740] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.386709 11895 consensus_queue.cc:260] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.387225 11894 raft_consensus.cc:359] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:43.387967 12280 log.cc:927] Time spent T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:24:43.387976 11894 raft_consensus.cc:385] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.388561 11894 raft_consensus.cc:740] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.389557 11895 ts_tablet_manager.cc:1434] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: Time spent starting tablet: real 0.087s	user 0.015s	sys 0.003s
I20260709 12:24:43.389231 11894 consensus_queue.cc:260] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:43.389642 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:43.391711 11664 leader_election.cc:343] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.392767 11664 leader_election.cc:343] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.393476 11772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:43.394670 11894 ts_tablet_manager.cc:1434] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.004s
I20260709 12:24:43.396265 11697 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:43.398911 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.400295 11622 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:43.401057 11843 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
W20260709 12:24:43.420622 11588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 52702.4us
I20260709 12:24:43.423316 11844 raft_consensus.cc:2468] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:43.425060 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:43.425136 12213 raft_consensus.cc:493] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.426731 12213 raft_consensus.cc:515] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.429376 11841 raft_consensus.cc:2468] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:43.428966 12213 leader_election.cc:290] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:43.430779 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:43.431491 11696 raft_consensus.cc:2468] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 0.
I20260709 12:24:43.432765 11814 leader_election.cc:304] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:43.439309 11813 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:43.440093 11588 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:43.448537 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.436546 12213 raft_consensus.cc:2804] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.452790 11975 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.457567 12296 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.457631 11975 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.458230 12296 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.458493 11975 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.458694 12296 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.461315 12276 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.464550 11842 raft_consensus.cc:2468] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:43.467358 12283 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:43.469538 12205 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.471272 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:43.471987 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.474059 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.456557 12213 raft_consensus.cc:493] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.475813 12213 raft_consensus.cc:3060] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:43.475844 11813 leader_election.cc:343] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.481329 11813 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.494661 11897 ts_tablet_manager.cc:1434] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.193s	user 0.018s	sys 0.040s
I20260709 12:24:43.496150 12213 raft_consensus.cc:515] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.496898 11897 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:43.499152 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
W20260709 12:24:43.500778 11588 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.501207 11813 leader_election.cc:343] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.501958 11738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 243276us
I20260709 12:24:43.502606 11975 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:43.508879 11812 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.509963 11812 consensus_peers.cc:597] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:43.511013 11812 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.519627 11590 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
W20260709 12:24:43.569365 11590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 49851us
I20260709 12:24:43.520561 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:43.579676 12275 consensus_queue.cc:1048] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.523255 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.523751 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:43.584849 11696 raft_consensus.cc:3060] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.525422 11975 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.533985 11769 raft_consensus.cc:3060] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.525241 11897 tablet_bootstrap.cc:654] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:43.541642 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 108804us
I20260709 12:24:43.588300 11663 leader_election.cc:304] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.589078 12189 raft_consensus.cc:2804] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.589556 12189 raft_consensus.cc:697] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:43.589733 11663 leader_election.cc:304] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.590497 12189 consensus_queue.cc:237] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:43.545428 11664 leader_election.cc:343] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.591238 12019 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:43.591580 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 46216.8us
I20260709 12:24:43.591764 12019 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:43.549043 12226 consensus_queue.cc:1048] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:24:43.533243 12009 raft_consensus.cc:493] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.593552 12009 raft_consensus.cc:515] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.511413 11812 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:43.597538 11812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 86562.4us
I20260709 12:24:43.598001 12279 raft_consensus.cc:2804] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.598640 12279 raft_consensus.cc:697] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:43.594898 11663 leader_election.cc:304] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.513092 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:43.513581 11894 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
W20260709 12:24:43.530961 12278 log.cc:927] Time spent T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: Append to log took a long time: real 0.252s	user 0.004s	sys 0.000s
I20260709 12:24:43.525703 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.567939 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:43.603948 11621 raft_consensus.cc:2393] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:43.651822 12295 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.651670 12279 consensus_queue.cc:237] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:43.652530 12295 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.562551 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:43.592729 12019 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:43.660900 12009 leader_election.cc:290] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:43.602671 11975 raft_consensus.cc:2749] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.530616 12213 leader_election.cc:290] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:43.730581 11894 tablet_bootstrap.cc:654] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:43.758512 11663 consensus_peers.cc:597] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:43.698210 12296 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.782822 11622 raft_consensus.cc:2393] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:43.768463 12295 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:43.766997 11739 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:43.810277 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 62698.8us
I20260709 12:24:43.800956 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:43.812412 11812 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.813270 11897 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:43.813848 11897 ts_tablet_manager.cc:1403] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.317s	user 0.024s	sys 0.022s
I20260709 12:24:43.814157 11739 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:43.815382 12283 raft_consensus.cc:2749] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.815564 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:43.816147 12283 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.817919 12296 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:43.809085 11696 raft_consensus.cc:2468] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:43.819895 12060 raft_consensus.cc:2764] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:24:43.824615 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:24:43.824954 11812 consensus_peers.cc:597] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:43.867661 11929 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.868527 11929 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.877333 11929 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:43.842617 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:43.882687 11841 raft_consensus.cc:2393] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:43.885955 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:43.888634 11664 leader_election.cc:343] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:43.888684 11813 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.863411 11814 leader_election.cc:304] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:43.894140 12293 raft_consensus.cc:2804] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.894892 12293 raft_consensus.cc:697] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:43.896122 12293 consensus_queue.cc:237] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:43.907963 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 121786us
I20260709 12:24:43.902271 11897 raft_consensus.cc:359] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:43.924124 11897 raft_consensus.cc:385] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.924546 11897 raft_consensus.cc:740] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:43.917423 11588 leader_election.cc:343] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.935461 11897 consensus_queue.cc:260] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:43.963784 11812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 98354.3us
I20260709 12:24:43.943117 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:43.970757 11897 ts_tablet_manager.cc:1434] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.157s	user 0.012s	sys 0.002s
I20260709 12:24:44.042872 11897 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:44.056551 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:44.057634 11700 raft_consensus.cc:2468] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
W20260709 12:24:44.061621 11814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 160870us
W20260709 12:24:44.075120 12280 log.cc:927] Time spent T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:44.139750 12283 raft_consensus.cc:2749] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.160627 11894 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:44.161468 11894 ts_tablet_manager.cc:1403] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.648s	user 0.042s	sys 0.046s
I20260709 12:24:44.156410 12297 raft_consensus.cc:493] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 141a039ea83140368c7d19efb49a48bc)
I20260709 12:24:44.164798 12297 raft_consensus.cc:515] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:44.166525 12321 log.cc:927] Time spent T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:24:44.189137 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:44.193477 12297 leader_election.cc:290] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:44.213124 11588 leader_election.cc:343] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.213706 11588 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
W20260709 12:24:44.209533 11663 leader_election.cc:343] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.221011 11663 leader_election.cc:304] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:44.219940 12118 raft_consensus.cc:2749] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.225590 12279 raft_consensus.cc:2749] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.232462 11590 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:44.234839 12315 raft_consensus.cc:2804] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.235266 12315 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.235730 12315 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.238564 11894 raft_consensus.cc:359] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:44.235059 11813 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:44.240743 11894 raft_consensus.cc:385] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.241146 11894 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.241775 11894 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:44.244300 12332 raft_consensus.cc:2749] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.251935 12315 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:44.254272 12322 log.cc:927] Time spent T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:24:44.254518 12315 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:44.256201 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:44.255167 12315 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.259187 11588 leader_election.cc:343] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:44.264696 11814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 195761us
I20260709 12:24:44.266340 12296 raft_consensus.cc:493] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 141a039ea83140368c7d19efb49a48bc)
I20260709 12:24:44.268079 12296 raft_consensus.cc:515] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.272210 11894 ts_tablet_manager.cc:1434] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.003s
I20260709 12:24:44.275815 12083 consensus_queue.cc:1048] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.265602 12315 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:44.281674 11894 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:44.288106 11770 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.291399 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.292126 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.296101 11897 tablet_bootstrap.cc:654] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.297780 12315 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:44.278725 12296 leader_election.cc:290] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:44.304666 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:44.306284 12319 log.cc:927] Time spent T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
I20260709 12:24:44.306123 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:44.316984 11699 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.323287 11894 tablet_bootstrap.cc:654] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.327359 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:44.329738 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.332477 12287 consensus_queue.cc:1048] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:24:44.335358 11588 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.330557 11845 raft_consensus.cc:2468] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:44.353489 11699 raft_consensus.cc:2468] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:44.355273 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9c065d47b4da99521736c33b51839" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:44.362607 11740 leader_election.cc:304] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:44.364775 12284 raft_consensus.cc:2749] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:44.367637 12326 log.cc:927] Time spent T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 12:24:44.375855 12288 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.377518 12288 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.389708 11519 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.392630 11897 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:44.393379 11897 ts_tablet_manager.cc:1403] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.351s	user 0.025s	sys 0.007s
I20260709 12:24:44.393071 11519 catalog_manager.cc:5697] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } }
W20260709 12:24:44.391047 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 433522us
I20260709 12:24:44.373509 11520 catalog_manager.cc:5697] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.414113 11588 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
W20260709 12:24:44.418272 11813 consensus_peers.cc:597] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:44.419232 12268 consensus_queue.cc:1048] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.421275 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:44.422629 12201 raft_consensus.cc:2804] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.423678 11897 raft_consensus.cc:359] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.425052 11897 raft_consensus.cc:385] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.425422 11897 raft_consensus.cc:740] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.426298 11897 consensus_queue.cc:260] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.423139 12201 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.431469 12201 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.413408 11520 catalog_manager.cc:5697] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } }
I20260709 12:24:44.441051 11520 catalog_manager.cc:5697] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.479537 11897 ts_tablet_manager.cc:1434] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 12:24:44.487985 11897 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:44.491039 11812 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.491601 11812 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:44.494465 11929 raft_consensus.cc:2749] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.478736 12205 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.367291 11590 leader_election.cc:304] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:44.526401 11894 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:44.527104 11894 ts_tablet_manager.cc:1403] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.248s	user 0.009s	sys 0.005s
I20260709 12:24:44.518783 12205 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:44.533543 12205 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:44.540766 12315 raft_consensus.cc:2749] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.545536 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:44.548882 11590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 181738us
I20260709 12:24:44.550312 11590 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:44.551298 12315 raft_consensus.cc:2804] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.551890 12315 raft_consensus.cc:697] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:44.552769 12315 consensus_queue.cc:237] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:44.566749 12345 log.cc:927] Time spent T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:24:44.570411 11929 consensus_queue.cc:1048] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.575048 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:44.587761 11696 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
W20260709 12:24:44.604604 11664 consensus_peers.cc:597] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:44.606110 12201 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:44.613011 11897 tablet_bootstrap.cc:654] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.618677 11740 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:44.617211 11894 raft_consensus.cc:359] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:44.623965 11894 raft_consensus.cc:385] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.624467 11894 raft_consensus.cc:740] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.625526 11894 consensus_queue.cc:260] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:44.634640 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:44.637607 12284 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:44.638556 11588 leader_election.cc:343] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.688655 11619 raft_consensus.cc:3060] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.692692 12284 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:44.693320 12284 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.717301 11894 ts_tablet_manager.cc:1434] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.189s	user 0.020s	sys 0.001s
I20260709 12:24:44.716049 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:44.726795 11843 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.710947 12201 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:44.749226 11897 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:44.749862 11897 ts_tablet_manager.cc:1403] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.025s
I20260709 12:24:44.762518 11894 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:44.772544 12318 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.815972 11897 raft_consensus.cc:359] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.816799 11897 raft_consensus.cc:385] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.817070 11897 raft_consensus.cc:740] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.820787 11897 consensus_queue.cc:260] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.842636 11897 ts_tablet_manager.cc:1434] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.002s
I20260709 12:24:44.813025 12297 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.867307 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:44.871162 11897 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:44.820235 12318 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:44.884492 12357 log.cc:927] Time spent T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:24:44.902045 12288 raft_consensus.cc:493] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.902639 12288 raft_consensus.cc:515] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.904803 12288 leader_election.cc:290] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:44.862506 12297 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:44.926515 11894 tablet_bootstrap.cc:654] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.918689 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.919857 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf7dd33493f4ea39e190ab6f2eacf45" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:44.924981 12318 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:44.935042 12340 raft_consensus.cc:493] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.935689 12340 raft_consensus.cc:515] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:44.937316 11588 leader_election.cc:304] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:44.939127 12340 leader_election.cc:290] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:44.941167 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:44.939649 12315 raft_consensus.cc:2749] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.943084 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.958647 11844 raft_consensus.cc:2393] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate ed4262e8a41a45cebe0b2587d48e1135 in this term.
I20260709 12:24:44.956938 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:44.959789 12352 consensus_queue.cc:1048] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.957149 11618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:44.961058 12359 log.cc:927] Time spent T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:24:44.961975 11664 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.943009 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:44.957612 11897 tablet_bootstrap.cc:654] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.954556 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:44.989974 11588 leader_election.cc:304] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:44.987897 11624 raft_consensus.cc:2393] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:45.009243 11739 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:45.012568 12337 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:44.985522 11663 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.019897 11663 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:44.914994 12297 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:45.022529 12009 raft_consensus.cc:2749] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.002882 11843 raft_consensus.cc:2468] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:45.006659 12284 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.029028 11521 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36738 (request call id 67) took 1160 ms. Trace:
I20260709 12:24:45.041450 11588 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:45.045293 11929 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.049480 11624 raft_consensus.cc:3060] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.046044 11929 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.046478 11521 rpcz_store.cc:276] 0709 12:24:43.862424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.864617 (+  2193us) service_pool.cc:224] Handling call
0709 12:24:45.022248 (+1157631us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":8}
I20260709 12:24:45.064476 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:45.066151 11812 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.053133 12340 raft_consensus.cc:2804] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.075938 11929 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:45.077212 11894 tablet_bootstrap.cc:492] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.077832 11894 ts_tablet_manager.cc:1403] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.317s	user 0.011s	sys 0.021s
I20260709 12:24:45.058766 11767 raft_consensus.cc:1240] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Rejecting Update request from peer a4cfb7e6c6a743fe80ee7917f0521805 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:45.084403 12340 raft_consensus.cc:697] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:45.085464 12340 consensus_queue.cc:237] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.086200 12298 raft_consensus.cc:2749] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:45.090917 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:45.105705 11897 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:45.107867 11897 ts_tablet_manager.cc:1403] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.255s	user 0.016s	sys 0.002s
I20260709 12:24:45.110534 12284 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:45.113413 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:45.117035 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:45.118733 11740 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:45.119925 12284 raft_consensus.cc:2749] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:45.123374 11813 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.124130 11813 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:45.132597 12213 raft_consensus.cc:2749] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.137226 12298 consensus_queue.cc:1059] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.138512 12315 raft_consensus.cc:3055] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:45.138963 12315 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:45.140053 12315 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.141585 12315 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.144707 12311 consensus_queue.cc:1048] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.146339 12337 raft_consensus.cc:2749] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.150317 11894 raft_consensus.cc:359] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.151342 11894 raft_consensus.cc:385] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.156694 11894 raft_consensus.cc:740] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.157532 11894 consensus_queue.cc:260] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.159420 11894 ts_tablet_manager.cc:1434] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 12:24:45.166304 11894 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:45.158476 11897 raft_consensus.cc:359] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.166913 11897 raft_consensus.cc:385] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.167268 11897 raft_consensus.cc:740] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.173106 11894 tablet_bootstrap.cc:654] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.173285 11897 consensus_queue.cc:260] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.181394 11897 ts_tablet_manager.cc:1434] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:24:45.187712 12337 raft_consensus.cc:493] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.188441 12337 raft_consensus.cc:515] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.196136 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.201515 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d410c3744a2471289fb0620248a0598" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:45.204023 12337 leader_election.cc:290] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.208835 11738 leader_election.cc:304] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:45.221068 11521 catalog_manager.cc:5697] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 1 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } }
I20260709 12:24:45.222474 12340 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.223039 12340 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.225399 12340 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:45.226363 11897 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:45.227528 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:45.232554 11588 consensus_peers.cc:597] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.233012 12325 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.233655 12284 raft_consensus.cc:2749] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.230695 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:45.234777 11696 raft_consensus.cc:2468] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:45.233702 12325 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:45.233135 11588 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.236158 11590 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:45.237282 12325 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:45.238080 12311 raft_consensus.cc:2804] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.238648 12311 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.238914 11894 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.239171 12311 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.239481 11894 ts_tablet_manager.cc:1403] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.026s
I20260709 12:24:45.237843 11897 tablet_bootstrap.cc:654] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.242802 11894 raft_consensus.cc:359] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.243554 11894 raft_consensus.cc:385] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.243816 11894 raft_consensus.cc:740] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.244947 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:45.249094 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:45.250742 11812 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.252318 11894 consensus_queue.cc:260] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.256593 11894 ts_tablet_manager.cc:1434] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:45.257701 11894 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
W20260709 12:24:45.279989 11813 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.281793 11813 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:45.286669 11894 tablet_bootstrap.cc:654] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.302783 11894 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.303347 11894 ts_tablet_manager.cc:1403] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.006s
I20260709 12:24:45.308126 11894 raft_consensus.cc:359] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.308974 11894 raft_consensus.cc:385] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.309288 11894 raft_consensus.cc:740] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.310184 11894 consensus_queue.cc:260] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.313529 11894 ts_tablet_manager.cc:1434] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:45.314777 11894 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:45.314960 12337 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.315582 12337 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.321841 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:45.322379 12284 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.321769 12337 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:45.322968 12284 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.326948 11894 tablet_bootstrap.cc:654] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:45.328712 11813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 45383.9us
I20260709 12:24:45.339228 12333 raft_consensus.cc:2749] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.347262 12284 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:45.322865 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:45.360793 11739 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:45.364394 12337 raft_consensus.cc:2749] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.371886 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.395097 11844 raft_consensus.cc:2393] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:45.379264 12311 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.386816 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:45.404172 11738 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:45.410446 12311 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:45.412145 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:45.412885 11694 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.406953 12331 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.415942 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
W20260709 12:24:45.417644 11588 leader_election.cc:343] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.424448 11894 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.425007 11894 ts_tablet_manager.cc:1403] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.111s	user 0.031s	sys 0.003s
I20260709 12:24:45.430244 12331 raft_consensus.cc:2749] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.428195 11894 raft_consensus.cc:359] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.431277 11894 raft_consensus.cc:385] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.431648 11894 raft_consensus.cc:740] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.432756 11894 consensus_queue.cc:260] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.432193 11694 raft_consensus.cc:2468] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:45.435232 11590 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:45.435513 11894 ts_tablet_manager.cc:1434] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:45.436462 12288 raft_consensus.cc:2804] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.436828 11894 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:45.437019 12288 raft_consensus.cc:697] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:45.438063 12288 consensus_queue.cc:237] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.440358 11897 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:45.441009 11897 ts_tablet_manager.cc:1403] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.215s	user 0.041s	sys 0.049s
I20260709 12:24:45.446985 11897 raft_consensus.cc:359] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.447824 11897 raft_consensus.cc:385] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.448151 11897 raft_consensus.cc:740] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.454929 11894 tablet_bootstrap.cc:654] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.458405 11897 consensus_queue.cc:260] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.461624 11897 ts_tablet_manager.cc:1434] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:24:45.462774 11897 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:45.468953 11897 tablet_bootstrap.cc:654] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.497246 11518 catalog_manager.cc:5697] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.502203 11518 catalog_manager.cc:5697] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.519122 11897 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:45.519932 11897 ts_tablet_manager.cc:1403] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.009s
I20260709 12:24:45.521211 11894 tablet_bootstrap.cc:492] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.521795 11894 ts_tablet_manager.cc:1403] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.003s
I20260709 12:24:45.529552 11897 raft_consensus.cc:359] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.530880 11897 raft_consensus.cc:385] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.531260 11897 raft_consensus.cc:740] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.534622 11897 consensus_queue.cc:260] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.541332 11897 ts_tablet_manager.cc:1434] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:24:45.545423 11894 raft_consensus.cc:359] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.546264 11894 raft_consensus.cc:385] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.546561 11894 raft_consensus.cc:740] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.547410 11894 consensus_queue.cc:260] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.547991 11897 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:45.551076 12311 consensus_queue.cc:1048] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:45.564101 11894 ts_tablet_manager.cc:1434] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 12:24:45.564210 11897 tablet_bootstrap.cc:654] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.577734 11769 raft_consensus.cc:3060] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.589078 12313 consensus_queue.cc:1048] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.609882 11894 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:45.616828 11518 catalog_manager.cc:5697] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.652189 12313 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.652732 12313 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.658789 12331 raft_consensus.cc:493] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.659397 12331 raft_consensus.cc:515] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.654848 12313 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.662956 12331 leader_election.cc:290] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.663563 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:45.666452 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.663617 11897 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:45.668502 11897 ts_tablet_manager.cc:1403] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.121s	user 0.032s	sys 0.016s
I20260709 12:24:45.670881 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:45.671977 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.672721 11842 raft_consensus.cc:2468] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:45.674930 11738 leader_election.cc:304] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:45.675081 11897 raft_consensus.cc:359] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:45.675840 11897 raft_consensus.cc:385] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.676105 11897 raft_consensus.cc:740] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.676865 11897 consensus_queue.cc:260] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:45.677318 12331 raft_consensus.cc:2749] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.678692 11897 ts_tablet_manager.cc:1434] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:24:45.680150 11588 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
W20260709 12:24:45.690400 11588 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.696761 12313 raft_consensus.cc:2804] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.697355 12313 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.697784 12313 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.698999 11894 tablet_bootstrap.cc:654] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.700306 11897 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:45.710894 11897 tablet_bootstrap.cc:654] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.729924 12298 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.730888 12298 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.733110 12298 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.735221 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.736291 11843 raft_consensus.cc:2468] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 0.
I20260709 12:24:45.740762 11588 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:45.743048 12288 raft_consensus.cc:2804] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.743531 12288 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.743880 12288 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.747962 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:45.757891 11588 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.766424 11897 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: No bootstrap required, opened a new log
I20260709 12:24:45.767058 11897 ts_tablet_manager.cc:1403] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.028s
I20260709 12:24:45.767566 12340 raft_consensus.cc:493] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.768285 12340 raft_consensus.cc:515] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:45.770648 12340 leader_election.cc:290] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:45.772738 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:45.775193 11894 tablet_bootstrap.cc:492] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.775754 11894 ts_tablet_manager.cc:1403] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.001s
I20260709 12:24:45.777220 12313 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.779742 12313 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.780409 12288 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.782943 12288 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:45.785331 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d4fdb6dd444feae249f74e1ac29bc" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:45.788260 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:45.788898 11842 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.792284 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:45.793689 11624 raft_consensus.cc:3060] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.795310 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:45.795972 11844 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.804373 11894 raft_consensus.cc:359] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.805160 11894 raft_consensus.cc:385] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.804984 11897 raft_consensus.cc:359] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.805527 11894 raft_consensus.cc:740] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.805881 11897 raft_consensus.cc:385] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.806207 12352 raft_consensus.cc:493] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.806308 11894 consensus_queue.cc:260] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:45.803893 11767 raft_consensus.cc:3060] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.806910 12352 raft_consensus.cc:515] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.808077 11894 ts_tablet_manager.cc:1434] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:24:45.805292 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:45.809561 12352 leader_election.cc:290] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:45.811640 11844 raft_consensus.cc:2468] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:45.819293 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:45.820788 11894 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:45.813038 11842 raft_consensus.cc:2468] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:45.806227 11897 raft_consensus.cc:740] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
W20260709 12:24:45.813340 11588 leader_election.cc:343] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:45.823091 11663 leader_election.cc:343] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.822763 11897 consensus_queue.cc:260] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.825297 11897 ts_tablet_manager.cc:1434] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.058s	user 0.014s	sys 0.013s
I20260709 12:24:45.825436 11588 leader_election.cc:304] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:45.826874 11588 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:45.827782 11588 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:45.835134 12288 raft_consensus.cc:2804] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.835742 12288 raft_consensus.cc:697] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:45.836575 12288 consensus_queue.cc:237] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:45.843283 11588 leader_election.cc:343] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.845363 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:45.846063 11624 raft_consensus.cc:2468] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 0.
I20260709 12:24:45.847472 11664 leader_election.cc:304] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:45.848779 11774 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.843918 12313 raft_consensus.cc:2749] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.839746 12340 raft_consensus.cc:2804] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.862752 12340 raft_consensus.cc:697] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:45.863745 12340 consensus_queue.cc:237] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:45.852741 12320 raft_consensus.cc:2804] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.867726 11894 tablet_bootstrap.cc:654] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.867960 12320 raft_consensus.cc:493] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.868597 12320 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.920652 12331 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.921430 12331 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.956542 11894 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:45.957348 11894 ts_tablet_manager.cc:1403] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.014s
I20260709 12:24:45.965639 11770 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:45.992048 11570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:45.996196 12320 raft_consensus.cc:515] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:45.998759 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:46.001322 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:46.002206 11623 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.002360 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:46.003201 11694 raft_consensus.cc:2393] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:45.999228 12331 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:46.003700 11894 raft_consensus.cc:359] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.004426 11894 raft_consensus.cc:385] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.004686 11894 raft_consensus.cc:740] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.005331 11894 consensus_queue.cc:260] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.006517 11739 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:46.021766 11521 catalog_manager.cc:5697] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.026422 11521 catalog_manager.cc:5697] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.027328 11894 ts_tablet_manager.cc:1434] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 12:24:46.033420 12284 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.034067 12284 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.036566 11894 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:46.060837 12284 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:46.065052 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:46.065922 11844 raft_consensus.cc:2393] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in current term 1: Already voted for candidate a4cfb7e6c6a743fe80ee7917f0521805 in this term.
I20260709 12:24:46.066977 12315 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.059723 12320 leader_election.cc:290] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:46.067997 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:46.051613 12337 raft_consensus.cc:2749] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.058367 12340 consensus_queue.cc:1048] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:24:46.081722 12315 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.086117 11739 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:46.087400 12337 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.074935 11623 raft_consensus.cc:2468] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:46.077247 11894 tablet_bootstrap.cc:654] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.098037 12315 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:46.100571 11664 leader_election.cc:304] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:46.101462 12279 raft_consensus.cc:2804] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:46.101938 12279 raft_consensus.cc:697] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:46.103158 12279 consensus_queue.cc:237] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.104231 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:46.105201 11770 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:46.109366 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:46.110126 11844 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 1.
I20260709 12:24:46.116359 11588 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
W20260709 12:24:46.120806 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 64190us
I20260709 12:24:46.122181 12315 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:46.122843 12315 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.126514 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:46.143712 11521 catalog_manager.cc:5697] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 1 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.125749 12315 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.157549 12337 raft_consensus.cc:2749] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:46.160459 11663 leader_election.cc:343] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.160823 12288 consensus_queue.cc:1048] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.179234 11894 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:46.179854 11894 ts_tablet_manager.cc:1403] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.008s
I20260709 12:24:46.184860 11894 raft_consensus.cc:359] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.186091 11894 raft_consensus.cc:385] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.186405 11894 raft_consensus.cc:740] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.186257 11769 raft_consensus.cc:3060] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.187400 11894 consensus_queue.cc:260] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.190347 11894 ts_tablet_manager.cc:1434] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:24:46.193882 11894 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Bootstrap starting.
I20260709 12:24:46.213678 12315 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.216269 12315 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:46.219139 11894 tablet_bootstrap.cc:654] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.252676 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:46.253449 11769 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.256554 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:46.257508 11844 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.262717 11769 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:24:46.303603 11588 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:46.310024 12315 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:46.312199 12315 raft_consensus.cc:697] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:46.313835 12315 consensus_queue.cc:237] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.318730 12313 consensus_queue.cc:1048] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.310024 11844 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:24:46.352591 12313 consensus_queue.cc:1048] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.375892 11894 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: No bootstrap required, opened a new log
I20260709 12:24:46.376474 11894 ts_tablet_manager.cc:1403] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent bootstrapping tablet: real 0.183s	user 0.029s	sys 0.070s
I20260709 12:24:46.380177 11894 raft_consensus.cc:359] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.380942 11894 raft_consensus.cc:385] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.386251 11894 raft_consensus.cc:740] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.387137 11894 consensus_queue.cc:260] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:46.388753 11588 consensus_peers.cc:597] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.392613 12288 consensus_queue.cc:1048] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.401693 11894 ts_tablet_manager.cc:1434] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:24:46.448784 11521 catalog_manager.cc:5697] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 0 to 2, leader changed from <none> to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.504701 11769 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.516546 12352 consensus_queue.cc:1048] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.549996 12300 consensus_queue.cc:1048] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.564038 12300 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:46.564793 12300 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.567229 12300 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:46.570675 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:46.571617 11767 raft_consensus.cc:2393] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:46.571393 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:46.572161 11624 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:46.573451 11664 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:46.574631 12279 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:46.575038 12279 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:46.575434 12279 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.584990 12279 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.587844 12279 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:46.588106 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:46.588639 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:46.589466 11767 raft_consensus.cc:2393] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:46.594219 11624 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:46.595211 11664 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:46.596227 12279 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:46.596781 12279 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:46.597754 12279 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.610255 11518 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 2 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.742149 11842 raft_consensus.cc:1275] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:46.743517 12313 consensus_queue.cc:1048] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.750222 11769 raft_consensus.cc:1275] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:46.751845 12313 consensus_queue.cc:1048] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.793619 12395 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.794168 12395 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.796386 11769 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.797760 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:46.798471 11624 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:46.798676 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:46.799685 11739 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:24:46.796406 12395 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:46.803197 12395 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:46.803642 12395 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.804030 12395 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.813709 12395 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.822553 11617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:46.822999 12395 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:46.823693 11617 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.828662 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:46.835894 11617 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 3.
I20260709 12:24:46.838377 12397 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:46.839025 11739 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:46.839103 12397 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:46.839946 12420 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:46.840534 12420 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:46.841487 12420 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:46.852114 12397 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:46.853974 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:46.855903 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:46.858480 11738 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:46.859313 12397 raft_consensus.cc:2749] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:46.868564 11518 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 2 to 3, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.880836  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
I20260709 12:24:46.924072  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:46.924888  2677 tablet_replica.cc:333] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.925626  2677 raft_consensus.cc:2243] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.926128  2677 raft_consensus.cc:2272] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.929271  2677 tablet_replica.cc:333] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.929989  2677 raft_consensus.cc:2243] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.930900  2677 raft_consensus.cc:2272] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.933969  2677 tablet_replica.cc:333] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.934966  2677 raft_consensus.cc:2243] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.935606  2677 raft_consensus.cc:2272] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.938557  2677 tablet_replica.cc:333] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.939492  2677 raft_consensus.cc:2243] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.940052  2677 raft_consensus.cc:2272] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.942665  2677 tablet_replica.cc:333] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.943570  2677 raft_consensus.cc:2243] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.944161  2677 raft_consensus.cc:2272] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.946466  2677 tablet_replica.cc:333] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.947239  2677 raft_consensus.cc:2243] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.948119  2677 raft_consensus.cc:2272] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.950693  2677 tablet_replica.cc:333] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.951349  2677 raft_consensus.cc:2243] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.952279  2677 raft_consensus.cc:2272] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.954468  2677 tablet_replica.cc:333] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
W20260709 12:24:46.955313 11813 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:24:46.955348  2677 raft_consensus.cc:2243] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.956791  2677 raft_consensus.cc:2272] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.960291  2677 tablet_replica.cc:333] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.961454  2677 raft_consensus.cc:2243] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.962018  2677 raft_consensus.cc:2272] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.962594 11813 consensus_peers.cc:597] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:46.962715 11664 consensus_peers.cc:597] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.964327  2677 tablet_replica.cc:333] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.965071  2677 raft_consensus.cc:2243] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.966089  2677 raft_consensus.cc:2272] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.968583  2677 tablet_replica.cc:333] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
W20260709 12:24:46.968472 11813 consensus_peers.cc:597] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.969475  2677 raft_consensus.cc:2243] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.969977  2677 raft_consensus.cc:2272] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:46.971228 11739 consensus_peers.cc:597] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.972461  2677 tablet_replica.cc:333] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.973378  2677 raft_consensus.cc:2243] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.973923  2677 raft_consensus.cc:2272] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.976933  2677 tablet_replica.cc:333] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
W20260709 12:24:46.977635 11813 consensus_peers.cc:597] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:46.977840  2677 raft_consensus.cc:2243] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.978430  2677 raft_consensus.cc:2272] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.980819  2677 tablet_replica.cc:333] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.981741  2677 raft_consensus.cc:2243] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.982268  2677 raft_consensus.cc:2272] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.984695  2677 tablet_replica.cc:333] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.985350  2677 raft_consensus.cc:2243] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.986300  2677 raft_consensus.cc:2272] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.988878  2677 tablet_replica.cc:333] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.989522  2677 raft_consensus.cc:2243] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.990003  2677 raft_consensus.cc:2272] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.992188  2677 tablet_replica.cc:333] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.992851  2677 raft_consensus.cc:2243] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:46.993372  2677 raft_consensus.cc:2272] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.995424  2677 tablet_replica.cc:333] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:46.996299  2677 raft_consensus.cc:2243] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:46.997226  2677 raft_consensus.cc:2272] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:46.999637  2677 tablet_replica.cc:333] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.000576  2677 raft_consensus.cc:2243] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.001448  2677 raft_consensus.cc:2272] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.003787  2677 tablet_replica.cc:333] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.004565  2677 raft_consensus.cc:2243] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.005060  2677 raft_consensus.cc:2272] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.007822  2677 tablet_replica.cc:333] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.008536  2677 raft_consensus.cc:2243] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.009091  2677 raft_consensus.cc:2272] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.011260  2677 tablet_replica.cc:333] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.012223  2677 raft_consensus.cc:2243] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.012817  2677 raft_consensus.cc:2272] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.015903  2677 tablet_replica.cc:333] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.016776  2677 raft_consensus.cc:2243] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.017746  2677 raft_consensus.cc:2272] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.019392 11739 consensus_peers.cc:597] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.020203  2677 tablet_replica.cc:333] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.021162  2677 raft_consensus.cc:2243] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.021708  2677 raft_consensus.cc:2272] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.024307  2677 tablet_replica.cc:333] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.025142  2677 raft_consensus.cc:2243] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.026086  2677 raft_consensus.cc:2272] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.027290 11813 consensus_peers.cc:597] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.028805  2677 tablet_replica.cc:333] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.029738  2677 raft_consensus.cc:2243] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.030279  2677 raft_consensus.cc:2272] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.032380  2677 tablet_replica.cc:333] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.033078  2677 raft_consensus.cc:2243] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.033521  2677 raft_consensus.cc:2272] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.035600  2677 tablet_replica.cc:333] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.036373  2677 raft_consensus.cc:2243] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.036834  2677 raft_consensus.cc:2272] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.039058  2677 tablet_replica.cc:333] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.039858  2677 raft_consensus.cc:2243] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.040416  2677 raft_consensus.cc:2272] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.043133  2677 tablet_replica.cc:333] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.043936  2677 raft_consensus.cc:2243] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.044389  2677 raft_consensus.cc:2272] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.047163  2677 tablet_replica.cc:333] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
W20260709 12:24:47.047060 11739 consensus_peers.cc:597] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.048204  2677 raft_consensus.cc:2243] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.048739  2677 raft_consensus.cc:2272] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.050963  2677 tablet_replica.cc:333] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.051805  2677 raft_consensus.cc:2243] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.052732  2677 raft_consensus.cc:2272] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.055166  2677 tablet_replica.cc:333] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
W20260709 12:24:47.055574 11813 consensus_peers.cc:597] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.055830  2677 raft_consensus.cc:2243] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.056418  2677 raft_consensus.cc:2272] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.058413  2677 tablet_replica.cc:333] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.059034  2677 raft_consensus.cc:2243] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.059536  2677 raft_consensus.cc:2272] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.061508  2677 tablet_replica.cc:333] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.062278  2677 raft_consensus.cc:2243] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.062829  2677 raft_consensus.cc:2272] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.063910 11767 raft_consensus.cc:1240] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Rejecting Update request from peer 141a039ea83140368c7d19efb49a48bc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:47.065677  2677 tablet_replica.cc:333] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.065630 12279 consensus_queue.cc:1059] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.066773  2677 raft_consensus.cc:2243] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.067266 12279 consensus_queue.cc:1243] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:24:47.067395  2677 raft_consensus.cc:2272] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.069104 12300 raft_consensus.cc:3055] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:47.069455 12300 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:47.070223 12300 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:47.070711  2677 tablet_replica.cc:333] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.071108 12300 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.071637  2677 raft_consensus.cc:2243] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.072732  2677 raft_consensus.cc:2272] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.081974 11664 consensus_peers.cc:597] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.084790  2677 tablet_replica.cc:333] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.085855  2677 raft_consensus.cc:2243] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:47.086468 11587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.087630  2677 raft_consensus.cc:2272] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.090713  2677 tablet_replica.cc:333] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.091526  2677 raft_consensus.cc:2243] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.092583  2677 raft_consensus.cc:2272] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.093603 11813 consensus_peers.cc:597] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.095324  2677 tablet_replica.cc:333] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.096212  2677 raft_consensus.cc:2243] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.096755  2677 raft_consensus.cc:2272] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.099651  2677 tablet_replica.cc:333] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.100340  2677 raft_consensus.cc:2243] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:47.101244  2677 raft_consensus.cc:2272] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.103648  2677 tablet_replica.cc:333] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.104393  2677 raft_consensus.cc:2243] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.105015  2677 raft_consensus.cc:2272] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.107856  2677 tablet_replica.cc:333] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.108546  2677 raft_consensus.cc:2243] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.109094  2677 raft_consensus.cc:2272] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.111737  2677 tablet_replica.cc:333] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.112581  2677 raft_consensus.cc:2243] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.113179  2677 raft_consensus.cc:2272] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:47.116106  2677 tablet_replica.cc:333] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: stopping tablet replica
I20260709 12:24:47.116796  2677 raft_consensus.cc:2243] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:47.117421  2677 raft_consensus.cc:2272] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:47.119763 11664 consensus_peers.cc:597] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.154637 11664 consensus_peers.cc:597] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.160395 11664 consensus_peers.cc:597] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.161202 11664 consensus_peers.cc:597] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.186508 11664 consensus_peers.cc:597] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.205540 11739 consensus_peers.cc:597] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.222318  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
W20260709 12:24:47.233664 11664 consensus_peers.cc:597] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.235862 11739 consensus_peers.cc:597] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.248895 11739 consensus_peers.cc:597] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.262137 11813 consensus_peers.cc:597] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.272651 11739 consensus_peers.cc:597] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.272861 11664 consensus_peers.cc:597] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.292227 11664 consensus_peers.cc:597] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.304132 11664 consensus_peers.cc:597] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.304574  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:47.314664 12431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:47.316933 12432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:47.323879 12434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:47.327229  2677 server_base.cc:1061] running on GCE node
W20260709 12:24:47.327579 11813 consensus_peers.cc:597] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.330693  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:47.331091  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:47.331338  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599887331319 us; error 0 us; skew 500 ppm
I20260709 12:24:47.332247  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:47.336452  2677 webserver.cc:533] Webserver started at http://127.2.157.65:43383/ using document root <none> and password file <none>
I20260709 12:24:47.337044  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:47.337244  2677 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:24:47.337491 11664 consensus_peers.cc:597] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.341308  2677 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:24:47.348941 11696 raft_consensus.cc:1275] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:47.349357 11696 pending_rounds.cc:85] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Aborting all ops after (but not including) 1
I20260709 12:24:47.349596 11696 pending_rounds.cc:107] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:47.349931 11696 raft_consensus.cc:2889] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.351698 12440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:47.351506 12397 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:47.352802  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:24:47.353188  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
format_stamp: "Formatted at 2026-07-09 12:24:33 on dist-test-slave-sx71"
I20260709 12:24:47.353711  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:24:47.385782 11739 consensus_peers.cc:597] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.389313  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:47.391291  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:47.394119  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:47.406605 12450 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:24:47.415877 11664 consensus_peers.cc:597] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:47.460357 11739 consensus_peers.cc:597] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:47.746315  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:24:47.746888  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.342s	user 0.010s	sys 0.001s
I20260709 12:24:47.747362  2677 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:24:47.753698 12450 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.769541 12450 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.770511 12450 tablet_bootstrap.cc:492] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.771129 12450 ts_tablet_manager.cc:1403] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:24:47.773913 12450 raft_consensus.cc:359] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.774600 12450 raft_consensus.cc:740] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.775523 12450 consensus_queue.cc:260] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.782128 12450 ts_tablet_manager.cc:1434] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.004s
I20260709 12:24:47.782986 12450 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.818403 12450 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.819408 12450 tablet_bootstrap.cc:492] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.820129 12450 ts_tablet_manager.cc:1403] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.019s
I20260709 12:24:47.821837 12450 raft_consensus.cc:359] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.822333 12450 raft_consensus.cc:740] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.822970 12450 consensus_queue.cc:260] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.824391 12450 ts_tablet_manager.cc:1434] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:24:47.825037 12450 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.840389 12450 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.841261 12450 tablet_bootstrap.cc:492] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.841928 12450 ts_tablet_manager.cc:1403] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:24:47.844413 12450 raft_consensus.cc:359] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:47.845090 12450 raft_consensus.cc:740] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.846794 12450 consensus_queue.cc:260] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:47.848718 12450 ts_tablet_manager.cc:1434] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:47.849471 12450 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.873315 12450 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.874141 12450 tablet_bootstrap.cc:492] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.874794 12450 ts_tablet_manager.cc:1403] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 12:24:47.876695 12450 raft_consensus.cc:359] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:47.877803 12450 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.878566 12450 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:47.880262 12450 ts_tablet_manager.cc:1434] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:24:47.881094 12450 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.893100 12450 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.893944 12450 tablet_bootstrap.cc:492] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.894505 12450 ts_tablet_manager.cc:1403] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:24:47.896858 12450 raft_consensus.cc:359] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:47.897437 12450 raft_consensus.cc:740] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.897969 12450 consensus_queue.cc:260] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:47.899503 12450 ts_tablet_manager.cc:1434] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:47.900128 12450 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.913265 12450 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.914196 12450 tablet_bootstrap.cc:492] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.914834 12450 ts_tablet_manager.cc:1403] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:24:47.917209 12450 raft_consensus.cc:359] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.917898 12450 raft_consensus.cc:740] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.918699 12450 consensus_queue.cc:260] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.920506 12450 ts_tablet_manager.cc:1434] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:24:47.921190 12450 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.933907 12450 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.934727 12450 tablet_bootstrap.cc:492] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.935307 12450 ts_tablet_manager.cc:1403] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:24:47.937879 12450 raft_consensus.cc:359] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.938536 12450 raft_consensus.cc:740] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.939232 12450 consensus_queue.cc:260] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:47.941270 12450 ts_tablet_manager.cc:1434] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:47.942059 12450 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.974754 12450 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:47.975824 12450 tablet_bootstrap.cc:492] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:47.976470 12450 ts_tablet_manager.cc:1403] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.020s
I20260709 12:24:47.979130 12450 raft_consensus.cc:359] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:47.979837 12450 raft_consensus.cc:740] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.980643 11929 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:47.981148 11929 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:47.980890 12450 consensus_queue.cc:260] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:47.983240 12450 ts_tablet_manager.cc:1434] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:24:47.984069 12450 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:47.984510 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:47.992412 11929 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:47.995271 11813 leader_election.cc:336] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:47.995865 11813 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:47.996511 11929 raft_consensus.cc:2749] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.001578 12450 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.002948 12450 tablet_bootstrap.cc:492] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.003700 12450 ts_tablet_manager.cc:1403] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:24:48.006379 12450 raft_consensus.cc:359] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.007077 12450 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.007884 12450 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.009843 12450 ts_tablet_manager.cc:1434] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:48.009747 11929 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.010538 11929 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.010962 12450 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.013662 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.016239 11929 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
W20260709 12:24:48.020121 11813 leader_election.cc:336] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.020500 11813 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.021111 11929 raft_consensus.cc:2749] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.026070 11929 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.026537 11929 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.027061 12450 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.027972 12450 tablet_bootstrap.cc:492] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.028497 11929 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.028541 12450 ts_tablet_manager.cc:1403] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:24:48.030123 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.031967 12450 raft_consensus.cc:359] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.032694 12450 raft_consensus.cc:740] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.033499 12450 consensus_queue.cc:260] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:48.033785 11813 leader_election.cc:336] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.034287 11813 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.034968 11929 raft_consensus.cc:2749] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.035787 12450 ts_tablet_manager.cc:1434] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:48.036487 12450 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.036958 12419 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.037483 12419 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.039736 12419 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.041363 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.044255  2677 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:24:48.044680  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.297s	user 0.257s	sys 0.006s
W20260709 12:24:48.049103 11739 leader_election.cc:336] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.049898 11739 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.052250 12419 raft_consensus.cc:2749] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.062961 12450 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.064033 12450 tablet_bootstrap.cc:492] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.064744 12450 ts_tablet_manager.cc:1403] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 12:24:48.067217 12450 raft_consensus.cc:359] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.067893 12450 raft_consensus.cc:740] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.068631 12450 consensus_queue.cc:260] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.070801 12450 ts_tablet_manager.cc:1434] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:48.071708 12450 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.082235 12419 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.083042 12419 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.086736 12419 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.090242 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.098318 12450 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.099329 12450 tablet_bootstrap.cc:492] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.100046 12450 ts_tablet_manager.cc:1403] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 12:24:48.102612 12450 raft_consensus.cc:359] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.103324 12450 raft_consensus.cc:740] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.104141 12450 consensus_queue.cc:260] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.106552 12450 ts_tablet_manager.cc:1434] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:48.107416 12450 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:48.111385 11739 leader_election.cc:336] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.118392 11739 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.114298 12426 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.119405 12426 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.124827 12450 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.125890 12450 tablet_bootstrap.cc:492] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.126543 12450 ts_tablet_manager.cc:1403] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 12:24:48.129144 12450 raft_consensus.cc:359] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.129828 12450 raft_consensus.cc:740] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.130721 12450 consensus_queue.cc:260] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.133018 12450 ts_tablet_manager.cc:1434] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:48.133821 12450 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:48.135251 11664 leader_election.cc:336] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.135387 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.136509 12419 raft_consensus.cc:2749] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.137240 11663 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.139093 12279 raft_consensus.cc:2749] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.140164 12426 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.148456 12300 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.149025 12300 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.154978 12450 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.156365 12450 tablet_bootstrap.cc:492] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.157037 12450 ts_tablet_manager.cc:1403] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:24:48.158419 12451 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.158982 12451 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.159829 12450 raft_consensus.cc:359] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.160542 12450 raft_consensus.cc:740] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.161267 12451 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.161409 12450 consensus_queue.cc:260] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.163712 12450 ts_tablet_manager.cc:1434] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:48.164556 12450 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.188481 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.204303 12427 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.205231 12427 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.209123 12427 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.213937 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.216346 12300 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.221699 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.222493 11769 raft_consensus.cc:2468] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
W20260709 12:24:48.223165 11664 leader_election.cc:336] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.233757 11664 leader_election.cc:336] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.240061 11664 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:48.239285 11813 leader_election.cc:336] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.245253 11813 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.235929 11663 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.246407 12451 raft_consensus.cc:2749] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.247605 12279 raft_consensus.cc:2804] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.248143 12279 raft_consensus.cc:493] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.248625 12279 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.251840 12427 raft_consensus.cc:2749] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.267812 12419 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.268280 12427 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.268429 12419 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.268860 12427 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.270726 12419 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.270963 12450 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.271713 12453 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.271802 12427 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.272286 12453 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.274441 12453 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.276398 12450 tablet_bootstrap.cc:492] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.276321 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.277138 11842 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.277279 12450 ts_tablet_manager.cc:1403] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.064s
I20260709 12:24:48.278440 11738 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.279333 12419 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:48.279722 12419 raft_consensus.cc:493] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.280073 12419 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.282815 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.283605 12427 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.284168 12427 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.288101 12419 raft_consensus.cc:515] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.290326 12419 leader_election.cc:290] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.291265 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:48.292142 11844 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.293138 12450 raft_consensus.cc:359] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.293829 12450 raft_consensus.cc:740] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.294137 12279 raft_consensus.cc:515] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.294692 12450 consensus_queue.cc:260] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.297366 12450 ts_tablet_manager.cc:1434] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:24:48.298170 12450 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.304265 12419 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.304862 12419 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.306267 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a124cf3dea44f39e82b7b9a5e9d64f" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.307124 11769 raft_consensus.cc:2393] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed4262e8a41a45cebe0b2587d48e1135 in current term 3: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:48.308274 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.308925 12419 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.308946 11694 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.310411 11740 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.311218 12419 raft_consensus.cc:2804] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.311618 12419 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.312043 12419 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.312055 12426 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.312721 12426 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.317294 12453 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.318070 12453 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:48.320134 11739 leader_election.cc:336] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.320919 11739 leader_election.cc:336] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.322621 12453 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.324400 12426 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.325344 12427 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.325845 12419 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.327768 12279 leader_election.cc:290] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.329303 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:48.329742 11844 raft_consensus.cc:2468] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 3.
I20260709 12:24:48.331753 12397 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.330773 12419 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.334621 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.339959 11769 raft_consensus.cc:2393] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:48.339668 12397 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.329998 11694 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.340459 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:48.341562 11739 leader_election.cc:336] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.342520 12397 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.338517 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.343721 11767 raft_consensus.cc:2468] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:48.344501 12397 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.345063 12397 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.347548 12397 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.348361 11694 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.348724 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.349483 11692 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.350378 11740 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.351960 12397 raft_consensus.cc:2804] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.350446 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.353488 11740 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.354158 12447 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.354875 12447 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.356243 12486 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.356703 12486 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.357056 12486 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.357826 12447 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.359177 12397 raft_consensus.cc:697] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.361096 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.360886 12397 consensus_queue.cc:237] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.362083 11692 raft_consensus.cc:2468] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.363981 11740 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
W20260709 12:24:48.364627 11739 leader_election.cc:336] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.364931 12447 raft_consensus.cc:2804] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.365514 12419 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.366080 12419 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.368319 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe475402ebb54fed9985713a50767b22" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:48.365540 12447 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.369208 12447 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.369249 11767 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.370798 12419 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:48.371934 11739 leader_election.cc:336] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.372396 11739 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:48.374039 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.374253 12419 raft_consensus.cc:2749] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.374831 11692 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
W20260709 12:24:48.374975 11739 leader_election.cc:336] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.376622 11740 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.376758 12419 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.377357 12419 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.378485 12486 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.381522 12447 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.383845 12397 raft_consensus.cc:2804] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.385514 12397 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.385947 12397 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.387313 12419 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.390259 12486 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:48.394150 11739 leader_election.cc:336] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.393275 11520 catalog_manager.cc:5697] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:48.394402 12397 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:48.394986 11739 leader_election.cc:336] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.400548 11739 leader_election.cc:336] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.400511 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:48.401748 11696 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.406729 12397 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.409005 12447 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.410121 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.416072 11692 raft_consensus.cc:2468] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.417775 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:48.430639 11694 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.418380 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
W20260709 12:24:48.419663 11813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 62891.5us
I20260709 12:24:48.431999 11697 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.412561 11739 leader_election.cc:336] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.433913 12450 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.435068 12450 tablet_bootstrap.cc:492] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.435802 12447 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.436424 12447 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:48.438483 11739 leader_election.cc:336] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.438812 12447 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.421270 11738 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.439389 12447 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.439988 12279 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.439957 12447 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.440574 12419 raft_consensus.cc:2804] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:48.441589 12419 raft_consensus.cc:697] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.442831 12447 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.443727 12450 ts_tablet_manager.cc:1403] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.039s
W20260709 12:24:48.444979 11739 leader_election.cc:336] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.440623 12279 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.447028 12450 raft_consensus.cc:359] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.447871 12450 raft_consensus.cc:740] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.442950 12419 consensus_queue.cc:237] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.448820 12450 consensus_queue.cc:260] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.451510 12450 ts_tablet_manager.cc:1434] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:48.452461 12450 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.454135 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.454958 11843 raft_consensus.cc:2468] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
W20260709 12:24:48.458315 11813 leader_election.cc:336] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.458797 11813 leader_election.cc:304] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.459605 12453 raft_consensus.cc:2749] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:48.461483 11738 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.462838 12397 raft_consensus.cc:2804] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.440801 11663 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.463533 12397 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.463979 12427 raft_consensus.cc:2804] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.464183 12397 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.464617 12427 raft_consensus.cc:493] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.465214 12427 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.472215 12279 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.475057 12450 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.476140 12450 tablet_bootstrap.cc:492] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.476850 12450 ts_tablet_manager.cc:1403] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 12:24:48.478782 11696 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
W20260709 12:24:48.427162 11664 leader_election.cc:336] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.480436 12486 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.481112 12486 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.483022 12450 raft_consensus.cc:359] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.483421 12486 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.480496 11664 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.484129 12450 raft_consensus.cc:740] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.483922 11740 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.485116 12450 consensus_queue.cc:260] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.485363 12486 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:48.485471 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 58366.3us
I20260709 12:24:48.486004 12486 raft_consensus.cc:697] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.486937 12486 consensus_queue.cc:237] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.490470 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.491185 11843 raft_consensus.cc:2468] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.492321 12450 ts_tablet_manager.cc:1434] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:48.493256 12450 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.496798 11694 raft_consensus.cc:2468] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.499362 11738 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.502625 12486 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.502700 12279 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.508370 12486 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.508631 12279 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.510969 12279 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.511128 12486 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.512210 12486 raft_consensus.cc:2804] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.500428 11740 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
W20260709 12:24:48.512513 11813 leader_election.cc:336] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.513943 11740 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.513123 12490 raft_consensus.cc:2804] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.499605 12426 raft_consensus.cc:2749] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.533087 11813 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.534873 12447 raft_consensus.cc:2804] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.535356 12447 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.535784 12447 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.537760 12427 raft_consensus.cc:515] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.535789 12453 raft_consensus.cc:2749] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.512743 12486 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.544472 12486 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.545372 12447 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.547137 12490 raft_consensus.cc:697] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.516745 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.547797 12447 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.548352 11844 raft_consensus.cc:2468] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.548395 12490 consensus_queue.cc:237] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.507285 11697 raft_consensus.cc:2468] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.520021 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:48.550554 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:48.550791 11692 raft_consensus.cc:2468] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.551193 11696 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.551311 11740 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.515594 11929 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.558686 11929 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.561067 12447 raft_consensus.cc:2804] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.561681 12447 raft_consensus.cc:697] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.562520 12447 consensus_queue.cc:237] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.563550 11929 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
W20260709 12:24:48.525976 11739 leader_election.cc:336] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.565387 11739 leader_election.cc:336] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.573644 12419 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.574514 12419 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.578135 12419 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.579698 11738 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.612844 12447 raft_consensus.cc:2804] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.613278 12447 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.613708 12447 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.616345 11738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 66274.9us
W20260709 12:24:48.623937 11740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 72710us
I20260709 12:24:48.583989 11696 raft_consensus.cc:2468] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.586079 12427 leader_election.cc:290] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:48.600565 12450 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.604418 11767 raft_consensus.cc:2468] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:48.608145 12397 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.634567 12450 tablet_bootstrap.cc:492] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.635404 12450 ts_tablet_manager.cc:1403] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.142s	user 0.023s	sys 0.004s
I20260709 12:24:48.637072 12397 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.637949 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:48.638141 12450 raft_consensus.cc:359] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.638659 11844 raft_consensus.cc:2468] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 1.
I20260709 12:24:48.638805 12450 raft_consensus.cc:740] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.639935 12450 consensus_queue.cc:260] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.642086 12450 ts_tablet_manager.cc:1434] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:24:48.642141 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:48.586967 11739 leader_election.cc:336] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.626330 11740 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:48.627031 12447 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.642968 11843 raft_consensus.cc:2468] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:48.643935 12397 raft_consensus.cc:2804] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.644328 12397 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.644927 12397 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.645102 12447 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.642923 12450 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:48.648097 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 61155.9us
I20260709 12:24:48.651878 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.654265 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:48.653549 12397 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.655103 11774 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 1.
I20260709 12:24:48.656337 11767 raft_consensus.cc:2393] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 141a039ea83140368c7d19efb49a48bc in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:48.657655 12397 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:48.651039 12486 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.660712 12486 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.663341 11812 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.664422 12453 raft_consensus.cc:2804] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.664880 12453 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.665272 12453 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.669576 11813 leader_election.cc:336] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.674263 12450 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:48.675623 12450 tablet_bootstrap.cc:492] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:48.676326 12450 ts_tablet_manager.cc:1403] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.003s
I20260709 12:24:48.631008 11520 catalog_manager.cc:5697] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 2 to 3, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:48.626897 11664 leader_election.cc:336] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.726781 11664 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.727923 11520 catalog_manager.cc:5697] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:48.732406 11520 catalog_manager.cc:5697] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:48.665273 11739 leader_election.cc:336] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.746526 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 81098.7us
W20260709 12:24:48.747634 11739 leader_election.cc:336] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.757202 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 130333us
W20260709 12:24:48.758589 11664 leader_election.cc:336] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.761041 11664 leader_election.cc:336] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.772656 12450 raft_consensus.cc:359] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.781400 12450 raft_consensus.cc:740] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.806296 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910c074d754749b9b864ab7017c2a8db" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:48.807644 11767 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.678114 12453 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.806602 11740 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.825922 12518 raft_consensus.cc:2749] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.834648 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:48.835840 11843 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.837481 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 68015.4us
I20260709 12:24:48.839430 12507 raft_consensus.cc:2804] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.839847 12450 consensus_queue.cc:260] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:48.840590 12507 raft_consensus.cc:697] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.842798 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:48.844834 11842 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.843506 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:48.848322 11844 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.850205 11738 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.853554 12397 raft_consensus.cc:2804] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.853096 12507 consensus_queue.cc:237] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.858771 12450 ts_tablet_manager.cc:1434] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.007s
I20260709 12:24:48.854163 12397 raft_consensus.cc:493] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.863168 11699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:48.864642 11699 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.878422 11739 leader_election.cc:336] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.879302 11739 leader_election.cc:336] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.880054 11767 raft_consensus.cc:2468] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:48.861012 12397 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.890784 11843 raft_consensus.cc:2468] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
W20260709 12:24:48.900355 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 87614.7us
I20260709 12:24:48.902882 11663 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:24:48.905082 12516 raft_consensus.cc:2804] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:48.905673 12516 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:24:48.906142 12516 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.918604 11842 raft_consensus.cc:2468] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.926878 12453 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:48.928257 11699 raft_consensus.cc:2468] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
W20260709 12:24:48.938145 11739 leader_election.cc:336] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.939687 11739 leader_election.cc:336] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.940965 11739 leader_election.cc:336] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:48.952843 11813 leader_election.cc:336] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.952641 11738 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.958671 11844 raft_consensus.cc:2468] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:48.967505 12486 raft_consensus.cc:2804] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.970000 12486 raft_consensus.cc:697] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.970676 12397 raft_consensus.cc:515] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.971663 12486 consensus_queue.cc:237] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:48.965759 11740 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.978142 11738 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.983924 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:48.984826 11774 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:48.987793 11664 leader_election.cc:336] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:48.991937 11844 raft_consensus.cc:1275] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:48.992609 12490 raft_consensus.cc:2804] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.993227 12490 raft_consensus.cc:697] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:48.994395 12490 consensus_queue.cc:237] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:48.996116 11697 raft_consensus.cc:1275] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.997208 12450 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:48.998345 11699 raft_consensus.cc:1275] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.998736 11738 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:48.998883 12419 raft_consensus.cc:2804] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.001549 11663 leader_election.cc:304] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.002240 12397 leader_election.cc:290] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:49.003371 12515 raft_consensus.cc:2804] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.004035 12515 raft_consensus.cc:697] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:49.004216 11663 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.005317 12515 consensus_queue.cc:237] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.005986 11774 raft_consensus.cc:2468] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 2.
I20260709 12:24:48.996800 12516 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.018802 12514 raft_consensus.cc:2749] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:49.025452 11664 leader_election.cc:336] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:24:49.027072 11664 leader_election.cc:336] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:49.025194 12447 raft_consensus.cc:2804] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.013196 12419 raft_consensus.cc:697] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:49.042300 12419 consensus_queue.cc:237] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:49.049960 11814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 63316.7us
I20260709 12:24:49.040573 12397 consensus_queue.cc:1048] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:49.072813 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04157ec411b241028d32c3555200ab43" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:49.073722 11842 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:49.073861 12516 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:49.085489 11812 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.088078 12451 raft_consensus.cc:2804] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.095552 11663 leader_election.cc:304] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.095705 12451 raft_consensus.cc:697] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 2 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:24:49.096758 12514 raft_consensus.cc:2804] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.097500 12514 raft_consensus.cc:697] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:49.097790 12451 consensus_queue.cc:237] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
W20260709 12:24:49.106254 11739 consensus_peers.cc:597] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.109678 11842 raft_consensus.cc:2468] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:24:49.098734 12514 consensus_queue.cc:237] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.112808 12447 raft_consensus.cc:697] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
W20260709 12:24:49.139626 11739 leader_election.cc:336] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:49.139513 12447 consensus_queue.cc:237] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.149756 12528 consensus_queue.cc:1048] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:49.149236 11520 catalog_manager.cc:5697] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 2 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:49.150818 11739 consensus_peers.cc:597] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.151055 12455 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.151808 12455 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.120218 12507 consensus_queue.cc:1048] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:24:49.159689 11739 consensus_peers.cc:597] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.162799 11664 leader_election.cc:336] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:24:49.186875 11738 leader_election.cc:304] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.189162 11694 raft_consensus.cc:1275] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.166522 12455 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:49.227885 12541 raft_consensus.cc:493] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.228689 12541 raft_consensus.cc:515] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:49.233582 11738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 46871.7us
I20260709 12:24:49.233105 12455 raft_consensus.cc:493] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.241508 12541 leader_election.cc:290] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:49.275556 11696 raft_consensus.cc:1275] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.280232 12534 raft_consensus.cc:2804] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.281143 12532 consensus_queue.cc:1048] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:24:49.280988 12455 raft_consensus.cc:515] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.295609 12455 leader_election.cc:290] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:49.281029 12534 raft_consensus.cc:697] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:49.317384 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:24:49.321067 11848 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:49.330366 12455 raft_consensus.cc:493] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.331354 11739 consensus_peers.cc:597] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.333071 12455 raft_consensus.cc:515] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.319599 12534 consensus_queue.cc:237] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.352062 12455 leader_election.cc:290] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:49.334596 12486 consensus_queue.cc:1048] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:24:49.364696 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 49875.5us
I20260709 12:24:49.385607 11699 raft_consensus.cc:1275] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.400802 11848 raft_consensus.cc:2468] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:49.440037 11663 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:49.428747 12397 consensus_queue.cc:1048] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:24:49.453509 12515 raft_consensus.cc:2804] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:49.459494 12515 raft_consensus.cc:697] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:49.460585 12515 consensus_queue.cc:237] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:49.461668 12554 log.cc:927] Time spent T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:24:49.462720 12450 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:49.463950 12450 tablet_bootstrap.cc:492] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:49.464737 11518 catalog_manager.cc:5697] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.467593 12455 raft_consensus.cc:493] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.468268 12455 raft_consensus.cc:515] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.470614 12455 leader_election.cc:290] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:49.464748 12450 ts_tablet_manager.cc:1403] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.468s	user 0.026s	sys 0.051s
I20260709 12:24:49.485900 11520 catalog_manager.cc:5697] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 2 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:49.466580 11518 catalog_manager.cc:5697] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.497934 12543 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.498643 12543 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.519004 12543 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:49.500304 12455 raft_consensus.cc:493] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.531224 12455 raft_consensus.cc:515] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.534086 12455 leader_election.cc:290] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:49.520299 12541 raft_consensus.cc:493] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.559878 12543 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.596266 12450 raft_consensus.cc:359] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.597119 12450 raft_consensus.cc:740] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.597883 12450 consensus_queue.cc:260] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:49.599651 12561 log.cc:927] Time spent T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:24:49.611084 11738 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 61754.8us
W20260709 12:24:49.625289 11739 consensus_peers.cc:597] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.622309 11813 consensus_peers.cc:597] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.626598 12565 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.626909 12543 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.627485 12565 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.594947 12541 raft_consensus.cc:515] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.627774 11769 raft_consensus.cc:1275] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer ed4262e8a41a45cebe0b2587d48e1135: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.625490 12450 ts_tablet_manager.cc:1434] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.147s	user 0.005s	sys 0.003s
W20260709 12:24:49.704236 11812 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.67:37587, user_credentials={real_user=slave}} blocked reactor thread for 64055.1us
I20260709 12:24:49.630198 12455 raft_consensus.cc:493] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.711658 12541 leader_election.cc:290] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:49.712214 11739 consensus_peers.cc:597] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.712860 11739 consensus_peers.cc:597] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.713516 11664 consensus_peers.cc:597] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.714056 11664 consensus_peers.cc:597] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.726073 12450 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:49.737669 12543 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:49.738744 12565 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:49.729571 12455 raft_consensus.cc:515] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.720010 12541 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.743387 12455 leader_election.cc:290] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:24:49.749424 11664 consensus_peers.cc:597] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.742710 12541 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:49.766897 12541 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:49.770323 12578 raft_consensus.cc:493] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.771091 12578 raft_consensus.cc:515] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:49.775035 12578 leader_election.cc:290] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:49.776897 12578 raft_consensus.cc:493] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.777534 12578 raft_consensus.cc:515] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.780771 12578 leader_election.cc:290] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:49.781862 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.788087 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.789410 11846 raft_consensus.cc:2393] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:49.788128 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.791610 11844 raft_consensus.cc:2393] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:49.793612 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.797405 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.802839 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.804750 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.805200 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba98915c34f347fdb7e429eef931c7ad" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.806954 11694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.807324 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.807967 11692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.808943 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.813462 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.809051 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.809986 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:49.819528 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.821472 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6631247217f4eb9b8113265bfd7ef14" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:49.824090 11813 consensus_peers.cc:597] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.824607 11813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 196458us
I20260709 12:24:49.803136 11844 raft_consensus.cc:2393] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 2: Already voted for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in this term.
I20260709 12:24:49.835265 12444 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:49.835574 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e3e708e6c145bc81691e6cbd7eb0a6" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.838140 12444 leader_election.cc:304] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:49.839946 12578 raft_consensus.cc:2749] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.840729 12578 raft_consensus.cc:3060] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:49.844730 12520 consensus_queue.cc:1048] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:49.845721 12444 leader_election.cc:304] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:49.851765 12541 raft_consensus.cc:2749] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.853086 12444 leader_election.cc:304] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
W20260709 12:24:49.853209 11664 consensus_peers.cc:597] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.853947 12541 raft_consensus.cc:2749] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:49.865370 11739 consensus_peers.cc:597] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.869463 11771 raft_consensus.cc:1275] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.870611 11846 raft_consensus.cc:1275] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.872366 11766 raft_consensus.cc:1275] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:49.865976 11739 consensus_peers.cc:597] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.876788 11739 consensus_peers.cc:597] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:49.884421 12541 raft_consensus.cc:493] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.885075 12541 raft_consensus.cc:515] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
W20260709 12:24:49.892035 11739 consensus_peers.cc:597] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.895912 12279 consensus_queue.cc:1048] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:49.887266 12541 leader_election.cc:290] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:49.898051 11739 consensus_peers.cc:597] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.906366 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:49.892949 12518 consensus_queue.cc:1048] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:24:49.914450 11849 raft_consensus.cc:1275] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.920271 11843 raft_consensus.cc:1275] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.920513 11840 raft_consensus.cc:1275] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.922317 12578 raft_consensus.cc:2749] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:49.926635 11813 consensus_peers.cc:597] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:49.935040 11813 consensus_peers.cc:597] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:49.935668 11813 consensus_peers.cc:597] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.967227 12531 consensus_queue.cc:1048] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:49.967641 11846 raft_consensus.cc:1275] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.975596 12450 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:49.976624 12279 consensus_queue.cc:1048] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:24:49.977399 11739 consensus_peers.cc:597] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:49.989912 12450 tablet_bootstrap.cc:492] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:49.990842 12450 ts_tablet_manager.cc:1403] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.285s	user 0.020s	sys 0.036s
I20260709 12:24:49.996604 12450 raft_consensus.cc:359] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:49.990753 12578 raft_consensus.cc:493] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.997825 12450 raft_consensus.cc:740] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.000260 12450 consensus_queue.cc:260] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:50.003338 12541 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.003485 12505 consensus_queue.cc:1048] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:50.004151 12541 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:50.006152 12505 consensus_queue.cc:1048] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:50.010650 12541 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:50.011082 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:50.014572 12450 ts_tablet_manager.cc:1434] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:24:50.010573 12447 consensus_queue.cc:1048] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:50.017220 12450 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
W20260709 12:24:50.025682 11664 consensus_peers.cc:597] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.029664 11664 consensus_peers.cc:597] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:50.026707 11520 catalog_manager.cc:5697] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 2 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:49.998798 12578 raft_consensus.cc:515] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
W20260709 12:24:50.050432 11664 consensus_peers.cc:597] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.039301 11520 catalog_manager.cc:5697] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 2 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:50.051426 11664 consensus_peers.cc:597] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.056592 11663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.68:43831, user_credentials={real_user=slave}} blocked reactor thread for 85065.5us
W20260709 12:24:50.051965 11664 consensus_peers.cc:597] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.059000 11664 consensus_peers.cc:597] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.059819 11664 consensus_peers.cc:597] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.063359 11813 consensus_peers.cc:597] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.068255 11813 consensus_peers.cc:597] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.086947 12578 leader_election.cc:290] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:50.088936 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:50.149456 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8cbbcd57984472b9a0ffee2f76bb32" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.149678 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e850aa3e4f4123bb241a8c42c6fba4" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.152451 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b3401de6ec4056b042aa09ec1abaa8" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.155400 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.157428 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.159931 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b354e318924ecaae70882105f1d00f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
W20260709 12:24:50.161765 11813 consensus_peers.cc:597] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.168511 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.169696 11771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.170593 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.172510 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412607e4f40b48cb9d7d91c15c2f0d1c" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.179407 11766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb409dacde4a45fd956e729c49b4a978" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.180718 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.182560 12442 leader_election.cc:304] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.187214 12442 leader_election.cc:304] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.187255 12578 raft_consensus.cc:3060] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.188097 12541 raft_consensus.cc:2749] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.188581 12442 leader_election.cc:304] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.189393 12541 raft_consensus.cc:2749] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.189924 12442 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.190652 12541 raft_consensus.cc:2749] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.191193 12442 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.192154 12541 raft_consensus.cc:2749] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.192641 12442 leader_election.cc:304] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.193445 12541 raft_consensus.cc:3060] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.193907 12442 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.198392 12455 raft_consensus.cc:2749] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.200263 12442 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.201122 12455 raft_consensus.cc:2749] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.202427 12442 leader_election.cc:304] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.203095 12541 raft_consensus.cc:2749] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.203312 12455 raft_consensus.cc:2749] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.204780 12442 leader_election.cc:304] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.205873 12455 raft_consensus.cc:2749] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.206827 12442 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.208182 12455 raft_consensus.cc:2749] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.208622 12442 leader_election.cc:304] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:50.229909 12455 raft_consensus.cc:2749] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.230257 12578 raft_consensus.cc:2749] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:50.246420 11664 consensus_peers.cc:597] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:50.254227 11664 consensus_peers.cc:597] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:50.586612 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09abbb280def4e0d95c1a6ba90635571" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:50.839679  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:42455
I20260709 12:24:50.839684 12611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:42455 every 8 connection(s)
I20260709 12:24:50.857373 12444 leader_election.cc:304] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.865566 12594 raft_consensus.cc:493] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.866585 12594 raft_consensus.cc:515] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:50.873309 12594 leader_election.cc:290] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:50.895308 12541 raft_consensus.cc:2749] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.896198 12541 raft_consensus.cc:493] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.896683 12541 raft_consensus.cc:515] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:50.900944 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:50.901734 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.903858 12541 leader_election.cc:290] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:50.921885 12551 raft_consensus.cc:493] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:50.922551 12551 raft_consensus.cc:515] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:50.925113 12551 leader_election.cc:290] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:50.928635 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.937786 12455 raft_consensus.cc:493] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.938066 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08646ea4ad114214a14c66377f11e4be" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:50.938531 12455 raft_consensus.cc:515] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:50.940271 12442 leader_election.cc:304] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.945039 12541 raft_consensus.cc:2749] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.952035 12455 leader_election.cc:290] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:50.976873 11766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.973564 12551 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:50.979571 12551 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:50.982151 12551 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:50.966425 12450 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:50.983975 12450 tablet_bootstrap.cc:492] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:50.984870 12450 ts_tablet_manager.cc:1403] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.969s	user 0.027s	sys 0.007s
I20260709 12:24:50.987500 12505 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 141a039ea83140368c7d19efb49a48bc)
I20260709 12:24:50.988318 12505 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:50.988612 12450 raft_consensus.cc:359] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:50.989439 12450 raft_consensus.cc:740] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.993247 12300 raft_consensus.cc:493] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:50.994722 12300 raft_consensus.cc:515] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:50.995023 12450 consensus_queue.cc:260] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:50.997237 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4131857eb24e4887659e33e75df237" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:50.998128 12450 ts_tablet_manager.cc:1434] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:24:50.999246 12442 leader_election.cc:304] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:50.999490 12505 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:51.000675 12578 raft_consensus.cc:2749] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:50.992750 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:50.993852 12575 raft_consensus.cc:493] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.007244 12575 raft_consensus.cc:515] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:51.010974 12575 leader_election.cc:290] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:51.017638 12300 leader_election.cc:290] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:51.003786 12520 raft_consensus.cc:493] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.018560 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.016892 12578 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.018427 12520 raft_consensus.cc:515] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:51.019882 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a78e8a37cdc46b2918da1716ded8a01" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.019852 12578 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:51.021399 12520 leader_election.cc:290] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:50.991492 12614 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.022132 12614 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.024289 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.024479 12614 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:51.025280 12450 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:51.026268 12505 raft_consensus.cc:493] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.026798 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.026820 12505 raft_consensus.cc:515] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:51.031752 11739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 68879.8us
I20260709 12:24:51.024317 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.032450 12505 leader_election.cc:290] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
W20260709 12:24:51.032985 11739 consensus_peers.cc:597] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.035107 12578 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:51.035565 12614 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.036147 12614 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.038509 12614 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
W20260709 12:24:51.033569 11739 consensus_peers.cc:597] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.046116 11697 raft_consensus.cc:1275] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.043998 11663 leader_election.cc:304] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.057984 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.064508 12444 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.044195 12614 raft_consensus.cc:493] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.072181 12567 raft_consensus.cc:493] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.073079 12567 raft_consensus.cc:515] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:51.079308 11700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.054270 12515 raft_consensus.cc:2749] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.068359 12578 raft_consensus.cc:2749] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.087393 12515 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.088212 12515 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:51.083055 12614 raft_consensus.cc:515] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.093519 12614 leader_election.cc:290] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:51.099624 11773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.099988 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.101594 12515 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:51.095541 11698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.106097 12567 leader_election.cc:290] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:51.111231 12540 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.113015 12540 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:51.125047 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.126214 11846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36360 (request call id 320) took 1065 ms. Trace:
I20260709 12:24:51.128455 11663 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.129391 12514 raft_consensus.cc:2749] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.138448 12419 raft_consensus.cc:493] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.139151 12419 raft_consensus.cc:515] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:51.126893 11846 rpcz_store.cc:276] 0709 12:24:50.060583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.062293 (+  1710us) service_pool.cc:224] Handling call
0709 12:24:50.078429 (+ 16136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.117599 (+ 39170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.120204 (+  2605us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.047245 (+927041us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b2c0007ad08. stack: 00007fdc4f8d4343 00007fdc4f8d4240 00007fdc4f2631d4 00007fdc58fa1304 00007fdc58fa1299 00007fdc512eca11 00007fdc512fc372 00007fdc52a2ea01 00007fdc529f343a 00007fdc529f283e 00007fdc579b7419 00007fdc50f2ebd4 00007fdc50f2eb62 00007fdc50f2ea91 00007fdc50f2ea0c 00007fdc50f2dcc2
0709 12:24:51.047719 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.125514 (+ 77795us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:51.125576 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.125683 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.125758 (+    75us) raft_consensus.cc:1685] finished
0709 12:24:51.125777 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.126090 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12026,"raft.queue_time_us":10843,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":23064,"spinlock_wait_cycles":3793280,"thread_start_us":77316,"threads_started":1,"wal-append.queue_time_us":70209}
I20260709 12:24:51.141691 12419 leader_election.cc:290] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:51.147751 12540 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
W20260709 12:24:51.148594 11740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 63962.5us
I20260709 12:24:51.150169 12528 consensus_queue.cc:1048] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.162811 11520 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36716 (request call id 106) took 1305 ms. Trace:
I20260709 12:24:51.175092 11842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e944029a644ed2a0dd77f44e800a3b" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.177964 11847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.180884 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.181833 11521 catalog_manager.cc:5697] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.184001 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.187294 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.187268 11521 catalog_manager.cc:5697] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.194772 12613 heartbeater.cc:344] Connected to a master server at 127.2.157.126:41099
I20260709 12:24:51.195322 12613 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:51.196349 12613 heartbeater.cc:507] Master 127.2.157.126:41099 requested a full tablet report, sending...
I20260709 12:24:51.199255 11521 catalog_manager.cc:5697] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.201480 11521 catalog_manager.cc:5697] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.203310 11521 catalog_manager.cc:5697] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:51.229092 11740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:41227, user_credentials={real_user=slave}} blocked reactor thread for 77265.6us
I20260709 12:24:51.168936 11520 rpcz_store.cc:276] 0709 12:24:49.857232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.867714 (+ 10482us) service_pool.cc:224] Handling call
0709 12:24:51.162719 (+1295005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:50.085552 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:50.086369 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:50.086427 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:24:50.086452 (+    25us) tablet.cc:662] Decoding operations
0709 12:24:50.087100 (+   648us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:50.087183 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:50.087225 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:50.087712 (+   487us) tablet.cc:701] Row locks acquired
0709 12:24:50.087754 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:24:50.087989 (+   235us) write_op.cc:270] Start()
0709 12:24:50.088149 (+   160us) write_op.cc:276] Timestamp: P: 1783599890087911 usec, L: 0
0709 12:24:50.088181 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:24:50.138795 (+ 50614us) log.cc:844] Serialized 922 byte log entry
0709 12:24:50.155174 (+ 16379us) op_driver.cc:464] REPLICATION: finished
0709 12:24:50.155685 (+   511us) write_op.cc:301] APPLY: starting
0709 12:24:50.155789 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:50.155935 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:50.156057 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:50.156485 (+   428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:50.156708 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:50.156761 (+    53us) write_op.cc:312] APPLY: finished
0709 12:24:50.157017 (+   256us) log.cc:844] Serialized 28 byte log entry
0709 12:24:50.157250 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.157359 (+   109us) write_op.cc:454] Released schema lock
0709 12:24:50.157409 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:50.157807 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.157838 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":284,"apply.run_cpu_time_us":2081,"apply.run_wall_time_us":2080,"num_ops":2,"prepare.queue_time_us":1531,"prepare.run_cpu_time_us":6939,"prepare.run_wall_time_us":62080,"replication_time_us":66850}]]}
I20260709 12:24:51.248370 11740 leader_election.cc:304] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
W20260709 12:24:51.290961 11721 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9be0 after lost signal to thread 2680
I20260709 12:24:51.289546 11740 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.285113 12534 raft_consensus.cc:2749] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.304121 12528 raft_consensus.cc:2749] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.326508 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa4b08c8ab84410da9b69d5236dc4c9e" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
W20260709 12:24:51.327620 11721 debug-util.cc:398] Leaking SignalData structure 0x7b08002af480 after lost signal to thread 11724
I20260709 12:24:51.311650 12578 raft_consensus.cc:493] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.334846 12450 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:51.343418 11740 leader_election.cc:304] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.347790 12447 raft_consensus.cc:2749] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.350570 12450 tablet_bootstrap.cc:492] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:51.354748 12517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.355129 12524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.361073 11766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bd851065052495d9905854dd7e0d1f8" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.362608 11767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:51.357136 12455 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.363425 12455 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:51.341208 12578 raft_consensus.cc:515] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:51.365701 12455 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:51.365942 12578 leader_election.cc:290] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:24:51.367810 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.368227 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.358892 12531 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.369616 12531 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:51.372095 12531 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:24:51.375864 12450 ts_tablet_manager.cc:1403] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.373s	user 0.019s	sys 0.006s
I20260709 12:24:51.384419 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
W20260709 12:24:51.385807 11721 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe2a0 after lost signal to thread 11798
W20260709 12:24:51.394011 11721 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae600 after lost signal to thread 11799
W20260709 12:24:51.397967 11721 debug-util.cc:398] Leaking SignalData structure 0x7b080034c540 after lost signal to thread 11873
I20260709 12:24:51.396410 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:51.409682 11848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.410171 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be73ed83804329a321f34cba74e33d" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.413233 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7553e005f3406698c40ed7d949f864" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.392145 12540 raft_consensus.cc:493] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed4262e8a41a45cebe0b2587d48e1135)
I20260709 12:24:51.416150 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.416631 12540 raft_consensus.cc:515] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:51.417112 12545 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 1.
I20260709 12:24:51.418118 12442 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.420534 12540 leader_election.cc:290] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:51.420629 12524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.422968 12578 raft_consensus.cc:2749] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.434551 11738 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.435547 12534 raft_consensus.cc:2749] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.439920 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135" is_pre_election: true
I20260709 12:24:51.440016 11518 ts_manager.cc:194] Re-registered known tserver with Master: a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455)
I20260709 12:24:51.441929 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.442739 12545 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 3.
I20260709 12:24:51.455092 12442 leader_election.cc:304] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.460485 12450 raft_consensus.cc:359] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:24:51.462071 12535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7089136bb8430a80f9cb95512704ad" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.463059 12524 raft_consensus.cc:3060] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.463382 12578 raft_consensus.cc:2749] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.467150 12517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff5912f7aa3418da40210943458bf43" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:51.477806 11813 consensus_peers.cc:597] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:51.482561 12450 raft_consensus.cc:740] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.493917 12450 consensus_queue.cc:260] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
W20260709 12:24:51.502674 11813 leader_election.cc:343] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.504663 11813 leader_election.cc:304] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.515054 12450 ts_tablet_manager.cc:1434] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.000s
W20260709 12:24:51.515865 11813 leader_election.cc:343] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.516598 11813 leader_election.cc:304] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.520838 12569 raft_consensus.cc:2749] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.521672 12450 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:51.516222 12520 raft_consensus.cc:2749] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.534199 12522 raft_consensus.cc:1275] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:51.539937 12522 raft_consensus.cc:3060] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.549883 12517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a473b2d6004593b4924bce2b7af51f" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.554214 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:51.584034 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224a9910fdc3406d86818fe98f0e8a0b" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
W20260709 12:24:51.597282 11664 leader_election.cc:343] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.598006 11664 leader_election.cc:304] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.599664 12514 raft_consensus.cc:2749] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.607925 11664 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:51.609278 12514 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:51.609818 12514 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.610296 12514 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:51.613842 11664 leader_election.cc:343] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.614549 11664 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.616104 11664 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:24:51.620851 12594 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:51.621338 12594 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:51.621716 12594 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.624697 12551 raft_consensus.cc:2749] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:51.646152 11739 consensus_peers.cc:597] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.673274 11739 consensus_peers.cc:597] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:51.674605 12531 consensus_queue.cc:1048] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:51.681598 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 43879.2us
W20260709 12:24:51.685822 11664 consensus_peers.cc:597] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:51.691232 11664 leader_election.cc:343] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.691783 11664 leader_election.cc:304] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.692929 12279 raft_consensus.cc:2749] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:51.693348 11664 leader_election.cc:343] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.693848 11664 leader_election.cc:304] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.694842 12300 raft_consensus.cc:2749] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:51.720114 11739 leader_election.cc:343] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.722899 11739 leader_election.cc:304] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.726123 12528 raft_consensus.cc:2749] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.738924 12450 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:51.740090 12450 tablet_bootstrap.cc:492] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:51.740824 12450 ts_tablet_manager.cc:1403] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.219s	user 0.029s	sys 0.005s
I20260709 12:24:51.742025 11739 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.744298 12490 raft_consensus.cc:2749] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:51.746738 11739 leader_election.cc:343] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.747239 11739 leader_election.cc:304] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40; no voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:24:51.750465 12450 raft_consensus.cc:359] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.751302 12450 raft_consensus.cc:740] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.752789 12490 raft_consensus.cc:2749] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.754771 12450 consensus_queue.cc:260] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.758028 12450 ts_tablet_manager.cc:1434] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:24:51.758919 12450 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:51.750927 12514 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.768692 12594 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.770911 12594 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 4 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:51.772133 12514 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:51.774729 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:51.777791 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
W20260709 12:24:51.799352 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:42455, user_credentials={real_user=slave}} blocked reactor thread for 72618.3us
I20260709 12:24:51.818440 12522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:51.819911 12524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:51.829309 11664 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.849304 11664 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc; no voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:51.855602 12426 raft_consensus.cc:2749] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.857478 11518 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57316
I20260709 12:24:51.865013 12613 heartbeater.cc:499] Master 127.2.157.126:41099 was elected leader, sending a full tablet report...
I20260709 12:24:51.873679 12426 raft_consensus.cc:2749] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.914819 11696 raft_consensus.cc:1240] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Rejecting Update request from peer 0fe4fa6e7e044fcd83efeafc9bea9c40 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:51.929952 12531 consensus_queue.cc:1059] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:51.931043 12540 raft_consensus.cc:3055] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:51.943516 12540 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:51.944751 12450 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:51.944463 12540 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:51.945822 12450 tablet_bootstrap.cc:492] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:51.945988 12540 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.946583 12450 ts_tablet_manager.cc:1403] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.006s
I20260709 12:24:51.958801 12450 raft_consensus.cc:359] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:51.959676 12450 raft_consensus.cc:740] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.963614 12450 consensus_queue.cc:260] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:51.973227 12524 raft_consensus.cc:3060] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.994479 12450 ts_tablet_manager.cc:1434] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:24:51.995995 12450 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.061218 11697 raft_consensus.cc:1240] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Rejecting Update request from peer 0fe4fa6e7e044fcd83efeafc9bea9c40 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:52.073184 12397 consensus_queue.cc:1059] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:52.081620 12397 raft_consensus.cc:3055] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.082053 12397 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:24:52.082846 12397 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.084175 12397 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.110023 12450 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.111315 12450 tablet_bootstrap.cc:492] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.112175 12450 ts_tablet_manager.cc:1403] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.009s
I20260709 12:24:52.116068 12450 raft_consensus.cc:359] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.116968 12450 raft_consensus.cc:740] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.117841 12450 consensus_queue.cc:260] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.122150 12450 ts_tablet_manager.cc:1434] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:24:52.124667 12450 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.157150 12450 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.158339 12450 tablet_bootstrap.cc:492] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.159066 12450 ts_tablet_manager.cc:1403] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.012s
I20260709 12:24:52.161950 12450 raft_consensus.cc:359] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.162655 12450 raft_consensus.cc:740] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.163508 12450 consensus_queue.cc:260] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.165896 12450 ts_tablet_manager.cc:1434] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:24:52.166801 12450 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.191601 12450 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.192663 12450 tablet_bootstrap.cc:492] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.193398 12450 ts_tablet_manager.cc:1403] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 12:24:52.196652 12450 raft_consensus.cc:359] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.197384 12450 raft_consensus.cc:740] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.198064 12450 consensus_queue.cc:260] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.200387 12450 ts_tablet_manager.cc:1434] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:52.201191 12450 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.240381 12450 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.241931 12450 tablet_bootstrap.cc:492] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.242743 12450 ts_tablet_manager.cc:1403] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.001s
I20260709 12:24:52.245816 12450 raft_consensus.cc:359] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.246642 12450 raft_consensus.cc:740] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.247484 12450 consensus_queue.cc:260] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.250186 12450 ts_tablet_manager.cc:1434] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:24:52.251050 12450 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.269191 12450 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.270339 12450 tablet_bootstrap.cc:492] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.271215 12450 ts_tablet_manager.cc:1403] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:24:52.274257 12450 raft_consensus.cc:359] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.275033 12450 raft_consensus.cc:740] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.275777 12450 consensus_queue.cc:260] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.278326 12450 ts_tablet_manager.cc:1434] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:52.279292 12450 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.306481 12450 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.307677 12450 tablet_bootstrap.cc:492] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.308107 12529 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.312517 12450 ts_tablet_manager.cc:1403] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.003s
I20260709 12:24:52.316071 12450 raft_consensus.cc:359] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.321034 12450 raft_consensus.cc:740] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.322496 12450 consensus_queue.cc:260] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.324712 12450 ts_tablet_manager.cc:1434] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:52.326220 12450 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.371953 12450 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.374127 12450 tablet_bootstrap.cc:492] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.374886 12450 ts_tablet_manager.cc:1403] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.001s
I20260709 12:24:52.379226 12450 raft_consensus.cc:359] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.380020 12450 raft_consensus.cc:740] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.380987 12450 consensus_queue.cc:260] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.385504 12450 ts_tablet_manager.cc:1434] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:24:52.386579 12450 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.454098 12513 raft_consensus.cc:3060] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.581180 12450 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.582273 12450 tablet_bootstrap.cc:492] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.583052 12450 ts_tablet_manager.cc:1403] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.197s	user 0.065s	sys 0.119s
I20260709 12:24:52.586143 12450 raft_consensus.cc:359] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.586895 12450 raft_consensus.cc:740] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.587884 12450 consensus_queue.cc:260] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.590250 12450 ts_tablet_manager.cc:1434] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:24:52.596482 12450 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.623313 12524 raft_consensus.cc:3060] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.625263 12450 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.626369 12450 tablet_bootstrap.cc:492] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.627107 12450 ts_tablet_manager.cc:1403] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.004s
I20260709 12:24:52.629963 12450 raft_consensus.cc:359] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.630753 12450 raft_consensus.cc:740] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.631567 12450 consensus_queue.cc:260] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.633116 12450 ts_tablet_manager.cc:1434] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:52.633927 12450 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.663013 12450 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.664108 12450 tablet_bootstrap.cc:492] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.664842 12450 ts_tablet_manager.cc:1403] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 12:24:52.667627 12450 raft_consensus.cc:359] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.668403 12450 raft_consensus.cc:740] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.669257 12450 consensus_queue.cc:260] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.671607 12450 ts_tablet_manager.cc:1434] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:52.672848 12450 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.697790 12450 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.684016 12524 raft_consensus.cc:3060] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.702941 12450 tablet_bootstrap.cc:492] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.705137 12450 ts_tablet_manager.cc:1403] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.006s
I20260709 12:24:52.708881 12450 raft_consensus.cc:359] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.709555 12450 raft_consensus.cc:740] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.711170 12450 consensus_queue.cc:260] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.713721 12450 ts_tablet_manager.cc:1434] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:52.717361 12450 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.742138 12450 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.743248 12450 tablet_bootstrap.cc:492] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.744076 12450 ts_tablet_manager.cc:1403] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.009s
I20260709 12:24:52.747468 12450 raft_consensus.cc:359] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.748200 12450 raft_consensus.cc:740] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.748935 12450 consensus_queue.cc:260] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:52.752666 12450 ts_tablet_manager.cc:1434] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:52.760442 12450 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.800800 12450 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.802040 12450 tablet_bootstrap.cc:492] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.802902 12450 ts_tablet_manager.cc:1403] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.020s
I20260709 12:24:52.806349 12450 raft_consensus.cc:359] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.813723 12450 raft_consensus.cc:740] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.814437 12450 consensus_queue.cc:260] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.817344 12450 ts_tablet_manager.cc:1434] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:52.818455 12450 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.861949 12450 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.863169 12450 tablet_bootstrap.cc:492] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.864030 12450 ts_tablet_manager.cc:1403] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.016s
I20260709 12:24:52.869661 12450 raft_consensus.cc:359] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.870548 12450 raft_consensus.cc:740] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.871318 12450 consensus_queue.cc:260] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:52.873404 12450 ts_tablet_manager.cc:1434] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:24:52.880431 12450 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:52.897375 12524 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.901078 12513 raft_consensus.cc:3060] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.909557 12529 raft_consensus.cc:3060] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:52.961011 11813 consensus_peers.cc:597] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:52.984525 12450 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:52.985721 12450 tablet_bootstrap.cc:492] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:52.986472 12450 ts_tablet_manager.cc:1403] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.014s
I20260709 12:24:52.989694 12450 raft_consensus.cc:359] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.990442 12450 raft_consensus.cc:740] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.991328 12450 consensus_queue.cc:260] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:52.994823 12450 ts_tablet_manager.cc:1434] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:24:52.995864 12450 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:53.018790 12450 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:53.019871 12450 tablet_bootstrap.cc:492] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:53.020624 12450 ts_tablet_manager.cc:1403] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 12:24:53.023284 12450 raft_consensus.cc:359] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:53.024019 12450 raft_consensus.cc:740] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:53.024724 12450 consensus_queue.cc:260] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:24:53.027045 12450 ts_tablet_manager.cc:1434] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:53.027961 12450 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:53.053081 12450 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:53.053885 12450 tablet_bootstrap.cc:492] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:53.054557 12450 ts_tablet_manager.cc:1403] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.005s
I20260709 12:24:53.056691 12450 raft_consensus.cc:359] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.057428 12450 raft_consensus.cc:740] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:53.058135 12450 consensus_queue.cc:260] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.060072 12450 ts_tablet_manager.cc:1434] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:24:53.060954 12450 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:53.085089 12450 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:53.086169 12450 tablet_bootstrap.cc:492] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:53.086935 12450 ts_tablet_manager.cc:1403] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:24:53.089797 12450 raft_consensus.cc:359] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:53.090525 12450 raft_consensus.cc:740] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:53.091275 12450 consensus_queue.cc:260] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:53.093684 12450 ts_tablet_manager.cc:1434] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:53.094262 12455 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:53.094602 12450 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:53.094923 12455 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.098434 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:53.098658 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:53.099171 11769 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 4.
I20260709 12:24:53.099563 11693 raft_consensus.cc:2393] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 4: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:53.102349 12442 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:53.102910 12455 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.103358 12684 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.103874 12684 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:53.104216 12684 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.110703 12529 raft_consensus.cc:3060] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.129866 12684 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.144799 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:53.146025 11693 raft_consensus.cc:2393] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 4: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:53.152441 12513 raft_consensus.cc:3060] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.202436 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:53.218923 11769 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 4.
I20260709 12:24:53.217648 12684 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.220719 12442 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:53.221968 12455 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:53.230262 12450 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:53.233683 12455 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:53.233922 12450 tablet_bootstrap.cc:492] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:53.235733 12450 ts_tablet_manager.cc:1403] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.141s	user 0.061s	sys 0.056s
I20260709 12:24:53.235263 12455 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.253728 12450 raft_consensus.cc:359] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.254550 12450 raft_consensus.cc:740] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:53.257575 12450 consensus_queue.cc:260] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.260841 12450 ts_tablet_manager.cc:1434] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:24:53.261781 12450 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap starting.
I20260709 12:24:53.292819 12450 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:53.293915 12450 tablet_bootstrap.cc:492] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Bootstrap complete.
I20260709 12:24:53.294652 12450 ts_tablet_manager.cc:1403] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.006s
I20260709 12:24:53.297539 12450 raft_consensus.cc:359] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:53.298686 12450 raft_consensus.cc:740] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Initialized, Role: FOLLOWER
I20260709 12:24:53.299612 12450 consensus_queue.cc:260] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:24:53.302500 12450 ts_tablet_manager.cc:1434] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:24:53.339926 11518 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 3 to 4, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 4 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.539142 12694 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:53.539757 12694 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.542783 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc" is_pre_election: true
I20260709 12:24:53.543330 12694 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.543708 11693 raft_consensus.cc:2393] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:53.544730 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:53.545341 11769 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:24:53.546630 12442 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:53.547531 12694 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:53.548032 12694 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0fe4fa6e7e044fcd83efeafc9bea9c40)
I20260709 12:24:53.548497 12694 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.554375 12514 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.555024 12514 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.558218 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:53.558305 12514 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.559214 11769 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 4.
I20260709 12:24:53.558198 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:53.561162 11663 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:24:53.563687 12514 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:53.564126 12514 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.564504 12514 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.565066 12694 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.570072 12694 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.570417 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:24:53.571095 11693 raft_consensus.cc:2393] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4cfb7e6c6a743fe80ee7917f0521805 in current term 2: Already voted for candidate 141a039ea83140368c7d19efb49a48bc in this term.
I20260709 12:24:53.572350 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:53.578979 12514 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.580221 11769 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:24:53.582585 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:53.582790 12442 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 141a039ea83140368c7d19efb49a48bc
I20260709 12:24:53.584323 12694 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:53.584914 12694 raft_consensus.cc:697] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:53.585987 12694 consensus_queue.cc:237] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.589529 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:53.590355 11774 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.618220 12514 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 5 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.619647 11518 catalog_manager.cc:5697] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.620414 11774 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 5.
I20260709 12:24:53.621986 11663 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:53.622861 12514 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.623623 12514 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:53.624850 12514 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.643810 11693 raft_consensus.cc:1240] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Rejecting Update request from peer a4cfb7e6c6a743fe80ee7917f0521805 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.646466 12694 consensus_queue.cc:1059] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:53.650908 11518 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 4 to 5, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 5 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.647547 12694 consensus_queue.cc:1243] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Peer 141a039ea83140368c7d19efb49a48bc log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:53.666276 12684 raft_consensus.cc:3055] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:53.666714 12684 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:53.667654 12684 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.668848 12684 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.770377 12514 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.771045 12514 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.773326 12514 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.775313 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" is_pre_election: true
I20260709 12:24:53.776065 11774 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 2.
I20260709 12:24:53.776587 12522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" is_pre_election: true
I20260709 12:24:53.779495 11663 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:53.780392 12657 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:53.780740 12657 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.781028 12657 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.794432 12657 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.799302 12657 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 election: Requested vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:24:53.801771 12522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
I20260709 12:24:53.802671 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "141a039ea83140368c7d19efb49a48bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:24:53.803323 11774 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.823998 11774 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 141a039ea83140368c7d19efb49a48bc in term 3.
I20260709 12:24:53.825117 11663 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:24:53.826346 12514 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:53.826882 12514 raft_consensus.cc:697] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Becoming Leader. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:24:53.827893 12514 consensus_queue.cc:237] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:53.844821 11518 catalog_manager.cc:5697] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc reported cstate change: term changed from 2 to 3, leader changed from a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65) to 141a039ea83140368c7d19efb49a48bc (127.2.157.66). New cstate: current_term: 3 leader_uuid: "141a039ea83140368c7d19efb49a48bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.023916 11693 raft_consensus.cc:1240] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Rejecting Update request from peer a4cfb7e6c6a743fe80ee7917f0521805 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:54.025629 12684 consensus_queue.cc:1059] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:54.026579 12684 consensus_queue.cc:1243] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Peer 141a039ea83140368c7d19efb49a48bc log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:54.028385 12694 raft_consensus.cc:3055] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:54.028847 12694 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:24:54.029850 12694 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:24:54.032996 12694 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:54.065608 12524 raft_consensus.cc:1275] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 5 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:54.066164 12524 pending_rounds.cc:85] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Aborting all ops after (but not including) 2
I20260709 12:24:54.066443 12524 pending_rounds.cc:107] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:54.066799 12524 raft_consensus.cc:2889] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:54.068562 12706 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:54.082815 11774 raft_consensus.cc:1275] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 5 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:54.086324 12594 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:54.284662 11769 raft_consensus.cc:1275] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:54.286028 12705 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:54.305655 12522 raft_consensus.cc:1275] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Refusing update from remote peer 141a039ea83140368c7d19efb49a48bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:54.306104 12522 pending_rounds.cc:85] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Aborting all ops after (but not including) 1
I20260709 12:24:54.306420 12522 pending_rounds.cc:107] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:54.306726 12522 raft_consensus.cc:2889] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:54.311061 12705 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:00.875030  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.942615 11697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:00.943645 11697 raft_consensus.cc:606] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:00.959203 11769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:00.959939 11769 raft_consensus.cc:606] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:00.963382 11769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:00.964109 11769 raft_consensus.cc:606] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:00.967295 11769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:00.967870 11769 raft_consensus.cc:606] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:00.982532 11841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3"
dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
mode: GRACEFUL
new_leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
 from {username='slave'} at 127.0.0.1:58630
I20260709 12:25:00.983145 11841 raft_consensus.cc:606] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Received request to transfer leadership to TS 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:25:00.986176 11769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:00.986807 11769 raft_consensus.cc:606] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:00.988143  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:00.989753  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.990792  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.061252 12720 raft_consensus.cc:993] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.061966 12731 raft_consensus.cc:1081] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.064043 12513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:01.064759 12513 raft_consensus.cc:493] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.065404 12513 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.073596 12513 raft_consensus.cc:515] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.075745 12513 leader_election.cc:290] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:01.076666 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:01.077085 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a366e09e3a54815b5bb446e20e8bf08" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:01.077406 11697 raft_consensus.cc:3055] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.077751 11697 raft_consensus.cc:740] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:01.077773 11769 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.078812 11697 consensus_queue.cc:260] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.079922 11697 raft_consensus.cc:3060] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.084313 11769 raft_consensus.cc:2468] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.085927 12442 leader_election.cc:304] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:01.086295 11697 raft_consensus.cc:2468] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.088526 12737 raft_consensus.cc:2804] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.093463 12737 raft_consensus.cc:697] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:01.094664 12737 consensus_queue.cc:237] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.106894 11519 catalog_manager.cc:5697] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.129874 12717 raft_consensus.cc:993] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.130560 12528 raft_consensus.cc:1081] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.132503 12529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:01.133124 12529 raft_consensus.cc:493] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.133459 12529 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.141330 12529 raft_consensus.cc:515] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.150164 12529 leader_election.cc:290] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:01.150970 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:01.151697 11697 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.152230 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd102418f4a969650594d69177b7f" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:01.152842 11769 raft_consensus.cc:3055] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.153134 11769 raft_consensus.cc:740] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:01.153921 11769 consensus_queue.cc:260] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.155347 11769 raft_consensus.cc:3060] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.159724 11697 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 3.
I20260709 12:25:01.161126 12444 leader_election.cc:304] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:01.163683 11769 raft_consensus.cc:2468] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 3.
I20260709 12:25:01.164902 12737 raft_consensus.cc:2804] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.165858 12737 raft_consensus.cc:697] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:01.168128 12737 consensus_queue.cc:237] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.183594 11519 catalog_manager.cc:5697] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 2 to 3, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 3 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.335376 12744 raft_consensus.cc:993] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.335955 12528 raft_consensus.cc:1081] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.337574 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:01.338081 12522 raft_consensus.cc:493] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.338363 12522 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.346014 12522 raft_consensus.cc:515] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.347875 12522 leader_election.cc:290] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:01.349040 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:01.349424 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb28e8992c4572b48c7a6e40155938" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:01.349802 11697 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.350133 11769 raft_consensus.cc:3055] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.350456 11769 raft_consensus.cc:740] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:01.351171 11769 consensus_queue.cc:260] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.352191 11769 raft_consensus.cc:3060] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.356458 11697 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 3.
I20260709 12:25:01.358027 12444 leader_election.cc:304] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:01.359114 12737 raft_consensus.cc:2804] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.359658 11769 raft_consensus.cc:2468] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 3.
I20260709 12:25:01.359705 12737 raft_consensus.cc:697] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:01.362025 12737 consensus_queue.cc:237] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:01.374042 11519 catalog_manager.cc:5697] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 2 to 3, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 3 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.386898 12735 raft_consensus.cc:993] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: : Instructing follower 0fe4fa6e7e044fcd83efeafc9bea9c40 to start an election
I20260709 12:25:01.387679 12721 raft_consensus.cc:1081] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Signalling peer 0fe4fa6e7e044fcd83efeafc9bea9c40 to start an election
I20260709 12:25:01.389818 11769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
 from {username='slave'} at 127.0.0.1:44252
I20260709 12:25:01.390467 11769 raft_consensus.cc:493] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.391316 11769 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.398119 11769 raft_consensus.cc:515] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:01.400256 11769 leader_election.cc:290] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:01.401014 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:01.401626 11697 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.402132 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b742388171e940eabb3e896f3946f3c3" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:01.402654 11846 raft_consensus.cc:3055] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.402963 11846 raft_consensus.cc:740] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:25:01.404034 11846 consensus_queue.cc:260] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:01.405519 11846 raft_consensus.cc:3060] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.408349 11697 raft_consensus.cc:2468] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:25:01.409883 11740 leader_election.cc:304] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, 141a039ea83140368c7d19efb49a48bc; no voters: 
I20260709 12:25:01.410830 12744 raft_consensus.cc:2804] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.411329 12744 raft_consensus.cc:697] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:01.412256 12744 consensus_queue.cc:237] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:01.414043 11846 raft_consensus.cc:2468] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:25:01.418337 12717 raft_consensus.cc:993] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.418792 12717 raft_consensus.cc:1081] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.425961 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:01.426260 12717 raft_consensus.cc:993] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.426610 12522 raft_consensus.cc:493] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.426759 12717 raft_consensus.cc:1081] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:01.427026 12522 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.429497 12513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:01.430099 12513 raft_consensus.cc:493] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.430492 12513 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.430635 11519 catalog_manager.cc:5697] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.438309 12522 raft_consensus.cc:515] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.441246 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:01.441861 11769 raft_consensus.cc:3055] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.442175 11769 raft_consensus.cc:740] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:01.442346 12522 leader_election.cc:290] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:01.443284 11769 consensus_queue.cc:260] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.444645 11769 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.447221 12513 raft_consensus.cc:515] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.443590 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f52aa43c6f4920af39015011c44a84" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:01.448321 11846 raft_consensus.cc:3060] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.450371 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:01.451078 11774 raft_consensus.cc:3055] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.451524 11774 raft_consensus.cc:740] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:01.452451 11774 consensus_queue.cc:260] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.461089 11774 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.467163 11846 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.468722 12442 leader_election.cc:304] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:01.470113 12737 raft_consensus.cc:2804] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.470621 12737 raft_consensus.cc:697] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:01.471626 12737 consensus_queue.cc:237] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.477523 11769 raft_consensus.cc:2468] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.484536 12513 leader_election.cc:290] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:01.488629 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ec9bad6eb04d448bbfb563a7675db2" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:01.489300 11846 raft_consensus.cc:3060] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.493952 11774 raft_consensus.cc:2468] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.495478 12442 leader_election.cc:304] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:01.496469 12737 raft_consensus.cc:2804] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.496976 12737 raft_consensus.cc:697] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:01.497707 11846 raft_consensus.cc:2468] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:01.497918 12737 consensus_queue.cc:237] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:01.503281 11770 raft_consensus.cc:1275] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.505424 12738 consensus_queue.cc:1048] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:01.510951 11519 catalog_manager.cc:5697] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.555972 11518 catalog_manager.cc:5697] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.566229 11697 raft_consensus.cc:1275] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.568346 12738 consensus_queue.cc:1048] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.730157 11770 raft_consensus.cc:1275] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.731180 11693 raft_consensus.cc:1275] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.731582 12737 consensus_queue.cc:1048] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.732677 12738 consensus_queue.cc:1048] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.821350 11697 raft_consensus.cc:1275] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.822686 12717 consensus_queue.cc:1048] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.844151 11841 raft_consensus.cc:1275] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.845732 12528 consensus_queue.cc:1048] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.851599 11770 raft_consensus.cc:1275] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.853235 12737 consensus_queue.cc:1048] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:01.873880 11774 raft_consensus.cc:1275] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.879824 11697 raft_consensus.cc:1275] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.881295 12737 consensus_queue.cc:1048] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:01.882113 12760 consensus_queue.cc:1048] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:01.908084 11846 raft_consensus.cc:1275] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.910619 12751 consensus_queue.cc:1048] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:01.938467 11774 raft_consensus.cc:1275] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.940038 12751 consensus_queue.cc:1048] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.951889 11846 raft_consensus.cc:1275] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.956147 12738 consensus_queue.cc:1048] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:02.030347  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.078028 11770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:02.078716 11770 raft_consensus.cc:606] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:02.082446 11697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:02.083037 11697 raft_consensus.cc:606] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:02.085827 11697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:02.086408 11697 raft_consensus.cc:606] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS 0fe4fa6e7e044fcd83efeafc9bea9c40
I20260709 12:25:02.089067 11697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:02.089633 11697 raft_consensus.cc:606] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:02.092689 11697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:02.093426 11697 raft_consensus.cc:606] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Received request to transfer leadership to TS ed4262e8a41a45cebe0b2587d48e1135
I20260709 12:25:02.099682  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:02.101483 12528 raft_consensus.cc:993] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.101635  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.102042 12528 raft_consensus.cc:1081] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.102587  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.104382 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:02.105268 12522 raft_consensus.cc:493] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.105739 12522 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.111794 12522 raft_consensus.cc:515] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.114496 12522 leader_election.cc:290] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:02.114413 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:02.117292 11770 raft_consensus.cc:3055] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:02.117234 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d00c475c524bf09cb644cdbd0d6765" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:02.117769 11770 raft_consensus.cc:740] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:02.118045 11846 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.119028 11770 consensus_queue.cc:260] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.120692 11770 raft_consensus.cc:3060] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.126644 11846 raft_consensus.cc:2468] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.128000 12442 leader_election.cc:304] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:02.128885 12760 raft_consensus.cc:2804] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:02.129366 12760 raft_consensus.cc:697] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:02.130218 12760 consensus_queue.cc:237] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.133432 11770 raft_consensus.cc:2468] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.144536 11519 catalog_manager.cc:5697] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.171366 12720 raft_consensus.cc:993] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: : Instructing follower 0fe4fa6e7e044fcd83efeafc9bea9c40 to start an election
I20260709 12:25:02.171984 12766 raft_consensus.cc:1081] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer 0fe4fa6e7e044fcd83efeafc9bea9c40 to start an election
I20260709 12:25:02.173455 11770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
 from {username='slave'} at 127.0.0.1:44266
I20260709 12:25:02.173997 11770 raft_consensus.cc:493] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.174328 11770 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.180639 12747 raft_consensus.cc:993] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.181278 12766 raft_consensus.cc:1081] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.182673 11770 raft_consensus.cc:515] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.183022 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:02.183830 12522 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.184178 12522 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.184971 11770 leader_election.cc:290] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:02.185639 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:02.186467 11697 raft_consensus.cc:3055] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:02.186606 11841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8272e93c7c9c428d9d914614986ff95d" candidate_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:02.186976 11697 raft_consensus.cc:740] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:02.187278 11841 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.187834 11697 consensus_queue.cc:260] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.188928 11697 raft_consensus.cc:3060] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.193007 12522 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:02.194543 11841 raft_consensus.cc:2468] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:25:02.196877 11738 leader_election.cc:304] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:02.197840 12762 raft_consensus.cc:2804] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:02.197739 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:02.198544 12762 raft_consensus.cc:697] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Becoming Leader. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:02.198582 11846 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.199240 11697 raft_consensus.cc:2468] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fe4fa6e7e044fcd83efeafc9bea9c40 in term 2.
I20260709 12:25:02.199674 12762 consensus_queue.cc:237] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.201045 12522 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:25:02.208849 11697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efa13ea53b04377b4e94d50ebd901c5" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:02.209625 11697 raft_consensus.cc:3055] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:02.209949 11697 raft_consensus.cc:740] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:02.212594 11697 consensus_queue.cc:260] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:02.213961 11697 raft_consensus.cc:3060] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.215823 11846 raft_consensus.cc:2468] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.217530 12442 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:02.218755 12760 raft_consensus.cc:2804] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:02.219336 12760 raft_consensus.cc:697] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:02.222488 12760 consensus_queue.cc:237] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:02.226737 11697 raft_consensus.cc:2468] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.236979 11519 catalog_manager.cc:5697] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.242832 11518 catalog_manager.cc:5697] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.367926 12720 raft_consensus.cc:993] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.368503 12766 raft_consensus.cc:1081] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:02.370496 12524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:02.371101 12524 raft_consensus.cc:493] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.371645 12524 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.377813 12524 raft_consensus.cc:515] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:02.379791 12524 leader_election.cc:290] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:02.380831 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:02.381875 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b59f3bf0bd4720a292c993753e9535" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:02.382638 11693 raft_consensus.cc:3055] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:02.382753 11770 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.383090 11693 raft_consensus.cc:740] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:02.384207 11693 consensus_queue.cc:260] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:02.385553 11693 raft_consensus.cc:3060] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:02.391233 11770 raft_consensus.cc:2468] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.392683 12442 leader_election.cc:304] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:02.393204 11693 raft_consensus.cc:2468] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:02.393623 12737 raft_consensus.cc:2804] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:02.394270 12737 raft_consensus.cc:697] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:02.395293 12737 consensus_queue.cc:237] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:02.405305 11518 catalog_manager.cc:5697] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.507859 12720 raft_consensus.cc:993] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower ed4262e8a41a45cebe0b2587d48e1135 to start an election
I20260709 12:25:02.508426 12766 raft_consensus.cc:1081] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Signalling peer ed4262e8a41a45cebe0b2587d48e1135 to start an election
I20260709 12:25:02.510246 11846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966"
dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
 from {username='slave'} at 127.0.0.1:36360
I20260709 12:25:02.510876 11846 raft_consensus.cc:493] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:02.511341 11846 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.517625 11846 raft_consensus.cc:515] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.520203 11846 leader_election.cc:290] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:02.520910 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:02.521643 11693 raft_consensus.cc:3055] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:02.521968 11693 raft_consensus.cc:740] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:02.522811 11693 consensus_queue.cc:260] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.524040 11693 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.528113 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8a60b4de2d84722b898bd80d5fed966" candidate_uuid: "ed4262e8a41a45cebe0b2587d48e1135" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:02.528857 11774 raft_consensus.cc:3060] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.534438 11693 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 3.
I20260709 12:25:02.535970 11774 raft_consensus.cc:2468] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed4262e8a41a45cebe0b2587d48e1135 in term 3.
I20260709 12:25:02.536036 11814 leader_election.cc:304] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:02.537882 12735 raft_consensus.cc:2804] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:02.538401 12735 raft_consensus.cc:697] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 3 LEADER]: Becoming Leader. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:25:02.539353 12735 consensus_queue.cc:237] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } }
I20260709 12:25:02.558977 11519 catalog_manager.cc:5697] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 reported cstate change: term changed from 2 to 3, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68). New cstate: current_term: 3 leader_uuid: "ed4262e8a41a45cebe0b2587d48e1135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:02.604846 11774 raft_consensus.cc:1275] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.606261 12737 consensus_queue.cc:1048] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.629988 11846 raft_consensus.cc:1275] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.646695 12738 consensus_queue.cc:1048] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.659497 11693 raft_consensus.cc:1275] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.664433 12717 consensus_queue.cc:1048] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.684222 11841 raft_consensus.cc:1275] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer 0fe4fa6e7e044fcd83efeafc9bea9c40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.687098 12762 consensus_queue.cc:1048] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:02.723780 11693 raft_consensus.cc:1275] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.724825 11846 raft_consensus.cc:1275] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.726429 12737 consensus_queue.cc:1048] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:02.727964 12760 consensus_queue.cc:1048] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.856042 11774 raft_consensus.cc:1275] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.857405 12760 consensus_queue.cc:1048] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.869810 11693 raft_consensus.cc:1275] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.871778 12760 consensus_queue.cc:1048] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:25:02.971843 11774 raft_consensus.cc:1275] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Refusing update from remote peer ed4262e8a41a45cebe0b2587d48e1135: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:02.973254 12790 consensus_queue.cc:1048] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.989207 11693 raft_consensus.cc:1275] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Refusing update from remote peer ed4262e8a41a45cebe0b2587d48e1135: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:02.992524 12779 consensus_queue.cc:1048] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:03.167695  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.210178 11693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:03.210767 11693 raft_consensus.cc:606] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.214427 11846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346"
dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58630
I20260709 12:25:03.215111 11846 raft_consensus.cc:606] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.218058 11693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97353355e64b4a2baa32282604facc78"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:03.218681 11693 raft_consensus.cc:606] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.223287 11696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:03.223927 11696 raft_consensus.cc:606] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.226805 11770 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ec367784484300bff9019d060541ca"
dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:41876
I20260709 12:25:03.227398 11770 raft_consensus.cc:606] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.228866 12720 raft_consensus.cc:993] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.229911 12720 raft_consensus.cc:1081] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.231022 11696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee"
dest_uuid: "141a039ea83140368c7d19efb49a48bc"
mode: GRACEFUL
new_leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:51992
I20260709 12:25:03.231704 11696 raft_consensus.cc:606] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Received request to transfer leadership to TS a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:03.231613 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:03.232424 12522 raft_consensus.cc:493] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.232800 12522 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.233604  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:03.235635  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.236747  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.245239 12522 raft_consensus.cc:515] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.248040 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:03.248396 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48afc51fa9e34dc0a796be2dcaf58501" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:03.248617 11693 raft_consensus.cc:3055] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:03.249029 11770 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.249068 11693 raft_consensus.cc:740] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:03.252470 11693 consensus_queue.cc:260] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.253376 11693 raft_consensus.cc:3060] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.257400 11770 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 4.
I20260709 12:25:03.258646 12442 leader_election.cc:304] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:03.259542 12760 raft_consensus.cc:2804] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:03.260134 12760 raft_consensus.cc:697] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.262696 12760 consensus_queue.cc:237] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.267494 12522 leader_election.cc:290] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 4 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:03.268639 11693 raft_consensus.cc:2468] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 4.
I20260709 12:25:03.286278 11519 catalog_manager.cc:5697] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 3 to 4, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 4 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.320456 12720 raft_consensus.cc:993] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.320941 12720 raft_consensus.cc:1081] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.322460 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97353355e64b4a2baa32282604facc78"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:03.323021 12522 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.323344 12522 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.328792 12522 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:03.330574 12522 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:25:03.331354 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:03.331701 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97353355e64b4a2baa32282604facc78" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:03.332010 11846 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.332340 11696 raft_consensus.cc:3055] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:03.332659 11696 raft_consensus.cc:740] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:03.333338 11696 consensus_queue.cc:260] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:03.334339 11696 raft_consensus.cc:3060] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.338071 11846 raft_consensus.cc:2468] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.339341 12442 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4cfb7e6c6a743fe80ee7917f0521805, ed4262e8a41a45cebe0b2587d48e1135; no voters: 
I20260709 12:25:03.340214 11696 raft_consensus.cc:2468] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.340233 12760 raft_consensus.cc:2804] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:03.341053 12760 raft_consensus.cc:697] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.342056 12760 consensus_queue.cc:237] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:03.356087 11519 catalog_manager.cc:5697] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.481782 12766 raft_consensus.cc:993] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.483251 12766 raft_consensus.cc:1081] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.485102 12735 raft_consensus.cc:993] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.485800 12790 raft_consensus.cc:1081] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.486413 12529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:03.487169 12529 raft_consensus.cc:493] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.487632 12524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58228
I20260709 12:25:03.487681 12529 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.488283 12524 raft_consensus.cc:493] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.488669 12524 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.496194 12524 raft_consensus.cc:515] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:03.496385 12529 raft_consensus.cc:515] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.498101 12529 leader_election.cc:290] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:03.498143 12524 leader_election.cc:290] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587), ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68:43831)
I20260709 12:25:03.499495 11846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed4262e8a41a45cebe0b2587d48e1135"
I20260709 12:25:03.500072 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c50f3c984bc40b78d55050ae3394346" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:03.500675 11774 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.503975 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:03.504595 11770 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.507208 11774 raft_consensus.cc:2468] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.499571 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feb74090705a402e9f360b6e9a2dfbee" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:03.508203 11693 raft_consensus.cc:3055] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:03.508472 11693 raft_consensus.cc:740] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:03.508538 12442 leader_election.cc:304] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:03.509658 12738 raft_consensus.cc:2804] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:03.509361 11693 consensus_queue.cc:260] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.510203 12738 raft_consensus.cc:697] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.510744 11693 raft_consensus.cc:3060] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.511668 11770 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.511224 12738 consensus_queue.cc:237] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:03.500128 11846 raft_consensus.cc:3055] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:03.512945 11846 raft_consensus.cc:740] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed4262e8a41a45cebe0b2587d48e1135, State: Running, Role: LEADER
I20260709 12:25:03.513633 11846 consensus_queue.cc:260] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } }
I20260709 12:25:03.513945 12442 leader_election.cc:304] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe4fa6e7e044fcd83efeafc9bea9c40, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:03.514767 12804 raft_consensus.cc:2804] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:03.515369 12804 raft_consensus.cc:697] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.516732 12804 consensus_queue.cc:237] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.522449 11693 raft_consensus.cc:2468] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.514873 11846 raft_consensus.cc:3060] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.529050 11846 raft_consensus.cc:2468] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.536137 11519 catalog_manager.cc:5697] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from ed4262e8a41a45cebe0b2587d48e1135 (127.2.157.68) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.554251 11519 catalog_manager.cc:5697] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.640245 12717 raft_consensus.cc:993] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.640825 12528 raft_consensus.cc:1081] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.642647 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ec367784484300bff9019d060541ca"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58238
I20260709 12:25:03.643291 12522 raft_consensus.cc:493] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.643651 12522 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.652170 12522 raft_consensus.cc:515] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.654018 12522 leader_election.cc:290] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:03.655053 11693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:03.655074 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ec367784484300bff9019d060541ca" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:03.656036 11693 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.656085 11774 raft_consensus.cc:3055] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:03.656613 11774 raft_consensus.cc:740] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0fe4fa6e7e044fcd83efeafc9bea9c40, State: Running, Role: LEADER
I20260709 12:25:03.657522 11774 consensus_queue.cc:260] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.658993 11774 raft_consensus.cc:3060] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:03.666034 11693 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.666723 11774 raft_consensus.cc:2468] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 2.
I20260709 12:25:03.667531 12444 leader_election.cc:304] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:03.668480 12738 raft_consensus.cc:2804] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:03.669809 12738 raft_consensus.cc:697] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.670868 12738 consensus_queue.cc:237] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.680929 11770 raft_consensus.cc:1275] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:03.682204 11519 catalog_manager.cc:5697] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 1 to 2, leader changed from 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.685001 12766 raft_consensus.cc:993] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: : Instructing follower a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.685562 12797 raft_consensus.cc:1081] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Signalling peer a4cfb7e6c6a743fe80ee7917f0521805 to start an election
I20260709 12:25:03.684465 12738 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.687530 12522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60"
dest_uuid: "a4cfb7e6c6a743fe80ee7917f0521805"
 from {username='slave'} at 127.0.0.1:58254
I20260709 12:25:03.688130 12522 raft_consensus.cc:493] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.688483 12522 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.703115 12522 raft_consensus.cc:515] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.708515 11693 raft_consensus.cc:1275] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:03.710520 11696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "141a039ea83140368c7d19efb49a48bc"
I20260709 12:25:03.710738 12522 leader_election.cc:290] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 6 election: Requested vote from peers 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227), 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587)
I20260709 12:25:03.712282 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e90b4bac88844df4a5d19f0f05135c60" candidate_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40"
I20260709 12:25:03.712919 11774 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.711234 11696 raft_consensus.cc:3055] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.714351 11696 raft_consensus.cc:740] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 141a039ea83140368c7d19efb49a48bc, State: Running, Role: LEADER
I20260709 12:25:03.715157 11696 consensus_queue.cc:260] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.716359 11696 raft_consensus.cc:3060] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.716809 12738 consensus_queue.cc:1048] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.725493 11696 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 6.
I20260709 12:25:03.726032 11774 raft_consensus.cc:2468] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4cfb7e6c6a743fe80ee7917f0521805 in term 6.
I20260709 12:25:03.727229 12444 leader_election.cc:304] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805; no voters: 
I20260709 12:25:03.729017 12738 raft_consensus.cc:2804] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:03.731142 12738 raft_consensus.cc:697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 6 LEADER]: Becoming Leader. State: Replica: a4cfb7e6c6a743fe80ee7917f0521805, State: Running, Role: LEADER
I20260709 12:25:03.733340 11697 raft_consensus.cc:1275] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:03.736351 12804 consensus_queue.cc:1048] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:03.732308 12738 consensus_queue.cc:237] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } }
I20260709 12:25:03.763486 11846 raft_consensus.cc:1275] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:03.766551 12805 consensus_queue.cc:1048] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:03.776417 11518 catalog_manager.cc:5697] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 reported cstate change: term changed from 5 to 6, leader changed from 141a039ea83140368c7d19efb49a48bc (127.2.157.66) to a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65). New cstate: current_term: 6 leader_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:03.963318 11693 raft_consensus.cc:1275] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:03.964716 12805 consensus_queue.cc:1048] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:03.973282 11774 raft_consensus.cc:1275] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:03.974977 12805 consensus_queue.cc:1048] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.076910 11774 raft_consensus.cc:1275] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:04.078284 12805 consensus_queue.cc:1048] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.085276 11846 raft_consensus.cc:1275] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:04.086957 12805 consensus_queue.cc:1048] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.146580 11696 raft_consensus.cc:1275] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:04.148056 12805 consensus_queue.cc:1048] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.158560 11774 raft_consensus.cc:1275] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:04.160761 12760 consensus_queue.cc:1048] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:04.259361 11774 raft_consensus.cc:1275] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 6 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:04.261176 12805 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe4fa6e7e044fcd83efeafc9bea9c40" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:04.274051 11693 raft_consensus.cc:1275] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 6 FOLLOWER]: Refusing update from remote peer a4cfb7e6c6a743fe80ee7917f0521805: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:04.275630 12738 consensus_queue.cc:1048] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [LEADER]: Connected to new peer: Peer: permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:04.304375  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.343019  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.344357  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.344974  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.388674  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.433632  2677 tablet_server.cc:179] TabletServer@127.2.157.65:42455 shutting down...
W20260709 12:25:04.436527 11739 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 265 similar messages]
W20260709 12:25:04.445919 11739 consensus_peers.cc:597] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.453817 11739 consensus_peers.cc:597] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.464953 11739 consensus_peers.cc:597] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.465647 11739 consensus_peers.cc:597] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.466233 11739 consensus_peers.cc:597] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.471347 11813 consensus_peers.cc:597] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.475544 11813 consensus_peers.cc:597] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.478047 11664 consensus_peers.cc:597] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.489564 11664 consensus_peers.cc:597] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.491952 11664 consensus_peers.cc:597] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.498049 11739 consensus_peers.cc:597] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.503635  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:04.504593  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.505489  2677 raft_consensus.cc:2243] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.506021  2677 raft_consensus.cc:2272] T 07a473b2d6004593b4924bce2b7af51f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.508646  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.509361  2677 raft_consensus.cc:2243] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.510180  2677 raft_consensus.cc:2272] T d6b59f3bf0bd4720a292c993753e9535 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.512959  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.513007 11664 consensus_peers.cc:597] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.513736  2677 raft_consensus.cc:2243] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.514257  2677 raft_consensus.cc:2272] T 4c7089136bb8430a80f9cb95512704ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.516513  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.517204  2677 raft_consensus.cc:2243] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.517634  2677 raft_consensus.cc:2272] T 891213c70e5a40d085c955386f620b0f P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.519968  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.520825  2677 raft_consensus.cc:2243] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.521435  2677 raft_consensus.cc:2272] T 04157ec411b241028d32c3555200ab43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.524412  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.525223  2677 raft_consensus.cc:2243] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.525970  2677 raft_consensus.cc:2272] T 99eb28e8992c4572b48c7a6e40155938 P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.528472  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.529209  2677 raft_consensus.cc:2243] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.530158  2677 raft_consensus.cc:2272] T 43ec9bad6eb04d448bbfb563a7675db2 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.532578  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.533488  2677 raft_consensus.cc:2243] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.534468  2677 raft_consensus.cc:2272] T f2ec367784484300bff9019d060541ca P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.534740 11813 consensus_peers.cc:597] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.540024 11664 consensus_peers.cc:597] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.546418  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.547333 11664 consensus_peers.cc:597] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.547431  2677 raft_consensus.cc:2243] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.548300  2677 raft_consensus.cc:2272] T 910c074d754749b9b864ab7017c2a8db P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.550658  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.551483  2677 raft_consensus.cc:2243] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.552038  2677 raft_consensus.cc:2272] T 91a124cf3dea44f39e82b7b9a5e9d64f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.555066  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.555027 11664 consensus_peers.cc:597] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.556126  2677 raft_consensus.cc:2243] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.556625  2677 raft_consensus.cc:2272] T 9b7553e005f3406698c40ed7d949f864 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.558960  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.559700  2677 raft_consensus.cc:2243] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.560108  2677 raft_consensus.cc:2272] T fea76dbfd7d0485ab14a3eedef8a4ff1 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.562325  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.562964  2677 raft_consensus.cc:2243] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.563395  2677 raft_consensus.cc:2272] T cad92fece50d444cb8e4841eb7f23518 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.565541  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.566148  2677 raft_consensus.cc:2243] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.566941  2677 raft_consensus.cc:2272] T 9a7dd102418f4a969650594d69177b7f P a4cfb7e6c6a743fe80ee7917f0521805 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.569357  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.570182  2677 raft_consensus.cc:2243] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.571177  2677 raft_consensus.cc:2272] T e90b4bac88844df4a5d19f0f05135c60 P a4cfb7e6c6a743fe80ee7917f0521805 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.574049  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.574883  2677 raft_consensus.cc:2243] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.575908  2677 raft_consensus.cc:2272] T 40d00c475c524bf09cb644cdbd0d6765 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.578910  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.579759  2677 raft_consensus.cc:2243] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.580205  2677 raft_consensus.cc:2272] T 22be73ed83804329a321f34cba74e33d P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.582405  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.583104  2677 raft_consensus.cc:2243] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.583630  2677 raft_consensus.cc:2272] T 3bd851065052495d9905854dd7e0d1f8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.586196  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.586939  2677 raft_consensus.cc:2243] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.587420  2677 raft_consensus.cc:2272] T ea4131857eb24e4887659e33e75df237 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.590833  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.591677  2677 raft_consensus.cc:2243] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.592645  2677 raft_consensus.cc:2272] T feb74090705a402e9f360b6e9a2dfbee P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.595573  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.596213  2677 raft_consensus.cc:2243] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.597018  2677 raft_consensus.cc:2272] T 4efa13ea53b04377b4e94d50ebd901c5 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.599305  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.599958  2677 raft_consensus.cc:2243] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.600436  2677 raft_consensus.cc:2272] T bb409dacde4a45fd956e729c49b4a978 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.603209  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.603978  2677 raft_consensus.cc:2243] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.604344  2677 raft_consensus.cc:2272] T 58e3e708e6c145bc81691e6cbd7eb0a6 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.606488  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.607333  2677 raft_consensus.cc:2243] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.607862  2677 raft_consensus.cc:2272] T 28755e05e0c142a8a2e116e1c788f197 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.610612  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.611395  2677 raft_consensus.cc:2243] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.612234  2677 raft_consensus.cc:2272] T 7c50f3c984bc40b78d55050ae3394346 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.614882  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.615599  2677 raft_consensus.cc:2243] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.616053  2677 raft_consensus.cc:2272] T b6631247217f4eb9b8113265bfd7ef14 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.618438  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.619230  2677 raft_consensus.cc:2243] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.619746  2677 raft_consensus.cc:2272] T f67d4fdb6dd444feae249f74e1ac29bc P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.622476  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.623173  2677 raft_consensus.cc:2243] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.623639  2677 raft_consensus.cc:2272] T 09abbb280def4e0d95c1a6ba90635571 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.625922  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.626554  2677 raft_consensus.cc:2243] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.627571  2677 raft_consensus.cc:2272] T c8f52aa43c6f4920af39015011c44a84 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.630671  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.631537  2677 raft_consensus.cc:2243] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:04.632208 11813 consensus_peers.cc:597] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.632539  2677 raft_consensus.cc:2272] T 2a366e09e3a54815b5bb446e20e8bf08 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.635310  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.636183  2677 raft_consensus.cc:2243] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.636701  2677 raft_consensus.cc:2272] T 3bf7dd33493f4ea39e190ab6f2eacf45 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.639631  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.640489  2677 raft_consensus.cc:2243] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.641057  2677 raft_consensus.cc:2272] T fe475402ebb54fed9985713a50767b22 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.644125  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.644735  2677 raft_consensus.cc:2243] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.645632  2677 raft_consensus.cc:2272] T 97353355e64b4a2baa32282604facc78 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.649454  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.650383  2677 raft_consensus.cc:2243] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.650947  2677 raft_consensus.cc:2272] T 93e850aa3e4f4123bb241a8c42c6fba4 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.651811 11813 consensus_peers.cc:597] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.653966  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.654778  2677 raft_consensus.cc:2243] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.655308  2677 raft_consensus.cc:2272] T 0821f1ba5d454c60969fe784eb8f4587 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.658119  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.658795  2677 raft_consensus.cc:2243] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.659252  2677 raft_consensus.cc:2272] T 80b3401de6ec4056b042aa09ec1abaa8 P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.662177  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.662601 11739 consensus_peers.cc:597] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.663004  2677 raft_consensus.cc:2243] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.663630  2677 raft_consensus.cc:2272] T fd301d1462624fbf813790e481f7aced P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.666709  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.667585  2677 raft_consensus.cc:2243] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.668176  2677 raft_consensus.cc:2272] T 224a9910fdc3406d86818fe98f0e8a0b P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.671289  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.671681 11664 consensus_peers.cc:597] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.672158  2677 raft_consensus.cc:2243] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.672861  2677 raft_consensus.cc:2272] T 412607e4f40b48cb9d7d91c15c2f0d1c P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.676115  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.676932  2677 raft_consensus.cc:2243] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.677956  2677 raft_consensus.cc:2272] T 48afc51fa9e34dc0a796be2dcaf58501 P a4cfb7e6c6a743fe80ee7917f0521805 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.679335 11664 consensus_peers.cc:597] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.681097  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.681727  2677 raft_consensus.cc:2243] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.682156  2677 raft_consensus.cc:2272] T 08646ea4ad114214a14c66377f11e4be P a4cfb7e6c6a743fe80ee7917f0521805 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.684497  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.685104  2677 raft_consensus.cc:2243] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.685564  2677 raft_consensus.cc:2272] T 1ff5912f7aa3418da40210943458bf43 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.687943  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.688642  2677 raft_consensus.cc:2243] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.689211  2677 raft_consensus.cc:2272] T 99b354e318924ecaae70882105f1d00f P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.692163  2677 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:04.692718 11739 consensus_peers.cc:597] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.692935  2677 raft_consensus.cc:2243] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.693594  2677 raft_consensus.cc:2272] T ba98915c34f347fdb7e429eef931c7ad P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.696501  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:04.697057  2677 raft_consensus.cc:2243] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.697633  2677 raft_consensus.cc:2272] T 9e8cbbcd57984472b9a0ffee2f76bb32 P a4cfb7e6c6a743fe80ee7917f0521805 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:04.701308 11813 consensus_peers.cc:597] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.714212 11813 consensus_peers.cc:597] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.716166 11739 consensus_peers.cc:597] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.755760 11664 consensus_peers.cc:597] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.777204  2677 tablet_server.cc:196] TabletServer@127.2.157.65:42455 shutdown complete.
W20260709 12:25:04.782157 11739 consensus_peers.cc:597] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.798041 11739 consensus_peers.cc:597] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.820487 11739 consensus_peers.cc:597] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.915105  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:25:04.924403 11664 consensus_peers.cc:597] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.958036 11813 consensus_peers.cc:597] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Couldn't send request to peer a4cfb7e6c6a743fe80ee7917f0521805. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:04.975550 11814 consensus_peers.cc:597] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.986960  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:04.988121  2677 tablet_replica.cc:333] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:04.989168  2677 raft_consensus.cc:2243] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.989713  2677 raft_consensus.cc:2272] T 2a366e09e3a54815b5bb446e20e8bf08 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.992427  2677 tablet_replica.cc:333] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:04.993108  2677 raft_consensus.cc:2243] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:04.993707  2677 raft_consensus.cc:2272] T f67d4fdb6dd444feae249f74e1ac29bc P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:04.996685  2677 tablet_replica.cc:333] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:04.997442  2677 raft_consensus.cc:2243] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:04.998593  2677 raft_consensus.cc:2272] T 09abbb280def4e0d95c1a6ba90635571 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.000794  2677 tablet_replica.cc:333] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.001461  2677 raft_consensus.cc:2243] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.002324  2677 raft_consensus.cc:2272] T 7d410c3744a2471289fb0620248a0598 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.004582  2677 tablet_replica.cc:333] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.005415  2677 raft_consensus.cc:2243] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.006470  2677 raft_consensus.cc:2272] T 910c074d754749b9b864ab7017c2a8db P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.009654  2677 tablet_replica.cc:333] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.010766  2677 raft_consensus.cc:2243] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.011979  2677 raft_consensus.cc:2272] T bb409dacde4a45fd956e729c49b4a978 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.017066  2677 tablet_replica.cc:333] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.017977  2677 raft_consensus.cc:2243] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.018567  2677 raft_consensus.cc:2272] T 4efa13ea53b04377b4e94d50ebd901c5 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.021484  2677 tablet_replica.cc:333] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.022372  2677 raft_consensus.cc:2243] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.023387  2677 raft_consensus.cc:2272] T 28755e05e0c142a8a2e116e1c788f197 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.026430  2677 tablet_replica.cc:333] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.027287  2677 raft_consensus.cc:2243] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.027858  2677 raft_consensus.cc:2272] T 99eb28e8992c4572b48c7a6e40155938 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.028460 11814 consensus_peers.cc:597] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.029951  2677 tablet_replica.cc:333] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.030977  2677 raft_consensus.cc:2243] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.031579  2677 raft_consensus.cc:2272] T f8a60b4de2d84722b898bd80d5fed966 P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.034165  2677 tablet_replica.cc:333] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.034941  2677 raft_consensus.cc:2243] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.035537  2677 raft_consensus.cc:2272] T 93a33d2febb741e6840067d443720a5a P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.037766  2677 tablet_replica.cc:333] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.038585  2677 raft_consensus.cc:2243] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.039656  2677 raft_consensus.cc:2272] T 58e3e708e6c145bc81691e6cbd7eb0a6 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.041527 11740 consensus_peers.cc:597] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.042418  2677 tablet_replica.cc:333] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.043164  2677 raft_consensus.cc:2243] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.043689  2677 raft_consensus.cc:2272] T e90b4bac88844df4a5d19f0f05135c60 P 141a039ea83140368c7d19efb49a48bc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.046444  2677 tablet_replica.cc:333] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.047242  2677 raft_consensus.cc:2243] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.047854  2677 raft_consensus.cc:2272] T 9a7dd102418f4a969650594d69177b7f P 141a039ea83140368c7d19efb49a48bc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.049768 11814 consensus_peers.cc:597] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.050424  2677 tablet_replica.cc:333] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.051156  2677 raft_consensus.cc:2243] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.051676  2677 raft_consensus.cc:2272] T 1ff5912f7aa3418da40210943458bf43 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.054030  2677 tablet_replica.cc:333] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.054864  2677 raft_consensus.cc:2243] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.055789  2677 raft_consensus.cc:2272] T 8979e35797a74681b5631a8b7b269607 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.058357  2677 tablet_replica.cc:333] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.059142  2677 raft_consensus.cc:2243] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.060256  2677 raft_consensus.cc:2272] T 451a1a4e56614af883d9ce0b87370816 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.063366  2677 tablet_replica.cc:333] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.064263  2677 raft_consensus.cc:2243] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.065239  2677 raft_consensus.cc:2272] T b6631247217f4eb9b8113265bfd7ef14 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.067981  2677 tablet_replica.cc:333] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.068737  2677 raft_consensus.cc:2243] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.069278  2677 raft_consensus.cc:2272] T 6a78e8a37cdc46b2918da1716ded8a01 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.070053 11814 consensus_peers.cc:597] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.072165  2677 tablet_replica.cc:333] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.073158  2677 raft_consensus.cc:2243] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.073745  2677 raft_consensus.cc:2272] T 22be73ed83804329a321f34cba74e33d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.075346 11740 consensus_peers.cc:597] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.076681  2677 tablet_replica.cc:333] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.077380  2677 raft_consensus.cc:2243] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.077844  2677 raft_consensus.cc:2272] T 8272e93c7c9c428d9d914614986ff95d P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.079937  2677 tablet_replica.cc:333] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.080560  2677 raft_consensus.cc:2243] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.081481  2677 raft_consensus.cc:2272] T 9db9c065d47b4da99521736c33b51839 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.084204  2677 tablet_replica.cc:333] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.085033  2677 raft_consensus.cc:2243] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.085558  2677 raft_consensus.cc:2272] T f2ec367784484300bff9019d060541ca P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.088608  2677 tablet_replica.cc:333] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.089483  2677 raft_consensus.cc:2243] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:05.090052 11740 consensus_peers.cc:597] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.090582  2677 raft_consensus.cc:2272] T fe475402ebb54fed9985713a50767b22 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.093734  2677 tablet_replica.cc:333] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.094633  2677 raft_consensus.cc:2243] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.095769  2677 raft_consensus.cc:2272] T 3bf7dd33493f4ea39e190ab6f2eacf45 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.096997 11814 consensus_peers.cc:597] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.098174  2677 tablet_replica.cc:333] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.099099  2677 raft_consensus.cc:2243] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.099700  2677 raft_consensus.cc:2272] T 97353355e64b4a2baa32282604facc78 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.102542  2677 tablet_replica.cc:333] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.103363  2677 raft_consensus.cc:2243] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.103969  2677 raft_consensus.cc:2272] T cad92fece50d444cb8e4841eb7f23518 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.106523  2677 tablet_replica.cc:333] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.107074  2677 raft_consensus.cc:2243] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.107560  2677 raft_consensus.cc:2272] T ddf12fde1d684537ae6ffc7c071107a7 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.110008  2677 tablet_replica.cc:333] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.110644  2677 raft_consensus.cc:2243] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.111116  2677 raft_consensus.cc:2272] T d6b59f3bf0bd4720a292c993753e9535 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.113587  2677 tablet_replica.cc:333] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.114332  2677 raft_consensus.cc:2243] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.114840  2677 raft_consensus.cc:2272] T 9b7553e005f3406698c40ed7d949f864 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.115672 11814 consensus_peers.cc:597] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.117010  2677 tablet_replica.cc:333] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.117693  2677 raft_consensus.cc:2243] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.118170  2677 raft_consensus.cc:2272] T 0821f1ba5d454c60969fe784eb8f4587 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.120308  2677 tablet_replica.cc:333] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.121134  2677 raft_consensus.cc:2243] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.122190  2677 raft_consensus.cc:2272] T 80b3401de6ec4056b042aa09ec1abaa8 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.125213  2677 tablet_replica.cc:333] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.126034  2677 raft_consensus.cc:2243] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.127147  2677 raft_consensus.cc:2272] T fea76dbfd7d0485ab14a3eedef8a4ff1 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.129539  2677 tablet_replica.cc:333] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.130141  2677 raft_consensus.cc:2243] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.130599  2677 raft_consensus.cc:2272] T 891213c70e5a40d085c955386f620b0f P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.133576  2677 tablet_replica.cc:333] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.134407  2677 raft_consensus.cc:2243] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.134955  2677 raft_consensus.cc:2272] T 826145f71fd94539864327f8c9f806ad P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.137954  2677 tablet_replica.cc:333] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.138756  2677 raft_consensus.cc:2243] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.139281  2677 raft_consensus.cc:2272] T 48afc51fa9e34dc0a796be2dcaf58501 P 141a039ea83140368c7d19efb49a48bc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.142187  2677 tablet_replica.cc:333] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.142984  2677 raft_consensus.cc:2243] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.144083  2677 raft_consensus.cc:2272] T 08646ea4ad114214a14c66377f11e4be P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.144585 11814 consensus_peers.cc:597] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.146965  2677 tablet_replica.cc:333] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.147917  2677 raft_consensus.cc:2243] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.148443  2677 raft_consensus.cc:2272] T 94e944029a644ed2a0dd77f44e800a3b P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.150655  2677 tablet_replica.cc:333] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.151238  2677 raft_consensus.cc:2243] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.151721  2677 raft_consensus.cc:2272] T feb74090705a402e9f360b6e9a2dfbee P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.153734  2677 tablet_replica.cc:333] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.154294  2677 raft_consensus.cc:2243] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.154753  2677 raft_consensus.cc:2272] T b742388171e940eabb3e896f3946f3c3 P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.156911  2677 tablet_replica.cc:333] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.157503  2677 raft_consensus.cc:2243] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.157994  2677 raft_consensus.cc:2272] T 4c7089136bb8430a80f9cb95512704ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.160156  2677 tablet_replica.cc:333] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.160761  2677 raft_consensus.cc:2243] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.161206  2677 raft_consensus.cc:2272] T fa4b08c8ab84410da9b69d5236dc4c9e P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.163251  2677 tablet_replica.cc:333] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.163800  2677 raft_consensus.cc:2243] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.164245  2677 raft_consensus.cc:2272] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 141a039ea83140368c7d19efb49a48bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.166452  2677 tablet_replica.cc:333] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc: stopping tablet replica
I20260709 12:25:05.167083  2677 raft_consensus.cc:2243] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.168089  2677 raft_consensus.cc:2272] T ba98915c34f347fdb7e429eef931c7ad P 141a039ea83140368c7d19efb49a48bc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.169713 11740 consensus_peers.cc:597] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.187723 11740 consensus_peers.cc:597] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.219291 11814 consensus_peers.cc:597] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.258071 11740 consensus_peers.cc:597] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.272025 11740 consensus_peers.cc:597] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.276882 11814 consensus_peers.cc:597] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.279479  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
W20260709 12:25:05.305812 11814 consensus_peers.cc:597] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.308565 11814 consensus_peers.cc:597] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.329555 11814 consensus_peers.cc:597] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Couldn't send request to peer 141a039ea83140368c7d19efb49a48bc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.381592  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
W20260709 12:25:05.411077 11812 consensus_peers.cc:597] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.418540 11812 consensus_peers.cc:597] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.435422  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:05.436538  2677 tablet_replica.cc:333] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.437667  2677 raft_consensus.cc:2243] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.438835  2677 raft_consensus.cc:2272] T 04157ec411b241028d32c3555200ab43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.441951  2677 tablet_replica.cc:333] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.442705  2677 raft_consensus.cc:2243] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.443212  2677 raft_consensus.cc:2272] T 2a366e09e3a54815b5bb446e20e8bf08 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.445452  2677 tablet_replica.cc:333] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.446301  2677 raft_consensus.cc:2243] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.446831  2677 raft_consensus.cc:2272] T 6a78e8a37cdc46b2918da1716ded8a01 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.449397  2677 tablet_replica.cc:333] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.450161  2677 raft_consensus.cc:2243] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.450661  2677 raft_consensus.cc:2272] T fe475402ebb54fed9985713a50767b22 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.453277  2677 tablet_replica.cc:333] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.453943  2677 raft_consensus.cc:2243] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.455140  2677 raft_consensus.cc:2272] T bb409dacde4a45fd956e729c49b4a978 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.458148  2677 tablet_replica.cc:333] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.459038  2677 raft_consensus.cc:2243] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.459630  2677 raft_consensus.cc:2272] T 7c50f3c984bc40b78d55050ae3394346 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.462001  2677 tablet_replica.cc:333] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.462747  2677 raft_consensus.cc:2243] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.463804  2677 raft_consensus.cc:2272] T 91a124cf3dea44f39e82b7b9a5e9d64f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.466344  2677 tablet_replica.cc:333] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.467147  2677 raft_consensus.cc:2243] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.467751  2677 raft_consensus.cc:2272] T 910c074d754749b9b864ab7017c2a8db P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.470592  2677 tablet_replica.cc:333] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.471266  2677 raft_consensus.cc:2243] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.472204  2677 raft_consensus.cc:2272] T 9e8cbbcd57984472b9a0ffee2f76bb32 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.475271  2677 tablet_replica.cc:333] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.476262  2677 raft_consensus.cc:2243] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.476953  2677 raft_consensus.cc:2272] T fa4b08c8ab84410da9b69d5236dc4c9e P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.480118  2677 tablet_replica.cc:333] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.480790  2677 raft_consensus.cc:2243] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.481281  2677 raft_consensus.cc:2272] T bffaa0a9d87c431ba2962fb1ba98a6b5 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.483798  2677 tablet_replica.cc:333] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.484443  2677 raft_consensus.cc:2243] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.484962  2677 raft_consensus.cc:2272] T f8a60b4de2d84722b898bd80d5fed966 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.487159  2677 tablet_replica.cc:333] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.488022  2677 raft_consensus.cc:2243] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.489183  2677 raft_consensus.cc:2272] T 93e850aa3e4f4123bb241a8c42c6fba4 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.492352  2677 tablet_replica.cc:333] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.493124  2677 raft_consensus.cc:2243] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.493669  2677 raft_consensus.cc:2272] T c8f52aa43c6f4920af39015011c44a84 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.496670  2677 tablet_replica.cc:333] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.497581  2677 raft_consensus.cc:2243] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.498791  2677 raft_consensus.cc:2272] T 99b354e318924ecaae70882105f1d00f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.501214  2677 tablet_replica.cc:333] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.501848  2677 raft_consensus.cc:2243] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.502372  2677 raft_consensus.cc:2272] T 8979e35797a74681b5631a8b7b269607 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.505147  2677 tablet_replica.cc:333] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.506000  2677 raft_consensus.cc:2243] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.507126  2677 raft_consensus.cc:2272] T 1ff5912f7aa3418da40210943458bf43 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.509757  2677 tablet_replica.cc:333] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.510416  2677 raft_consensus.cc:2243] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.510898  2677 raft_consensus.cc:2272] T 451a1a4e56614af883d9ce0b87370816 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.513057  2677 tablet_replica.cc:333] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.513697  2677 raft_consensus.cc:2243] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.514180  2677 raft_consensus.cc:2272] T 7d410c3744a2471289fb0620248a0598 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.516327  2677 tablet_replica.cc:333] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.516932  2677 raft_consensus.cc:2243] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.517797  2677 raft_consensus.cc:2272] T 412607e4f40b48cb9d7d91c15c2f0d1c P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.520695  2677 tablet_replica.cc:333] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.521502  2677 raft_consensus.cc:2243] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.522130  2677 raft_consensus.cc:2272] T 224a9910fdc3406d86818fe98f0e8a0b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.524832  2677 tablet_replica.cc:333] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.525702  2677 raft_consensus.cc:2243] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.526854  2677 raft_consensus.cc:2272] T 4c7089136bb8430a80f9cb95512704ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.529954  2677 tablet_replica.cc:333] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.530594  2677 raft_consensus.cc:2243] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.531037  2677 raft_consensus.cc:2272] T 94e944029a644ed2a0dd77f44e800a3b P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.533303  2677 tablet_replica.cc:333] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.533876  2677 raft_consensus.cc:2243] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.534322  2677 raft_consensus.cc:2272] T feb74090705a402e9f360b6e9a2dfbee P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.536502  2677 tablet_replica.cc:333] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.537078  2677 raft_consensus.cc:2243] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.537896  2677 raft_consensus.cc:2272] T b742388171e940eabb3e896f3946f3c3 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.540314  2677 tablet_replica.cc:333] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.541000  2677 raft_consensus.cc:2243] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.541446  2677 raft_consensus.cc:2272] T 826145f71fd94539864327f8c9f806ad P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.543803  2677 tablet_replica.cc:333] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.544441  2677 raft_consensus.cc:2243] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.544935  2677 raft_consensus.cc:2272] T 07a473b2d6004593b4924bce2b7af51f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.547691  2677 tablet_replica.cc:333] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.548521  2677 raft_consensus.cc:2243] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.549117  2677 raft_consensus.cc:2272] T 9db9c065d47b4da99521736c33b51839 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.551258  2677 tablet_replica.cc:333] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.551872  2677 raft_consensus.cc:2243] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.552331  2677 raft_consensus.cc:2272] T f2ec367784484300bff9019d060541ca P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.554316  2677 tablet_replica.cc:333] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.554868  2677 raft_consensus.cc:2243] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.555790  2677 raft_consensus.cc:2272] T 8272e93c7c9c428d9d914614986ff95d P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.557803  2677 tablet_replica.cc:333] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.558435  2677 raft_consensus.cc:2243] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.558903  2677 raft_consensus.cc:2272] T ddf12fde1d684537ae6ffc7c071107a7 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.561015  2677 tablet_replica.cc:333] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.561573  2677 raft_consensus.cc:2243] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.562372  2677 raft_consensus.cc:2272] T 93a33d2febb741e6840067d443720a5a P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.564852  2677 tablet_replica.cc:333] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.565521  2677 raft_consensus.cc:2243] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.566059  2677 raft_consensus.cc:2272] T e90b4bac88844df4a5d19f0f05135c60 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.566490 11812 consensus_peers.cc:597] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.568236  2677 tablet_replica.cc:333] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.568899  2677 raft_consensus.cc:2243] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.569298  2677 raft_consensus.cc:2272] T 9a7dd102418f4a969650594d69177b7f P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.571465  2677 tablet_replica.cc:333] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.572093  2677 raft_consensus.cc:2243] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.572530  2677 raft_consensus.cc:2272] T 40d00c475c524bf09cb644cdbd0d6765 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.574972  2677 tablet_replica.cc:333] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
W20260709 12:25:05.575556 11812 consensus_peers.cc:597] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.575608  2677 raft_consensus.cc:2243] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.576692  2677 raft_consensus.cc:2272] T 9b7553e005f3406698c40ed7d949f864 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.578689  2677 tablet_replica.cc:333] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.579273  2677 raft_consensus.cc:2243] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.579820  2677 raft_consensus.cc:2272] T d6b59f3bf0bd4720a292c993753e9535 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.582296  2677 tablet_replica.cc:333] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.583019  2677 raft_consensus.cc:2243] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.583540  2677 raft_consensus.cc:2272] T 99eb28e8992c4572b48c7a6e40155938 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.586107  2677 tablet_replica.cc:333] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.586663  2677 raft_consensus.cc:2243] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.587195  2677 raft_consensus.cc:2272] T 43ec9bad6eb04d448bbfb563a7675db2 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.589779  2677 tablet_replica.cc:333] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.590497  2677 raft_consensus.cc:2243] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.591087  2677 raft_consensus.cc:2272] T fd301d1462624fbf813790e481f7aced P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.593658  2677 tablet_replica.cc:333] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.594275  2677 raft_consensus.cc:2243] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.594774  2677 raft_consensus.cc:2272] T 80b3401de6ec4056b042aa09ec1abaa8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.597843  2677 tablet_replica.cc:333] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.598560  2677 raft_consensus.cc:2243] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.599725  2677 raft_consensus.cc:2272] T ea4131857eb24e4887659e33e75df237 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.602785  2677 tablet_replica.cc:333] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.603396  2677 raft_consensus.cc:2243] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.604333  2677 raft_consensus.cc:2272] T 3bd851065052495d9905854dd7e0d1f8 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.607118  2677 tablet_replica.cc:333] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40: stopping tablet replica
I20260709 12:25:05.607851  2677 raft_consensus.cc:2243] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.608470  2677 raft_consensus.cc:2272] T 48afc51fa9e34dc0a796be2dcaf58501 P 0fe4fa6e7e044fcd83efeafc9bea9c40 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.619652 11812 consensus_peers.cc:597] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.625835 11812 consensus_peers.cc:597] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.651176 11812 consensus_peers.cc:597] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.675385 12831 raft_consensus.cc:493] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:25:05.676074 12831 raft_consensus.cc:515] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:05.678428 12831 leader_election.cc:290] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
W20260709 12:25:05.684767 11813 leader_election.cc:336] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
W20260709 12:25:05.690076 11814 leader_election.cc:336] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111)
I20260709 12:25:05.690668 11814 leader_election.cc:304] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:05.691517 12831 raft_consensus.cc:2749] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:05.694039  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
W20260709 12:25:05.694628 11812 consensus_peers.cc:597] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.67:37587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:05.703536 11812 consensus_peers.cc:597] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.67:37587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.778329  2677 tablet_server.cc:179] TabletServer@127.2.157.68:0 shutting down...
I20260709 12:25:05.817327 12831 raft_consensus.cc:493] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4cfb7e6c6a743fe80ee7917f0521805)
I20260709 12:25:05.817973 12831 raft_consensus.cc:515] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed4262e8a41a45cebe0b2587d48e1135" member_type: VOTER last_known_addr { host: "127.2.157.68" port: 43831 } } peers { permanent_uuid: "a4cfb7e6c6a743fe80ee7917f0521805" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 42455 } } peers { permanent_uuid: "141a039ea83140368c7d19efb49a48bc" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 41227 } }
I20260709 12:25:05.820797 12831 leader_election.cc:290] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455), 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227)
I20260709 12:25:05.823768  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:05.824554 11813 leader_election.cc:336] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4cfb7e6c6a743fe80ee7917f0521805 (127.2.157.65:42455): Network error: Client connection negotiation failed: client connection to 127.2.157.65:42455: connect: Connection refused (error 111)
I20260709 12:25:05.825425  2677 tablet_replica.cc:333] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.826659  2677 raft_consensus.cc:2243] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.827260  2677 raft_consensus.cc:2272] T 04157ec411b241028d32c3555200ab43 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:05.828540 11814 leader_election.cc:336] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 141a039ea83140368c7d19efb49a48bc (127.2.157.66:41227): Network error: Client connection negotiation failed: client connection to 127.2.157.66:41227: connect: Connection refused (error 111)
I20260709 12:25:05.829115 11814 leader_election.cc:304] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed4262e8a41a45cebe0b2587d48e1135; no voters: 141a039ea83140368c7d19efb49a48bc, a4cfb7e6c6a743fe80ee7917f0521805
I20260709 12:25:05.829927 12831 raft_consensus.cc:2749] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:05.830505  2677 tablet_replica.cc:333] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.831321  2677 raft_consensus.cc:2243] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.832181  2677 raft_consensus.cc:2272] T f67d4fdb6dd444feae249f74e1ac29bc P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.834321  2677 tablet_replica.cc:333] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.834952  2677 raft_consensus.cc:2243] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.835558  2677 raft_consensus.cc:2272] T 09abbb280def4e0d95c1a6ba90635571 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.837720  2677 tablet_replica.cc:333] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.838326  2677 raft_consensus.cc:2243] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.838757  2677 raft_consensus.cc:2272] T 9db9c065d47b4da99521736c33b51839 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.840909  2677 tablet_replica.cc:333] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.841521  2677 raft_consensus.cc:2243] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.841941  2677 raft_consensus.cc:2272] T 91a124cf3dea44f39e82b7b9a5e9d64f P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.844105  2677 tablet_replica.cc:333] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.844714  2677 raft_consensus.cc:2243] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.845141  2677 raft_consensus.cc:2272] T 4efa13ea53b04377b4e94d50ebd901c5 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.847141  2677 tablet_replica.cc:333] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.847810  2677 raft_consensus.cc:2243] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.848263  2677 raft_consensus.cc:2272] T 9e8cbbcd57984472b9a0ffee2f76bb32 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.850651  2677 tablet_replica.cc:333] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.851262  2677 raft_consensus.cc:2243] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.851758  2677 raft_consensus.cc:2272] T 7c50f3c984bc40b78d55050ae3394346 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.853885  2677 tablet_replica.cc:333] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.854589  2677 raft_consensus.cc:2243] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.855108  2677 raft_consensus.cc:2272] T 28755e05e0c142a8a2e116e1c788f197 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.857306  2677 tablet_replica.cc:333] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.858021  2677 raft_consensus.cc:2243] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.859282  2677 raft_consensus.cc:2272] T f8a60b4de2d84722b898bd80d5fed966 P ed4262e8a41a45cebe0b2587d48e1135 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.862167  2677 tablet_replica.cc:333] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.862855  2677 raft_consensus.cc:2243] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.863889  2677 raft_consensus.cc:2272] T 0821f1ba5d454c60969fe784eb8f4587 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.866076  2677 tablet_replica.cc:333] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.866680  2677 raft_consensus.cc:2243] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.867123  2677 raft_consensus.cc:2272] T 93e850aa3e4f4123bb241a8c42c6fba4 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.869617  2677 tablet_replica.cc:333] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.870509  2677 raft_consensus.cc:2243] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.871105  2677 raft_consensus.cc:2272] T 451a1a4e56614af883d9ce0b87370816 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.874282  2677 tablet_replica.cc:333] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.875104  2677 raft_consensus.cc:2243] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.875737  2677 raft_consensus.cc:2272] T c8f52aa43c6f4920af39015011c44a84 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.878379  2677 tablet_replica.cc:333] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.879017  2677 raft_consensus.cc:2243] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.879558  2677 raft_consensus.cc:2272] T b6631247217f4eb9b8113265bfd7ef14 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.881780  2677 tablet_replica.cc:333] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.882421  2677 raft_consensus.cc:2243] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.882899  2677 raft_consensus.cc:2272] T 99b354e318924ecaae70882105f1d00f P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.885092  2677 tablet_replica.cc:333] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.885861  2677 raft_consensus.cc:2243] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.886425  2677 raft_consensus.cc:2272] T 8979e35797a74681b5631a8b7b269607 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.889434  2677 tablet_replica.cc:333] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.890200  2677 raft_consensus.cc:2243] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.890825  2677 raft_consensus.cc:2272] T 93a33d2febb741e6840067d443720a5a P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.893707  2677 tablet_replica.cc:333] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.894387  2677 raft_consensus.cc:2243] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.894881  2677 raft_consensus.cc:2272] T 58e3e708e6c145bc81691e6cbd7eb0a6 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.896878  2677 tablet_replica.cc:333] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.897511  2677 raft_consensus.cc:2243] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.898002  2677 raft_consensus.cc:2272] T 7d410c3744a2471289fb0620248a0598 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.900220  2677 tablet_replica.cc:333] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.900873  2677 raft_consensus.cc:2243] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.901350  2677 raft_consensus.cc:2272] T 412607e4f40b48cb9d7d91c15c2f0d1c P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.903671  2677 tablet_replica.cc:333] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.904278  2677 raft_consensus.cc:2243] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.905216  2677 raft_consensus.cc:2272] T 224a9910fdc3406d86818fe98f0e8a0b P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.907816  2677 tablet_replica.cc:333] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.908478  2677 raft_consensus.cc:2243] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.909399  2677 raft_consensus.cc:2272] T 826145f71fd94539864327f8c9f806ad P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.912241  2677 tablet_replica.cc:333] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.913062  2677 raft_consensus.cc:2243] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:05.913668 11812 consensus_peers.cc:597] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 -> Peer 0fe4fa6e7e044fcd83efeafc9bea9c40 (127.2.157.67:37587): Couldn't send request to peer 0fe4fa6e7e044fcd83efeafc9bea9c40. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.67:37587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:05.914140  2677 raft_consensus.cc:2272] T 07a473b2d6004593b4924bce2b7af51f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.916543  2677 tablet_replica.cc:333] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.917152  2677 raft_consensus.cc:2243] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.917590  2677 raft_consensus.cc:2272] T 43ec9bad6eb04d448bbfb563a7675db2 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.919906  2677 tablet_replica.cc:333] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.920516  2677 raft_consensus.cc:2243] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.921335  2677 raft_consensus.cc:2272] T 94e944029a644ed2a0dd77f44e800a3b P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.923599  2677 tablet_replica.cc:333] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.924202  2677 raft_consensus.cc:2243] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.924705  2677 raft_consensus.cc:2272] T b742388171e940eabb3e896f3946f3c3 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.927037  2677 tablet_replica.cc:333] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.927778  2677 raft_consensus.cc:2243] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.928695  2677 raft_consensus.cc:2272] T fa4b08c8ab84410da9b69d5236dc4c9e P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.930954  2677 tablet_replica.cc:333] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.931715  2677 raft_consensus.cc:2243] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.932579  2677 raft_consensus.cc:2272] T bffaa0a9d87c431ba2962fb1ba98a6b5 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.934791  2677 tablet_replica.cc:333] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.935541  2677 raft_consensus.cc:2243] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.936059  2677 raft_consensus.cc:2272] T ba98915c34f347fdb7e429eef931c7ad P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.938463  2677 tablet_replica.cc:333] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.939136  2677 raft_consensus.cc:2243] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.939673  2677 raft_consensus.cc:2272] T ea4131857eb24e4887659e33e75df237 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.942169  2677 tablet_replica.cc:333] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.942849  2677 raft_consensus.cc:2243] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.943331  2677 raft_consensus.cc:2272] T 3bd851065052495d9905854dd7e0d1f8 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.945626  2677 tablet_replica.cc:333] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.946251  2677 raft_consensus.cc:2243] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.946794  2677 raft_consensus.cc:2272] T fea76dbfd7d0485ab14a3eedef8a4ff1 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.948943  2677 tablet_replica.cc:333] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.949692  2677 raft_consensus.cc:2243] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.950528  2677 raft_consensus.cc:2272] T 891213c70e5a40d085c955386f620b0f P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.953006  2677 tablet_replica.cc:333] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.953681  2677 raft_consensus.cc:2243] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.954165  2677 raft_consensus.cc:2272] T 40d00c475c524bf09cb644cdbd0d6765 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.956552  2677 tablet_replica.cc:333] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.957175  2677 raft_consensus.cc:2243] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.957864  2677 raft_consensus.cc:2272] T 08646ea4ad114214a14c66377f11e4be P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.960736  2677 tablet_replica.cc:333] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.961405  2677 raft_consensus.cc:2243] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.961963  2677 raft_consensus.cc:2272] T 8272e93c7c9c428d9d914614986ff95d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.964578  2677 tablet_replica.cc:333] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.965220  2677 raft_consensus.cc:2243] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.965726  2677 raft_consensus.cc:2272] T 3bf7dd33493f4ea39e190ab6f2eacf45 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.968116  2677 tablet_replica.cc:333] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.968696  2677 raft_consensus.cc:2243] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:05.969138  2677 raft_consensus.cc:2272] T 97353355e64b4a2baa32282604facc78 P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.971377  2677 tablet_replica.cc:333] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.972026  2677 raft_consensus.cc:2243] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.972872  2677 raft_consensus.cc:2272] T cad92fece50d444cb8e4841eb7f23518 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.975127  2677 tablet_replica.cc:333] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.975773  2677 raft_consensus.cc:2243] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.976699  2677 raft_consensus.cc:2272] T ddf12fde1d684537ae6ffc7c071107a7 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.978847  2677 tablet_replica.cc:333] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.979542  2677 raft_consensus.cc:2243] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.980362  2677 raft_consensus.cc:2272] T 6a78e8a37cdc46b2918da1716ded8a01 P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.982643  2677 tablet_replica.cc:333] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.983180  2677 raft_consensus.cc:2243] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.984112  2677 raft_consensus.cc:2272] T 22be73ed83804329a321f34cba74e33d P ed4262e8a41a45cebe0b2587d48e1135 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:05.986860  2677 tablet_replica.cc:333] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135: stopping tablet replica
I20260709 12:25:05.987493  2677 raft_consensus.cc:2243] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:05.988334  2677 raft_consensus.cc:2272] T fd301d1462624fbf813790e481f7aced P ed4262e8a41a45cebe0b2587d48e1135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.059437  2677 tablet_server.cc:196] TabletServer@127.2.157.68:0 shutdown complete.
I20260709 12:25:06.128201  2677 master.cc:562] Master@127.2.157.126:41099 shutting down...
I20260709 12:25:06.157358  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:06.157998  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:06.158353  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P f5be24357a09446eacbc482ffe0031fc: stopping tablet replica
I20260709 12:25:06.180751  2677 master.cc:584] Master@127.2.157.126:41099 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32828 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:25:06.274863  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:32979
I20260709 12:25:06.276172  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:06.282675 12844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:06.282714 12845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:06.283857 12847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.284207  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:06.285467  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:06.285655  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:06.285785  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599906285767 us; error 0 us; skew 500 ppm
I20260709 12:25:06.286317  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:06.289251  2677 webserver.cc:533] Webserver started at http://127.2.157.126:34271/ using document root <none> and password file <none>
I20260709 12:25:06.289722  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:06.289884  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:06.290108  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:06.291277  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "e292a5fb2aae4610bcbccf76cd599fc2"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.296136  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:06.300033 12852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.300907  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:25:06.301188  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "e292a5fb2aae4610bcbccf76cd599fc2"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.301455  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:06.311959  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:06.313247  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:06.356266  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:32979
I20260709 12:25:06.356410 12904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:32979 every 8 connection(s)
I20260709 12:25:06.360582 12905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.372771 12905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2: Bootstrap starting.
I20260709 12:25:06.378276 12905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:06.384203 12905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2: No bootstrap required, opened a new log
I20260709 12:25:06.387669 12905 raft_consensus.cc:359] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER }
I20260709 12:25:06.388092 12905 raft_consensus.cc:385] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:06.388379 12905 raft_consensus.cc:740] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e292a5fb2aae4610bcbccf76cd599fc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:06.389096 12905 consensus_queue.cc:260] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER }
I20260709 12:25:06.389710 12905 raft_consensus.cc:399] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:06.390053 12905 raft_consensus.cc:493] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:06.390401 12905 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:06.396220 12905 raft_consensus.cc:515] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER }
I20260709 12:25:06.396816 12905 leader_election.cc:304] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e292a5fb2aae4610bcbccf76cd599fc2; no voters: 
I20260709 12:25:06.398041 12905 leader_election.cc:290] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:06.398419 12908 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:06.399925 12908 raft_consensus.cc:697] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 1 LEADER]: Becoming Leader. State: Replica: e292a5fb2aae4610bcbccf76cd599fc2, State: Running, Role: LEADER
I20260709 12:25:06.400640 12908 consensus_queue.cc:237] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER }
I20260709 12:25:06.401194 12905 sys_catalog.cc:565] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:06.405176 12909 sys_catalog.cc:455] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER } }
I20260709 12:25:06.405969 12909 sys_catalog.cc:458] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:06.406687 12910 sys_catalog.cc:455] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e292a5fb2aae4610bcbccf76cd599fc2. Latest consensus state: current_term: 1 leader_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e292a5fb2aae4610bcbccf76cd599fc2" member_type: VOTER } }
I20260709 12:25:06.407191 12910 sys_catalog.cc:458] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:06.408834 12915 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:06.413842 12915 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:06.418171  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:06.423575 12915 catalog_manager.cc:1383] Generated new cluster ID: bae85219c9e445daba1c00c4680d40a2
I20260709 12:25:06.423872 12915 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:06.440999 12915 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:06.442453 12915 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:06.455811 12915 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2: Generated new TSK 0
I20260709 12:25:06.456524 12915 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:06.485098  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:06.492141 12926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:06.493903 12927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.496697  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:06.499240 12929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.500372  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:06.500725  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:06.500921  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599906500893 us; error 0 us; skew 500 ppm
I20260709 12:25:06.501528  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:06.504283  2677 webserver.cc:533] Webserver started at http://127.2.157.65:46103/ using document root <none> and password file <none>
I20260709 12:25:06.504784  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:06.504995  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:06.505275  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:06.506413  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "5186a51d648545d5ac77a4aab189a9a7"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.511158  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:06.515091 12934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.516139  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:06.516427  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "5186a51d648545d5ac77a4aab189a9a7"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.516691  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:06.548295  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:06.549638  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:06.551296  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:06.553990  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:06.554232  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.554549  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:06.554738  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.598737  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:40965
I20260709 12:25:06.598825 12997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:40965 every 8 connection(s)
I20260709 12:25:06.604404  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:06.612226 13002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:06.613118 13003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.616408  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:06.617062 13006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.618049  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:06.618351  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:06.618561  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599906618542 us; error 0 us; skew 500 ppm
I20260709 12:25:06.619153  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:06.621783  2677 webserver.cc:533] Webserver started at http://127.2.157.66:46139/ using document root <none> and password file <none>
I20260709 12:25:06.622371  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:06.622571  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:06.622905  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:06.624557  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "fa4bce3f28c14c0f857d077a9c283c17"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.625695 12998 heartbeater.cc:344] Connected to a master server at 127.2.157.126:32979
I20260709 12:25:06.626204 12998 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:06.626979 12998 heartbeater.cc:507] Master 127.2.157.126:32979 requested a full tablet report, sending...
I20260709 12:25:06.629259 12870 ts_manager.cc:194] Registered new tserver with Master: 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965)
I20260709 12:25:06.630364  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:06.631181 12870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38050
I20260709 12:25:06.634697 13010 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.636036  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:06.636456  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "fa4bce3f28c14c0f857d077a9c283c17"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.636816  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:06.662549  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:06.664243  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:06.666339  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:06.668823  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:06.669018  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.669338  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:06.669477  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.711772  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:39365
I20260709 12:25:06.711997 13073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:39365 every 8 connection(s)
I20260709 12:25:06.717756  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:06.725920 13077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:06.726547 13078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.730628  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:06.731156 13080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:06.731549 13074 heartbeater.cc:344] Connected to a master server at 127.2.157.126:32979
I20260709 12:25:06.732168 13074 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:06.732465  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:06.732789  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:06.732998  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599906732979 us; error 0 us; skew 500 ppm
I20260709 12:25:06.733142 13074 heartbeater.cc:507] Master 127.2.157.126:32979 requested a full tablet report, sending...
I20260709 12:25:06.733809  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:06.735904 12870 ts_manager.cc:194] Registered new tserver with Master: fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:06.736804  2677 webserver.cc:533] Webserver started at http://127.2.157.67:37677/ using document root <none> and password file <none>
I20260709 12:25:06.737396  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:06.737607  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:06.737670 12870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38058
I20260709 12:25:06.737937  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:06.739701  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "b672236b0eff4d3d9e3108044aad4348"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.744613  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:25:06.748590 13085 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.749590  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:06.749905  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "b672236b0eff4d3d9e3108044aad4348"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:06.750231  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:06.767910  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:06.769238  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:06.770890  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:06.773587  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:06.773783  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.773964  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:06.774195  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:06.820652  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:46361
I20260709 12:25:06.820848 13147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:46361 every 8 connection(s)
I20260709 12:25:06.836090 13148 heartbeater.cc:344] Connected to a master server at 127.2.157.126:32979
I20260709 12:25:06.836591 13148 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:06.837397 13148 heartbeater.cc:507] Master 127.2.157.126:32979 requested a full tablet report, sending...
I20260709 12:25:06.839605 12870 ts_manager.cc:194] Registered new tserver with Master: b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:06.840727  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01659269s
I20260709 12:25:06.841223 12870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38066
I20260709 12:25:06.870390 12870 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38074:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:06.873914 12870 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:06.961261 13113 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccd48ead33c4938a7b644536fc8ee4c (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:06.962864 13113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccd48ead33c4938a7b644536fc8ee4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.967202 13112 tablet_service.cc:1511] Processing CreateTablet for tablet 7afab10799e04fcbb73fe19b2feb7c23 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:06.969012 13112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afab10799e04fcbb73fe19b2feb7c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.974922 13039 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccd48ead33c4938a7b644536fc8ee4c (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:06.976507 13039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccd48ead33c4938a7b644536fc8ee4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.980839 13038 tablet_service.cc:1511] Processing CreateTablet for tablet 7afab10799e04fcbb73fe19b2feb7c23 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:06.982452 13038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afab10799e04fcbb73fe19b2feb7c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.985252 12962 tablet_service.cc:1511] Processing CreateTablet for tablet 7afab10799e04fcbb73fe19b2feb7c23 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:06.986958 12962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7afab10799e04fcbb73fe19b2feb7c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.988884 12963 tablet_service.cc:1511] Processing CreateTablet for tablet 6ccd48ead33c4938a7b644536fc8ee4c (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:06.990473 12963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ccd48ead33c4938a7b644536fc8ee4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.994069 13037 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0d87f489444810b4f161d5c7523081 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:06.995798 13037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0d87f489444810b4f161d5c7523081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:06.994068 12961 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0d87f489444810b4f161d5c7523081 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:07.002924 12961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0d87f489444810b4f161d5c7523081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.005457 13036 tablet_service.cc:1511] Processing CreateTablet for tablet 43261a62955e4a0b9f8b5629b4842db6 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:07.007197 13036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43261a62955e4a0b9f8b5629b4842db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.012187 12959 tablet_service.cc:1511] Processing CreateTablet for tablet da17cc8b61c84b9fbf3efab275b9e6fb (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:07.009200 13110 tablet_service.cc:1511] Processing CreateTablet for tablet 43261a62955e4a0b9f8b5629b4842db6 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:07.016716 13110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43261a62955e4a0b9f8b5629b4842db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.001139 13111 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0d87f489444810b4f161d5c7523081 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:07.022691 13111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0d87f489444810b4f161d5c7523081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.001021 12960 tablet_service.cc:1511] Processing CreateTablet for tablet 43261a62955e4a0b9f8b5629b4842db6 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:07.026340 12959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da17cc8b61c84b9fbf3efab275b9e6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.030624 13112 tablet_service.cc:1511] Processing CreateTablet for tablet da17cc8b61c84b9fbf3efab275b9e6fb (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:07.031934 12960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43261a62955e4a0b9f8b5629b4842db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.032980 13112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da17cc8b61c84b9fbf3efab275b9e6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.052136 12958 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3d5ce26784132942656cefa6d6026 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:07.053876 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3d5ce26784132942656cefa6d6026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.052136 13035 tablet_service.cc:1511] Processing CreateTablet for tablet da17cc8b61c84b9fbf3efab275b9e6fb (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:07.059360 13035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da17cc8b61c84b9fbf3efab275b9e6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.079281 13034 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3d5ce26784132942656cefa6d6026 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:07.080931 13034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3d5ce26784132942656cefa6d6026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.088665 13164 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.098711 13165 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.102625 13164 tablet_bootstrap.cc:654] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.113406 12960 tablet_service.cc:1511] Processing CreateTablet for tablet cef676c5cb154626bb00f403a8fd3d05 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:07.113425 13165 tablet_bootstrap.cc:654] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.119781 13033 tablet_service.cc:1511] Processing CreateTablet for tablet cef676c5cb154626bb00f403a8fd3d05 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:07.122087 13033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef676c5cb154626bb00f403a8fd3d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.121734 13113 tablet_service.cc:1511] Processing CreateTablet for tablet 78b3d5ce26784132942656cefa6d6026 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:07.114889 12960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef676c5cb154626bb00f403a8fd3d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.145397 13164 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.146128 13164 ts_tablet_manager.cc:1403] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.011s
I20260709 12:25:07.149396 13164 raft_consensus.cc:359] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.150241 13164 raft_consensus.cc:385] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.150590 13164 raft_consensus.cc:740] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.139874 13113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3d5ce26784132942656cefa6d6026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.154084 13164 consensus_queue.cc:260] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.160494 13112 tablet_service.cc:1511] Processing CreateTablet for tablet cef676c5cb154626bb00f403a8fd3d05 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:07.162632 13112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef676c5cb154626bb00f403a8fd3d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.167903 12958 tablet_service.cc:1511] Processing CreateTablet for tablet fd769e3b22764149a64442215d813423 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:07.169718 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd769e3b22764149a64442215d813423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.170316 13165 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.171070 13165 ts_tablet_manager.cc:1403] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.009s
I20260709 12:25:07.175248 13165 raft_consensus.cc:359] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.178095 13165 raft_consensus.cc:385] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.178267 13166 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.178470 13165 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.179557 13165 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.181341 13148 heartbeater.cc:499] Master 127.2.157.126:32979 was elected leader, sending a full tablet report...
I20260709 12:25:07.183347 13038 tablet_service.cc:1511] Processing CreateTablet for tablet fd769e3b22764149a64442215d813423 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:07.185025 13038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd769e3b22764149a64442215d813423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.188093 13164 ts_tablet_manager.cc:1434] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.042s	user 0.018s	sys 0.006s
I20260709 12:25:07.189956 13164 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.193179 13166 tablet_bootstrap.cc:654] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.194418 13111 tablet_service.cc:1511] Processing CreateTablet for tablet fd769e3b22764149a64442215d813423 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:07.200395 13165 ts_tablet_manager.cc:1434] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:25:07.203819 13111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd769e3b22764149a64442215d813423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.204051 13074 heartbeater.cc:499] Master 127.2.157.126:32979 was elected leader, sending a full tablet report...
I20260709 12:25:07.213939 13034 tablet_service.cc:1511] Processing CreateTablet for tablet 96a65807ef8b4f929c3e1d6988726e71 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:07.215654 13034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a65807ef8b4f929c3e1d6988726e71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:07.216969 13075 tablet.cc:2406] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:07.217559 13110 tablet_service.cc:1511] Processing CreateTablet for tablet 96a65807ef8b4f929c3e1d6988726e71 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:07.219278 13110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a65807ef8b4f929c3e1d6988726e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.207230 13164 tablet_bootstrap.cc:654] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.231180 12960 tablet_service.cc:1511] Processing CreateTablet for tablet 96a65807ef8b4f929c3e1d6988726e71 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:07.232676 12960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a65807ef8b4f929c3e1d6988726e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.233377 12958 tablet_service.cc:1511] Processing CreateTablet for tablet a1574c45c8cb4bb5a6e63936927b4b12 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:07.234771 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1574c45c8cb4bb5a6e63936927b4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.234869 13033 tablet_service.cc:1511] Processing CreateTablet for tablet a1574c45c8cb4bb5a6e63936927b4b12 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:07.236223 13033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1574c45c8cb4bb5a6e63936927b4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.238217 13169 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.238785 13169 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.242722 13169 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.228615 13165 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.255818 13109 tablet_service.cc:1511] Processing CreateTablet for tablet a1574c45c8cb4bb5a6e63936927b4b12 (DEFAULT_TABLE table=test-workload [id=c448cf70cae04c2eaabd7ca620c9ff59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:07.261708 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
W20260709 12:25:07.263543 13086 leader_election.cc:343] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.265223 13109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1574c45c8cb4bb5a6e63936927b4b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:07.269450 13164 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.270165 13164 ts_tablet_manager.cc:1403] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.005s
I20260709 12:25:07.279042 13164 raft_consensus.cc:359] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.279870 13164 raft_consensus.cc:385] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.280186 13164 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.281095 13164 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.290916 13165 tablet_bootstrap.cc:654] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.293004 13164 ts_tablet_manager.cc:1434] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 12:25:07.294443 13164 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.299412 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.301060 13166 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.301656 13166 ts_tablet_manager.cc:1403] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.005s
W20260709 12:25:07.301949 13089 leader_election.cc:343] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.303613 13089 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348; no voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:07.305524 13166 raft_consensus.cc:359] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.306295 13169 raft_consensus.cc:2749] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:07.306375 13166 raft_consensus.cc:385] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.307168 13166 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.307884 13164 tablet_bootstrap.cc:654] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.308162 13166 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.310458 13165 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.311239 13165 ts_tablet_manager.cc:1403] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.005s
I20260709 12:25:07.315274 13165 raft_consensus.cc:359] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.316125 13165 raft_consensus.cc:385] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.316431 13165 raft_consensus.cc:740] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.317463 12998 heartbeater.cc:499] Master 127.2.157.126:32979 was elected leader, sending a full tablet report...
I20260709 12:25:07.317468 13166 ts_tablet_manager.cc:1434] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:25:07.317385 13165 consensus_queue.cc:260] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.318701 13164 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.319274 13164 ts_tablet_manager.cc:1403] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 12:25:07.319191 13166 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.320240 13165 ts_tablet_manager.cc:1434] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:07.322863 13165 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.322726 13164 raft_consensus.cc:359] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.323541 13164 raft_consensus.cc:385] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.323845 13164 raft_consensus.cc:740] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.324750 13164 consensus_queue.cc:260] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.331343 13166 tablet_bootstrap.cc:654] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.331501 13165 tablet_bootstrap.cc:654] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.334671 13164 ts_tablet_manager.cc:1434] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:07.342039 13164 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.345995 13170 raft_consensus.cc:493] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.346869 13170 raft_consensus.cc:515] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.354979 13170 leader_election.cc:290] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.358541 13166 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.359400 13166 ts_tablet_manager.cc:1403] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.019s
I20260709 12:25:07.370337 13166 raft_consensus.cc:359] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.370995 13166 raft_consensus.cc:385] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.371275 13166 raft_consensus.cc:740] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.372138 13166 consensus_queue.cc:260] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.374998 13166 ts_tablet_manager.cc:1434] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:07.376185 13166 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.378554 13164 tablet_bootstrap.cc:654] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.383536 13166 tablet_bootstrap.cc:654] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.395612 13164 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.396183 13164 ts_tablet_manager.cc:1403] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.004s
I20260709 12:25:07.399380 13164 raft_consensus.cc:359] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.400569 13164 raft_consensus.cc:385] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.401944 13123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.402828 13123 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.403473 13165 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.403939 13166 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.404234 13165 ts_tablet_manager.cc:1403] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.082s	user 0.037s	sys 0.035s
I20260709 12:25:07.404578 13166 ts_tablet_manager.cc:1403] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:25:07.404418 13011 leader_election.cc:304] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.405486 13170 raft_consensus.cc:2804] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.405858 13170 raft_consensus.cc:493] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.406183 13170 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.406898 13164 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.407815 13164 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.407967 13165 raft_consensus.cc:359] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.408607 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.408880 13165 raft_consensus.cc:385] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.409235 13165 raft_consensus.cc:740] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.409379 12973 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.410245 13164 ts_tablet_manager.cc:1434] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:25:07.410148 13165 consensus_queue.cc:260] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
W20260709 12:25:07.413053 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:07.413976 13165 ts_tablet_manager.cc:1434] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:25:07.414654 13166 raft_consensus.cc:359] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.415130 13165 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.415990 13164 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.415505 13166 raft_consensus.cc:385] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.416450 13166 raft_consensus.cc:740] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.417410 13166 consensus_queue.cc:260] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.423077 13164 tablet_bootstrap.cc:654] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.425391 13166 ts_tablet_manager.cc:1434] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:07.427366 13166 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.431016 13170 raft_consensus.cc:515] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.435993 13166 tablet_bootstrap.cc:654] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.436717 13165 tablet_bootstrap.cc:654] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.437994 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.438840 12973 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.439410 13170 leader_election.cc:290] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.441663 13175 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.442129 13123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.442582 13175 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.443149 13123 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.457237 13123 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.458636 13011 leader_election.cc:304] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.459622 13164 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.459952 13170 raft_consensus.cc:2804] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.460403 13164 ts_tablet_manager.cc:1403] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.025s
I20260709 12:25:07.460745 13170 raft_consensus.cc:697] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:07.461745 13170 consensus_queue.cc:237] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.464669 13175 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.465503 13175 raft_consensus.cc:493] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.477496 13164 raft_consensus.cc:359] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.478772 13164 raft_consensus.cc:385] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.466084 13175 raft_consensus.cc:515] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.481267 13175 leader_election.cc:290] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.486783 13164 raft_consensus.cc:740] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.489151 13165 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.489786 13165 ts_tablet_manager.cc:1403] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.023s
I20260709 12:25:07.489455 13164 consensus_queue.cc:260] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.493031 13165 raft_consensus.cc:359] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.493822 13165 raft_consensus.cc:385] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.494138 13165 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.495118 13164 ts_tablet_manager.cc:1434] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:25:07.496721 13164 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.519897 13164 tablet_bootstrap.cc:654] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.519941 12866 catalog_manager.cc:5697] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.546447 13165 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.548019 13123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.549127 13165 ts_tablet_manager.cc:1434] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.059s	user 0.020s	sys 0.038s
I20260709 12:25:07.530133 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.550390 13165 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.550552 13122 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 0.
I20260709 12:25:07.552443 13164 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.553030 13164 ts_tablet_manager.cc:1403] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.010s
I20260709 12:25:07.553637 12935 leader_election.cc:304] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.555145 13188 raft_consensus.cc:2804] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.555827 13188 raft_consensus.cc:493] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.556317 13188 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.556473 13164 raft_consensus.cc:359] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.557365 13164 raft_consensus.cc:385] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.557679 13164 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.558066 13165 tablet_bootstrap.cc:654] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.558715 13164 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.561909 13164 ts_tablet_manager.cc:1434] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:07.563474 13164 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.574544 13165 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.575353 13165 ts_tablet_manager.cc:1403] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.013s
I20260709 12:25:07.579282 13188 raft_consensus.cc:515] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.580936 13164 tablet_bootstrap.cc:654] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.581802 13188 leader_election.cc:290] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 election: Requested vote from peers fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.549124 13123 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 0.
I20260709 12:25:07.582748 13165 raft_consensus.cc:359] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.583734 13165 raft_consensus.cc:385] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.584188 13165 raft_consensus.cc:740] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.584512 12973 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.587178 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.588209 13122 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.594715 12935 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.595597 13165 consensus_queue.cc:260] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.596297 13188 raft_consensus.cc:2804] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.596683 13188 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.597031 13188 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.598258 13165 ts_tablet_manager.cc:1434] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:07.599467 13165 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.605999 13166 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.606609 13166 ts_tablet_manager.cc:1403] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.179s	user 0.061s	sys 0.083s
I20260709 12:25:07.609989 13166 raft_consensus.cc:359] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.610782 13166 raft_consensus.cc:385] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.611096 13166 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.611903 13166 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.614450 13166 ts_tablet_manager.cc:1434] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:07.605890 13188 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.617527 13166 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.616044 13170 raft_consensus.cc:493] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.618613 13170 raft_consensus.cc:515] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.625298 13164 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.625883 13164 ts_tablet_manager.cc:1403] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.021s
I20260709 12:25:07.627194 13166 tablet_bootstrap.cc:654] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.629444 13170 leader_election.cc:290] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.624505 13165 tablet_bootstrap.cc:654] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.637151 13123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.637631 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.631657 13188 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 election: Requested vote from peers b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.634119 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.638516 13121 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.638715 13048 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 0.
I20260709 12:25:07.634757 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.639945 13049 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 0.
I20260709 12:25:07.635258 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:07.635711 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:07.640811 13047 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.640870 13046 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.630059 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.642794 12973 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.645036 13011 leader_election.cc:304] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.646051 13170 raft_consensus.cc:2804] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.646435 13170 raft_consensus.cc:493] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.646786 13170 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.649158 13046 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 1.
I20260709 12:25:07.635854 13164 raft_consensus.cc:359] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.637921 13123 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.650043 13164 raft_consensus.cc:385] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.650592 13164 raft_consensus.cc:740] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.650727 12938 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.634178 13122 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 1.
I20260709 12:25:07.653364 13175 raft_consensus.cc:2804] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.654121 13121 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 1.
I20260709 12:25:07.655381 12935 leader_election.cc:304] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.660444 13188 raft_consensus.cc:2804] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.661003 13188 raft_consensus.cc:697] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 LEADER]: Becoming Leader. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Running, Role: LEADER
I20260709 12:25:07.661684 13047 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5186a51d648545d5ac77a4aab189a9a7 in term 1.
I20260709 12:25:07.661935 13188 consensus_queue.cc:237] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.661866 13164 consensus_queue.cc:260] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.669198 13164 ts_tablet_manager.cc:1434] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:25:07.672384 13175 raft_consensus.cc:697] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 LEADER]: Becoming Leader. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Running, Role: LEADER
I20260709 12:25:07.674175 13175 consensus_queue.cc:237] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:07.681339 13166 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.682195 13166 ts_tablet_manager.cc:1403] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.010s
I20260709 12:25:07.682672 13165 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.683259 13165 ts_tablet_manager.cc:1403] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.013s
I20260709 12:25:07.686892 13166 raft_consensus.cc:359] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.687005 13165 raft_consensus.cc:359] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.687883 13166 raft_consensus.cc:385] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.687970 13165 raft_consensus.cc:385] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.688475 13166 raft_consensus.cc:740] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.688562 13165 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.689679 13165 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.690405 13164 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.691882 13170 raft_consensus.cc:515] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.695082 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.695302 13165 ts_tablet_manager.cc:1434] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:07.695783 12973 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.697642 13165 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.697834 13166 consensus_queue.cc:260] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.700328 13166 ts_tablet_manager.cc:1434] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 12:25:07.701535 13166 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.703550 13164 tablet_bootstrap.cc:654] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.705413 13165 tablet_bootstrap.cc:654] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.713241 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.714612 13121 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.713817 13166 tablet_bootstrap.cc:654] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.713346 13170 leader_election.cc:290] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.724243 13165 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.724907 13165 ts_tablet_manager.cc:1403] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 12:25:07.711323 12973 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.726238 13164 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.727011 13164 ts_tablet_manager.cc:1403] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.014s
I20260709 12:25:07.727571 13011 leader_election.cc:304] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.728766 13170 raft_consensus.cc:2804] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.728530 13165 raft_consensus.cc:359] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.729491 13165 raft_consensus.cc:385] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.729847 13165 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.730618 13170 raft_consensus.cc:697] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:07.730859 13165 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.725870 13121 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.730870 13164 raft_consensus.cc:359] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.732280 13164 raft_consensus.cc:385] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.732472 13164 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.732970 13164 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.733671 13165 ts_tablet_manager.cc:1434] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:25:07.733299 13170 consensus_queue.cc:237] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.734350 13164 ts_tablet_manager.cc:1434] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:07.736738 13165 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.736982 13164 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.735769 13166 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.738300 13166 ts_tablet_manager.cc:1403] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.004s
I20260709 12:25:07.748221 13166 raft_consensus.cc:359] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.749066 13166 raft_consensus.cc:385] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.749395 13166 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.750329 13166 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.752802 13166 ts_tablet_manager.cc:1434] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:07.753880 13166 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.754279 13165 tablet_bootstrap.cc:654] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.756716 12868 catalog_manager.cc:5697] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "5186a51d648545d5ac77a4aab189a9a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.760742 13164 tablet_bootstrap.cc:654] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.768462 13166 tablet_bootstrap.cc:654] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.770000 13183 raft_consensus.cc:493] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.770756 13183 raft_consensus.cc:515] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.773865 13183 leader_election.cc:290] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.775475 13183 raft_consensus.cc:493] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.775743 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.775936 13183 raft_consensus.cc:515] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.777308 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.778036 13121 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.778724 13183 leader_election.cc:290] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
W20260709 12:25:07.780512 13011 leader_election.cc:343] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.781312 13011 leader_election.cc:304] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7
I20260709 12:25:07.786057 13169 raft_consensus.cc:493] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.786906 13169 raft_consensus.cc:515] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.788390 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.788839 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.789150 13121 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.789505 12973 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.788655 13165 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.789990 13169 leader_election.cc:290] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.786005 13164 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.790565 13165 ts_tablet_manager.cc:1403] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.008s
I20260709 12:25:07.790992 13164 ts_tablet_manager.cc:1403] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.010s
I20260709 12:25:07.791505 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.787043 12869 catalog_manager.cc:5697] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "5186a51d648545d5ac77a4aab189a9a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.792169 12973 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 0.
I20260709 12:25:07.793311 13086 leader_election.cc:304] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.794085 13169 raft_consensus.cc:2804] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.791522 13011 leader_election.cc:304] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.794703 13169 raft_consensus.cc:493] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.795140 13169 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.796352 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.797096 13047 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 0.
I20260709 12:25:07.797152 13211 raft_consensus.cc:2804] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.798202 13211 raft_consensus.cc:493] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.798703 13211 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.793548 13165 raft_consensus.cc:359] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.800246 13165 raft_consensus.cc:385] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.800575 13165 raft_consensus.cc:740] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.802977 13183 raft_consensus.cc:2804] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.803514 13183 raft_consensus.cc:493] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.803107 13165 consensus_queue.cc:260] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.803876 13183 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.810854 13169 raft_consensus.cc:515] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.793716 13164 raft_consensus.cc:359] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.813525 13164 raft_consensus.cc:385] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.813836 13164 raft_consensus.cc:740] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.814558 13164 consensus_queue.cc:260] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.814831 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.815429 12973 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.814587 12868 catalog_manager.cc:5697] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.821080 13183 raft_consensus.cc:515] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.823945 13165 ts_tablet_manager.cc:1434] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:25:07.825111 13165 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.825563 13164 ts_tablet_manager.cc:1434] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:25:07.809957 13212 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.828191 13166 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.827944 13212 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.828804 13166 ts_tablet_manager.cc:1403] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.010s
I20260709 12:25:07.831066 12973 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 1.
I20260709 12:25:07.834970 13164 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: Bootstrap starting.
I20260709 12:25:07.834856 13086 leader_election.cc:304] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.833563 13169 leader_election.cc:290] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.835458 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:07.836149 13169 raft_consensus.cc:2804] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.836369 13047 raft_consensus.cc:2393] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b672236b0eff4d3d9e3108044aad4348 in current term 1: Already voted for candidate fa4bce3f28c14c0f857d077a9c283c17 in this term.
I20260709 12:25:07.836772 13169 raft_consensus.cc:697] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:07.837035 13166 raft_consensus.cc:359] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.837844 13166 raft_consensus.cc:385] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.838199 13166 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.838014 13169 consensus_queue.cc:237] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.811201 13211 raft_consensus.cc:515] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.841290 13209 raft_consensus.cc:493] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.842161 13213 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.842962 13213 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.844200 13164 tablet_bootstrap.cc:654] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.846249 13212 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.846509 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.847282 12973 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 0.
I20260709 12:25:07.841922 13209 raft_consensus.cc:515] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.848286 12972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.849038 12972 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.849218 13086 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.849516 13166 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.849033 13165 tablet_bootstrap.cc:654] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.850730 13011 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.851811 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.852671 12972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.853240 13166 ts_tablet_manager.cc:1434] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 12:25:07.854457 13166 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.857620 13212 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.858165 13212 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.858613 13212 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.862402 13166 tablet_bootstrap.cc:654] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:07.862838 13011 leader_election.cc:343] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.852682 12973 raft_consensus.cc:2393] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fa4bce3f28c14c0f857d077a9c283c17 in current term 1: Already voted for candidate b672236b0eff4d3d9e3108044aad4348 in this term.
I20260709 12:25:07.856274 13183 leader_election.cc:290] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.868353 13165 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.869479 13165 ts_tablet_manager.cc:1403] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.000s
I20260709 12:25:07.873782 13165 raft_consensus.cc:359] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.875171 13169 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.875988 13169 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.876364 13169 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.876490 13215 raft_consensus.cc:493] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.877058 13215 raft_consensus.cc:515] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.882007 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.884188 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.884745 13165 raft_consensus.cc:385] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.885123 13165 raft_consensus.cc:740] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.885612 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
W20260709 12:25:07.887017 13089 leader_election.cc:343] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.885968 13165 consensus_queue.cc:260] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.888381 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.889056 13122 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.890751 13165 ts_tablet_manager.cc:1434] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:07.891207 13169 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.892055 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.892587 13121 raft_consensus.cc:2393] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa4bce3f28c14c0f857d077a9c283c17 in current term 1: Already voted for candidate b672236b0eff4d3d9e3108044aad4348 in this term.
I20260709 12:25:07.893079 12973 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.894958 13165 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: Bootstrap starting.
I20260709 12:25:07.896638 13215 leader_election.cc:290] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.901516 13164 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: No bootstrap required, opened a new log
I20260709 12:25:07.902227 13164 ts_tablet_manager.cc:1403] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 12:25:07.905642 13164 raft_consensus.cc:359] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.906507 13165 tablet_bootstrap.cc:654] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.906378 13164 raft_consensus.cc:385] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.907021 13164 raft_consensus.cc:740] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.885933 12866 catalog_manager.cc:5697] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 0 to 1, leader changed from <none> to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.907931 13164 consensus_queue.cc:260] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.910624 13164 ts_tablet_manager.cc:1434] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:07.896319 13211 leader_election.cc:290] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.915506 13122 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.918392 12972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:07.915992 13011 leader_election.cc:304] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:07.921054 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:07.921669 13213 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
W20260709 12:25:07.923108 13086 leader_election.cc:343] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.913717 13169 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:07.923532 13011 leader_election.cc:304] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:07.923839 12972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.924597 12972 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.924675 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:07.925856 13183 raft_consensus.cc:2749] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:07.926604 13183 raft_consensus.cc:2804] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.927240 13183 raft_consensus.cc:697] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:07.928104 13183 consensus_queue.cc:237] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.932682 13209 leader_election.cc:290] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.934134 12972 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 1.
I20260709 12:25:07.923660 13086 leader_election.cc:304] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348; no voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:07.937062 13169 raft_consensus.cc:2749] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:07.938833 13086 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:07.939695 13169 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.940199 13169 raft_consensus.cc:697] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:07.940227 12973 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.940490 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:07.935954 13212 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.942206 13122 raft_consensus.cc:2468] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:07.943822 13047 raft_consensus.cc:2393] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b672236b0eff4d3d9e3108044aad4348 in current term 1: Already voted for candidate fa4bce3f28c14c0f857d077a9c283c17 in this term.
I20260709 12:25:07.945554 13212 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.941162 13169 consensus_queue.cc:237] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.950701 13011 leader_election.cc:304] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7
I20260709 12:25:07.951326 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.951894 13183 raft_consensus.cc:2804] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:07.952333 13183 raft_consensus.cc:493] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.952508 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.952732 13183 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.953379 12973 raft_consensus.cc:2393] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fa4bce3f28c14c0f857d077a9c283c17 in current term 1: Already voted for candidate b672236b0eff4d3d9e3108044aad4348 in this term.
I20260709 12:25:07.954831 13011 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:07.956001 13212 raft_consensus.cc:2749] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:07.950541 12866 catalog_manager.cc:5697] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.964249 13166 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.964907 13166 ts_tablet_manager.cc:1403] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.000s
I20260709 12:25:07.965346 13183 raft_consensus.cc:515] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.964318 13165 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: No bootstrap required, opened a new log
I20260709 12:25:07.968119 13165 ts_tablet_manager.cc:1403] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.000s
I20260709 12:25:07.967832 13166 raft_consensus.cc:359] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.968514 13166 raft_consensus.cc:385] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.969198 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:07.968787 12869 catalog_manager.cc:5697] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 0 to 1, leader changed from <none> to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:07.970584 13011 leader_election.cc:343] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:07.968811 13166 raft_consensus.cc:740] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.971016 13165 raft_consensus.cc:359] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.971846 13165 raft_consensus.cc:385] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:07.972163 13165 raft_consensus.cc:740] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Initialized, Role: FOLLOWER
I20260709 12:25:07.971995 13166 consensus_queue.cc:260] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.972908 13165 consensus_queue.cc:260] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.976625 13166 ts_tablet_manager.cc:1434] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:07.977725 13166 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:07.978693 13183 leader_election.cc:290] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:07.979800 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:07.980484 13122 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:07.985119 13166 tablet_bootstrap.cc:654] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:07.985548 13165 ts_tablet_manager.cc:1434] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:07.991966 13122 raft_consensus.cc:2468] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:07.993919 13011 leader_election.cc:304] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7
I20260709 12:25:07.995792 13183 raft_consensus.cc:2804] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:07.995982 13166 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:07.996477 13183 raft_consensus.cc:697] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:07.996580 13166 ts_tablet_manager.cc:1403] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:25:07.997416 13183 consensus_queue.cc:237] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.999214 13166 raft_consensus.cc:359] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:07.999893 13166 raft_consensus.cc:385] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:08.000181 13166 raft_consensus.cc:740] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:08.000854 13166 consensus_queue.cc:260] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.004829 13166 ts_tablet_manager.cc:1434] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:08.006006 13166 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:08.006492 12868 catalog_manager.cc:5697] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.011752 13166 tablet_bootstrap.cc:654] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:08.016952 13166 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: No bootstrap required, opened a new log
I20260709 12:25:08.017499 13166 ts_tablet_manager.cc:1403] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:25:08.019652 13166 raft_consensus.cc:359] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.020177 13166 raft_consensus.cc:385] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:08.020406 13166 raft_consensus.cc:740] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:08.020934 13166 consensus_queue.cc:260] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.022432 13166 ts_tablet_manager.cc:1434] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:08.068595 13183 raft_consensus.cc:493] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.069231 13183 raft_consensus.cc:515] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.069591 13212 raft_consensus.cc:493] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.070124 13212 raft_consensus.cc:515] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.071633 13183 leader_election.cc:290] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:08.072192 13212 leader_election.cc:290] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:08.072691 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:08.072974 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:08.073482 12973 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:08.073705 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:08.073700 13122 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:08.074532 13121 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:08.075724 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7" is_pre_election: true
I20260709 12:25:08.075755 13011 leader_election.cc:304] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:08.076323 12973 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 0.
I20260709 12:25:08.077136 13212 raft_consensus.cc:2804] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:08.077571 13212 raft_consensus.cc:493] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.077339 13175 consensus_queue.cc:1048] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:08.077680 13011 leader_election.cc:304] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:08.077973 13212 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.078667 13183 raft_consensus.cc:2804] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:08.079058 13183 raft_consensus.cc:493] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.079399 13183 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.086318 13212 raft_consensus.cc:515] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.088193 13183 raft_consensus.cc:515] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.089428 12973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:08.090301 12973 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.090600 13183 leader_election.cc:290] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:08.092736 12972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:08.093080 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:08.093452 12972 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.093866 13122 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.095315 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:08.096086 13121 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:08.100243 13212 leader_election.cc:290] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:08.104825 13122 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:08.106523 13011 leader_election.cc:304] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:08.107841 12973 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:08.109825 12972 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:08.108898 13121 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:08.110674 13011 leader_election.cc:304] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:08.111299 13212 raft_consensus.cc:2804] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:08.116164 13212 raft_consensus.cc:697] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:08.116307 13209 raft_consensus.cc:2804] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:08.116928 13209 raft_consensus.cc:697] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:08.117811 13209 consensus_queue.cc:237] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.118292 13170 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.123383 13200 consensus_queue.cc:1048] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:08.124169 13175 consensus_queue.cc:1048] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.131798 13211 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.123271 13212 consensus_queue.cc:237] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:08.140671 13188 consensus_queue.cc:1048] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:08.157415 12868 catalog_manager.cc:5697] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.160008 12868 catalog_manager.cc:5697] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.233834 13212 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.246667 13212 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.257901 13169 consensus_queue.cc:1048] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.270138 13213 consensus_queue.cc:1048] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.378818  2677 ts_manager.cc:295] Set tserver state for 5186a51d648545d5ac77a4aab189a9a7 to MAINTENANCE_MODE
I20260709 12:25:08.379817  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
I20260709 12:25:08.382123 13212 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:08.398159 13209 consensus_queue.cc:1048] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:25:08.402225 13011 consensus_peers.cc:597] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.417371 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:08.424383  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:08.428633  2677 tablet_replica.cc:333] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.429412  2677 raft_consensus.cc:2243] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.430145  2677 raft_consensus.cc:2272] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.428256 13011 consensus_peers.cc:597] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.433889  2677 tablet_replica.cc:333] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.434875  2677 raft_consensus.cc:2243] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.435400  2677 raft_consensus.cc:2272] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.438232  2677 tablet_replica.cc:333] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.438902  2677 raft_consensus.cc:2243] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.439390  2677 raft_consensus.cc:2272] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.442041  2677 tablet_replica.cc:333] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.442963  2677 raft_consensus.cc:2243] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.443550  2677 raft_consensus.cc:2272] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.446379  2677 tablet_replica.cc:333] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.447003  2677 raft_consensus.cc:2243] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.447420  2677 raft_consensus.cc:2272] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.450187  2677 tablet_replica.cc:333] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.450939  2677 raft_consensus.cc:2243] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.452189  2677 raft_consensus.cc:2272] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.454195 13213 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:08.454995  2677 tablet_replica.cc:333] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.455802  2677 raft_consensus.cc:2243] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.456318  2677 raft_consensus.cc:2272] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.459201  2677 tablet_replica.cc:333] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.460131  2677 raft_consensus.cc:2243] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.461350  2677 raft_consensus.cc:2272] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.465315  2677 tablet_replica.cc:333] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.466233  2677 raft_consensus.cc:2243] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.466949  2677 raft_consensus.cc:2272] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.472599  2677 tablet_replica.cc:333] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: stopping tablet replica
I20260709 12:25:08.473318  2677 raft_consensus.cc:2243] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.473901  2677 raft_consensus.cc:2272] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.476881 13086 consensus_peers.cc:597] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.509464  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
W20260709 12:25:08.520892 13011 consensus_peers.cc:597] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.648219 13011 consensus_peers.cc:597] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:08.649113 13086 consensus_peers.cc:597] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.653301 13170 consensus_queue.cc:1048] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:08.668799 13011 consensus_peers.cc:597] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.700820 13211 consensus_queue.cc:1048] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:08.823926 13011 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:09.418699 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:09.495312 13086 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111) [suppressed 138 similar messages]
I20260709 12:25:09.597798 13217 raft_consensus.cc:493] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
I20260709 12:25:09.598614 13217 raft_consensus.cc:515] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:09.601295 13217 leader_election.cc:290] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:09.603199 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
W20260709 12:25:09.605522 13086 leader_election.cc:336] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.606462 13089 leader_election.cc:304] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348; no voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:09.607306 13217 raft_consensus.cc:2749] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:09.631292 13211 raft_consensus.cc:493] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
I20260709 12:25:09.632098 13211 raft_consensus.cc:515] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:09.634217 13211 leader_election.cc:290] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:09.636086 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:09.636785 13122 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 1.
I20260709 12:25:09.637794 13211 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
I20260709 12:25:09.638579 13011 leader_election.cc:304] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:09.638649 13211 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
W20260709 12:25:09.639708 13011 leader_election.cc:336] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.639799 13212 raft_consensus.cc:2804] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:09.640316 13212 raft_consensus.cc:493] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
I20260709 12:25:09.640673 13212 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.641281 13211 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361), 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965)
I20260709 12:25:09.642066 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:09.645493 13217 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
W20260709 12:25:09.645660 13011 leader_election.cc:336] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.646279 13217 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:09.646407 13011 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:09.647505 13211 raft_consensus.cc:2749] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:09.648557 13217 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:09.649822 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:09.650610 13047 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 1.
I20260709 12:25:09.651924 13089 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
W20260709 12:25:09.652583 13086 leader_election.cc:336] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.652798 13217 raft_consensus.cc:2804] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:09.653349 13217 raft_consensus.cc:493] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5186a51d648545d5ac77a4aab189a9a7)
I20260709 12:25:09.653743 13217 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.653991 13212 raft_consensus.cc:515] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:09.656149 13212 leader_election.cc:290] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:09.657778 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43261a62955e4a0b9f8b5629b4842db6" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:09.658545 13122 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:09.660787 13011 leader_election.cc:336] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.661904 13217 raft_consensus.cc:515] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:09.664166 13217 leader_election.cc:290] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:09.665412 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ccd48ead33c4938a7b644536fc8ee4c" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:09.666253 13047 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.670094 13122 raft_consensus.cc:2468] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 2.
W20260709 12:25:09.670354 13086 leader_election.cc:336] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111)
I20260709 12:25:09.671913 13011 leader_election.cc:304] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7
I20260709 12:25:09.672655 13212 raft_consensus.cc:2804] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.673167 13212 raft_consensus.cc:697] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:09.674355 13212 consensus_queue.cc:237] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:09.675997 13047 raft_consensus.cc:2468] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:09.680826 13089 leader_election.cc:304] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17; no voters: 5186a51d648545d5ac77a4aab189a9a7
I20260709 12:25:09.681674 13217 raft_consensus.cc:2804] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.682921 13217 raft_consensus.cc:697] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:09.683954 12868 catalog_manager.cc:5697] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 1 to 2, leader changed from 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.685032 13217 consensus_queue.cc:237] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:09.697280 12869 catalog_manager.cc:5697] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.078079 13047 raft_consensus.cc:1275] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.079917 13253 consensus_queue.cc:1048] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:10.094506 13086 consensus_peers.cc:597] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:10.209849 13122 raft_consensus.cc:1275] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.211192 13212 consensus_queue.cc:1048] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:10.227180 13011 consensus_peers.cc:597] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:10.419803 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:10.784258 13011 consensus_peers.cc:597] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:10.808385 13086 consensus_peers.cc:597] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:10.819500 13086 consensus_peers.cc:597] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:10.930933 13011 consensus_peers.cc:597] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:10.997565 13011 consensus_peers.cc:597] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:11.201527 13011 consensus_peers.cc:597] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:11.313273 13011 consensus_peers.cc:597] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:11.335259 13011 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:11.420881 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:12.421993 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:12.636602 13086 consensus_peers.cc:597] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:12.699395 13011 consensus_peers.cc:597] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:13.306795 13011 consensus_peers.cc:597] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:13.312216 13011 consensus_peers.cc:597] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:13.344206 13086 consensus_peers.cc:597] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:13.379547 13086 consensus_peers.cc:597] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:13.422952 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:13.503301 13011 consensus_peers.cc:597] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:13.588300  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:13.597163 13270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:13.597427 13271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:13.601928  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:13.602912 13273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:13.604254  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:13.604547  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:13.604756  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599913604733 us; error 0 us; skew 500 ppm
I20260709 12:25:13.605386  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:13.608572  2677 webserver.cc:533] Webserver started at http://127.2.157.65:46103/ using document root <none> and password file <none>
I20260709 12:25:13.609165  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:13.609383  2677 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:25:13.613767  2677 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:13.618569 13278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:13.619647  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:25:13.620007  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "5186a51d648545d5ac77a4aab189a9a7"
format_stamp: "Formatted at 2026-07-09 12:25:06 on dist-test-slave-sx71"
I20260709 12:25:13.620424  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:13.633071  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:13.634519  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:13.636277  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:13.640614 13285 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:25:13.704679  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:25:13.705224  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.000s	sys 0.003s
I20260709 12:25:13.705740  2677 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 12:25:13.707774 13011 consensus_peers.cc:597] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:13.714270 13285 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.730931 13285 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.731899 13285 tablet_bootstrap.cc:492] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.732507 13285 ts_tablet_manager.cc:1403] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:25:13.734791 13285 raft_consensus.cc:359] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.735392 13285 raft_consensus.cc:740] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.736207 13285 consensus_queue.cc:260] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.738674 13285 ts_tablet_manager.cc:1434] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:13.739523 13285 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.755931 13285 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.757153 13285 tablet_bootstrap.cc:492] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.757956 13285 ts_tablet_manager.cc:1403] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
W20260709 12:25:13.759904 13011 consensus_peers.cc:597] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:13.761118  2677 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:25:13.760885 13285 raft_consensus.cc:359] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.761444  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.056s	user 0.053s	sys 0.000s
I20260709 12:25:13.761639 13285 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.762544 13285 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.764350 13285 ts_tablet_manager.cc:1434] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:13.765162 13285 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.781507 13285 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.782418 13285 tablet_bootstrap.cc:492] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.783172 13285 ts_tablet_manager.cc:1403] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:25:13.785992 13285 raft_consensus.cc:359] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.786631 13285 raft_consensus.cc:740] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.787436 13285 consensus_queue.cc:260] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.789419 13285 ts_tablet_manager.cc:1434] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:13.790230 13285 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.803807 13285 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.804790 13285 tablet_bootstrap.cc:492] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.805449 13285 ts_tablet_manager.cc:1403] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:25:13.808013 13285 raft_consensus.cc:359] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.808666 13285 raft_consensus.cc:740] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.809538 13285 consensus_queue.cc:260] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.812165 13285 ts_tablet_manager.cc:1434] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:13.813025 13285 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.827929 13285 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.829016 13285 tablet_bootstrap.cc:492] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.829875 13285 ts_tablet_manager.cc:1403] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:25:13.831349  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:40965
I20260709 12:25:13.831578 13348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:40965 every 8 connection(s)
I20260709 12:25:13.832731 13285 raft_consensus.cc:359] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.833390 13285 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.834162 13285 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.836279 13285 ts_tablet_manager.cc:1434] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:13.837201 13285 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.850085  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.864038 13322 raft_consensus.cc:3060] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:13.864404 13011 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:13.873389 13285 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.875067 13285 tablet_bootstrap.cc:492] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.875967 13285 ts_tablet_manager.cc:1403] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.012s
I20260709 12:25:13.887598 13285 raft_consensus.cc:359] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:13.889865 13285 raft_consensus.cc:740] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.893491 13285 consensus_queue.cc:260] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } } peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } }
I20260709 12:25:13.895265 13349 heartbeater.cc:344] Connected to a master server at 127.2.157.126:32979
I20260709 12:25:13.895553 13323 raft_consensus.cc:3060] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:13.895895 13349 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:13.896500 13285 ts_tablet_manager.cc:1434] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:13.897143 13349 heartbeater.cc:507] Master 127.2.157.126:32979 requested a full tablet report, sending...
I20260709 12:25:13.897559 13285 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.917738 13047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:13.918641 13047 raft_consensus.cc:606] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:13.921754 13285 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.922959 13285 tablet_bootstrap.cc:492] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.922783 13047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:13.923854 13285 ts_tablet_manager.cc:1403] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 12:25:13.923656 13047 raft_consensus.cc:606] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:13.926188 12869 ts_manager.cc:194] Re-registered known tserver with Master: 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965)
I20260709 12:25:13.927318 13285 raft_consensus.cc:359] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.927699 13047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd769e3b22764149a64442215d813423"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:13.928105 13285 raft_consensus.cc:740] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.928331 13047 raft_consensus.cc:606] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:13.929075 13285 consensus_queue.cc:260] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.929693  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:13.930435  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.931054  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.931473 13285 ts_tablet_manager.cc:1434] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:13.932449 13285 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.942703 12869 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52992
I20260709 12:25:13.946588 13349 heartbeater.cc:499] Master 127.2.157.126:32979 was elected leader, sending a full tablet report...
I20260709 12:25:13.946694 13285 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.947610 13285 tablet_bootstrap.cc:492] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.948302 13285 ts_tablet_manager.cc:1403] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 12:25:13.950865 13285 raft_consensus.cc:359] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.951578 13285 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.952314 13285 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.954485 13285 ts_tablet_manager.cc:1434] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:25:13.955396 13285 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.970238 13285 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.971240 13285 tablet_bootstrap.cc:492] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.972095 13285 ts_tablet_manager.cc:1403] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:25:13.974717 13285 raft_consensus.cc:359] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.975287 13285 raft_consensus.cc:385] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:13.975672 13285 raft_consensus.cc:740] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:13.976389 13285 consensus_queue.cc:260] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.978412 13285 ts_tablet_manager.cc:1434] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:25:13.979583 13285 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap starting.
I20260709 12:25:13.996800 13287 raft_consensus.cc:493] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.997080 13285 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:13.997478 13287 raft_consensus.cc:515] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:13.998162 13285 tablet_bootstrap.cc:492] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Bootstrap complete.
I20260709 12:25:13.998905 13285 ts_tablet_manager.cc:1403] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:25:14.000052 13287 leader_election.cc:290] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:14.002100 13285 raft_consensus.cc:359] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.003044 13285 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5186a51d648545d5ac77a4aab189a9a7, State: Initialized, Role: FOLLOWER
I20260709 12:25:14.004144 13285 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.018671 13285 ts_tablet_manager.cc:1434] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7: Time spent starting tablet: real 0.019s	user 0.019s	sys 0.004s
I20260709 12:25:14.018692 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17" is_pre_election: true
I20260709 12:25:14.029794 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "5186a51d648545d5ac77a4aab189a9a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b672236b0eff4d3d9e3108044aad4348" is_pre_election: true
I20260709 12:25:14.031642 13279 leader_election.cc:304] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7; no voters: b672236b0eff4d3d9e3108044aad4348, fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:14.032639 13367 raft_consensus.cc:2749] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:14.167382 13263 raft_consensus.cc:993] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.168042 13269 raft_consensus.cc:1081] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.169616 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:14.170115 13122 raft_consensus.cc:493] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.170372 13122 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.175995 13122 raft_consensus.cc:515] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.177651 13122 leader_election.cc:290] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:14.178736 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:14.178752 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:14.179522 13323 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.179683 13047 raft_consensus.cc:3055] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:14.180084 13047 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:14.181130 13047 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.182350 13047 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.185472 13323 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.186714 13086 leader_election.cc:304] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:14.187729 13357 raft_consensus.cc:2804] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:14.188210 13357 raft_consensus.cc:697] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:14.188514 13047 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.189263 13357 consensus_queue.cc:237] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.198364 12869 catalog_manager.cc:5697] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.210794 13323 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:14.322417 13144 debug-util.cc:398] Leaking SignalData structure 0x7b08001baec0 after lost signal to thread 2680
I20260709 12:25:14.371666 13263 raft_consensus.cc:993] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.372296 13269 raft_consensus.cc:1081] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.374181 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd769e3b22764149a64442215d813423"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:14.374703 13122 raft_consensus.cc:493] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.375003 13122 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.383270 13122 raft_consensus.cc:515] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.394492 13322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:14.395267 13322 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.394519 13122 leader_election.cc:290] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:14.405532 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd769e3b22764149a64442215d813423" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:14.406490 13047 raft_consensus.cc:3055] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:14.406890 13047 raft_consensus.cc:740] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:14.408314 13322 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.409387 13047 consensus_queue.cc:260] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.410048 13086 leader_election.cc:304] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:14.411083 13357 raft_consensus.cc:2804] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:14.411360 13047 raft_consensus.cc:3060] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.411612 13357 raft_consensus.cc:697] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:14.412853 13357 consensus_queue.cc:237] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.418633 13269 raft_consensus.cc:993] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.419345 13269 raft_consensus.cc:1081] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:14.421941 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:14.423782 13122 raft_consensus.cc:493] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:25:14.424150 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:14.424326 13122 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.426581 13047 raft_consensus.cc:2468] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.439085 13122 raft_consensus.cc:515] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.440025 12868 catalog_manager.cc:5697] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.442592 13322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:14.443336 13322 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.452632 13122 leader_election.cc:290] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:14.454499 13047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:14.455250 13047 raft_consensus.cc:3055] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:14.455281 13322 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.455826 13047 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:14.456751 13086 leader_election.cc:304] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:14.456964 13047 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.457919 13357 raft_consensus.cc:2804] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:14.458550 13357 raft_consensus.cc:697] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:14.459522 13047 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:14.459867 13357 consensus_queue.cc:237] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:14.470546 13047 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:14.470691 12868 catalog_manager.cc:5697] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.653911 13322 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.655476 13357 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:14.672837 13047 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.685084 13357 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:14.842170 13047 raft_consensus.cc:1275] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.843627 13383 consensus_queue.cc:1048] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:14.847611 13322 raft_consensus.cc:1275] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.849650 13383 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:14.857556 13323 raft_consensus.cc:1275] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.860463 13383 consensus_queue.cc:1048] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:14.870548 13047 raft_consensus.cc:1275] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:14.872512 13383 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:14.939719  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.965327 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:14.966033 13122 raft_consensus.cc:606] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:14.969002 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:14.969565 13046 raft_consensus.cc:606] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:14.974033 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:14.974694 13122 raft_consensus.cc:606] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:14.976387  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:14.977182  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:14.978207  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.267694 13357 raft_consensus.cc:993] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:15.268185 13383 raft_consensus.cc:1081] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:15.270152 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:15.270722 13046 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.271061 13046 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.279430 13046 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.281315 13046 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:15.282301 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:15.282506 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:15.282927 13323 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.283187 13122 raft_consensus.cc:3055] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:15.283630 13122 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:15.284508 13122 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.285897 13122 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.289322 13323 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 2.
I20260709 12:25:15.290616 13011 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:15.291359 13269 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:15.292529 13269 raft_consensus.cc:697] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:15.293637 13269 consensus_queue.cc:237] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.293828 13122 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 2.
I20260709 12:25:15.306802 12868 catalog_manager.cc:5697] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 1 to 2, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.384075 13269 raft_consensus.cc:993] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:15.384722 13392 raft_consensus.cc:1081] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:15.386322 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:15.386888 13122 raft_consensus.cc:493] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.387225 13122 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.393608 13122 raft_consensus.cc:515] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.395290 13122 leader_election.cc:290] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:15.396256 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:15.396406 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a65807ef8b4f929c3e1d6988726e71" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:15.397284 13046 raft_consensus.cc:3055] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:15.397222 13323 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.397825 13046 raft_consensus.cc:740] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:15.398777 13046 consensus_queue.cc:260] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.400142 13046 raft_consensus.cc:3060] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.405616 13323 raft_consensus.cc:2468] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:15.407014 13086 leader_election.cc:304] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:15.407932 13384 raft_consensus.cc:2804] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:15.408313 13046 raft_consensus.cc:2468] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:15.408537 13384 raft_consensus.cc:697] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:15.409816 13384 consensus_queue.cc:237] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.419034 12868 catalog_manager.cc:5697] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:15.425359 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:15.432686 13383 raft_consensus.cc:993] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:15.433320 13384 raft_consensus.cc:1081] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:15.435079 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:15.435802 13046 raft_consensus.cc:493] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.436233 13046 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.446491 13046 raft_consensus.cc:515] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.449129 13046 leader_election.cc:290] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:15.449900 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:15.450668 13323 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.450747 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da17cc8b61c84b9fbf3efab275b9e6fb" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:15.451370 13122 raft_consensus.cc:3055] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:15.451751 13122 raft_consensus.cc:740] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:15.452589 13122 consensus_queue.cc:260] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.453917 13122 raft_consensus.cc:3060] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:15.459239 13323 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 2.
I20260709 12:25:15.460863 13011 leader_election.cc:304] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:15.461768 13392 raft_consensus.cc:2804] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:15.462059 13122 raft_consensus.cc:2468] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 2.
I20260709 12:25:15.462303 13392 raft_consensus.cc:697] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:15.463403 13392 consensus_queue.cc:237] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:15.473441 12868 catalog_manager.cc:5697] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 1 to 2, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:15.837782 13122 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.839192 13392 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.866324 13323 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.870070 13392 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:15.878005 13323 raft_consensus.cc:1275] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.879521 13400 consensus_queue.cc:1048] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.901706 13122 raft_consensus.cc:1275] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.905267 13269 consensus_queue.cc:1048] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.954782 13323 raft_consensus.cc:1275] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.956667 13384 consensus_queue.cc:1048] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:15.969607 13046 raft_consensus.cc:1275] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:15.978722 13410 consensus_queue.cc:1048] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:15.990201  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.007063 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:16.007843 13122 raft_consensus.cc:606] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:16.011281 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:16.011981 13046 raft_consensus.cc:606] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:16.014942 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:16.015683 13046 raft_consensus.cc:606] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:16.016959  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:16.017729  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.018548  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.312635 13400 raft_consensus.cc:993] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:16.313266 13392 raft_consensus.cc:1081] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:16.315093 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:16.315825 13122 raft_consensus.cc:493] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.316246 13122 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.325671 13122 raft_consensus.cc:515] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.328178 13122 leader_election.cc:290] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:16.329187 13320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:16.329488 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:16.329963 13320 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.330090 13046 raft_consensus.cc:3055] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.330518 13046 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:16.331554 13046 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.332991 13046 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.341264 13320 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:16.343339 13046 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:16.344269 13086 leader_election.cc:304] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:16.345278 13384 raft_consensus.cc:2804] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.345889 13384 raft_consensus.cc:697] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:16.346300 13400 raft_consensus.cc:993] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:16.346921 13400 raft_consensus.cc:1081] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:16.346881 13384 consensus_queue.cc:237] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.349301 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:16.349879 13122 raft_consensus.cc:493] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.350229 13122 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.361776 13122 raft_consensus.cc:515] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.363404 12869 catalog_manager.cc:5697] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.365969 13320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:16.366932 13122 leader_election.cc:290] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:16.367085 13320 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.366189 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1574c45c8cb4bb5a6e63936927b4b12" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:16.369585 13046 raft_consensus.cc:3055] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:16.370121 13046 raft_consensus.cc:740] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:16.371634 13046 consensus_queue.cc:260] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.375200 13046 raft_consensus.cc:3060] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:16.384435 13320 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:16.386488 13086 leader_election.cc:304] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:16.387570 13384 raft_consensus.cc:2804] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:16.388139 13384 raft_consensus.cc:697] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:16.389184 13384 consensus_queue.cc:237] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.410554 13046 raft_consensus.cc:2468] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 2.
I20260709 12:25:16.421075 13411 raft_consensus.cc:993] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:16.421676 13411 raft_consensus.cc:1081] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:16.424467 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:16.425115 13046 raft_consensus.cc:493] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:16.425518 13046 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:16.428596 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:16.433693 13046 raft_consensus.cc:515] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.433799 12869 catalog_manager.cc:5697] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 1 to 2, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 2 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.436340 13046 leader_election.cc:290] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:16.437368 13320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:16.438254 13320 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:16.438437 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7afab10799e04fcbb73fe19b2feb7c23" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:16.439320 13122 raft_consensus.cc:3055] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:16.439656 13122 raft_consensus.cc:740] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:16.440459 13122 consensus_queue.cc:260] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.441717 13122 raft_consensus.cc:3060] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:16.448494 13320 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:16.450174 13122 raft_consensus.cc:2468] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:16.451370 13011 leader_election.cc:304] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:16.452527 13269 raft_consensus.cc:2804] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:16.453138 13269 raft_consensus.cc:697] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:16.454182 13269 consensus_queue.cc:237] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:16.466130 12869 catalog_manager.cc:5697] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 2 to 3, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.801885 13046 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.803535 13410 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:16.819775 13320 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.821768 13410 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:16.830605 13046 raft_consensus.cc:1275] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:16.833349 13410 consensus_queue.cc:1048] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:16.847095 13323 raft_consensus.cc:1275] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:16.849752 13400 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.029697  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.048858 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:17.049525 13122 raft_consensus.cc:606] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:17.058319 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:17.059016 13046 raft_consensus.cc:606] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:17.060537 13321 raft_consensus.cc:1275] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:17.062847 13384 consensus_queue.cc:1048] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:17.066704 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:17.067396 13122 raft_consensus.cc:606] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:17.076654 13121 raft_consensus.cc:1275] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.084041  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:17.085995  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.086907  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:17.127810 13011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:40965, user_credentials={real_user=slave}} blocked reactor thread for 52395.7us
I20260709 12:25:17.135308 13400 raft_consensus.cc:993] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:17.135841 13400 raft_consensus.cc:1081] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:17.137784 13269 consensus_queue.cc:1048] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:17.145344 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:17.145980 13122 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.146324 13122 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.148689 13384 raft_consensus.cc:993] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:17.149252 13384 raft_consensus.cc:1081] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:17.153319 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:17.153990 13046 raft_consensus.cc:493] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.154419 13046 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.163127 13046 raft_consensus.cc:515] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.166945 13046 leader_election.cc:290] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:17.168958 13122 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.170804 13122 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 3 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:17.172240 13320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:17.172988 13320 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.176987 13321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:17.177742 13321 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.179293 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:17.180203 13046 raft_consensus.cc:3055] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:17.180599 13046 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:17.180974 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:17.181638 13122 raft_consensus.cc:3055] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:17.181538 13046 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.182966 13046 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.187896 13320 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 3.
I20260709 12:25:17.188843 13323 raft_consensus.cc:1240] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Rejecting Update request from peer fa4bce3f28c14c0f857d077a9c283c17 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:17.182158 13122 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:17.190241 13122 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.191761 13086 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:17.193323 13411 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:17.193828 13411 raft_consensus.cc:697] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:17.194727 13411 consensus_queue.cc:237] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.200215 13046 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 3.
I20260709 12:25:17.202730 13321 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:17.203584 13122 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.206055 13011 leader_election.cc:304] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:17.207412 13427 raft_consensus.cc:2804] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:17.208006 13427 raft_consensus.cc:697] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:17.208940 13427 consensus_queue.cc:237] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.212402 13122 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:17.213896 12868 catalog_manager.cc:5697] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 2 to 3, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 3 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.227037 12869 catalog_manager.cc:5697] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 2 to 3, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.276485 13384 raft_consensus.cc:993] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:17.277065 13411 raft_consensus.cc:1081] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:17.279069 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:17.279852 13046 raft_consensus.cc:493] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.280339 13046 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.290268 13046 raft_consensus.cc:515] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.293538 13046 leader_election.cc:290] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:17.293872 13321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:17.294596 13321 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.295907 13122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:17.296628 13122 raft_consensus.cc:3055] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:17.296976 13122 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:17.297935 13122 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.299487 13122 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:17.306231 13321 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:17.308059 13011 leader_election.cc:304] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:17.309072 13427 raft_consensus.cc:2804] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:17.309564 13427 raft_consensus.cc:697] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:17.310431 13427 consensus_queue.cc:237] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:17.312376 13122 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 3.
I20260709 12:25:17.319943 12869 catalog_manager.cc:5697] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 2 to 3, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 3 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:17.429749 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:17.617832 13046 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.619484 13411 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.633651 13320 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.638383 13384 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:17.700776 13320 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.702343 13427 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.717429 13122 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.721190 13443 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:17.860325 13320 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.862159 13427 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:17.874925 13122 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:17.876838 13443 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:25:18.069216 13345 debug-util.cc:398] Leaking SignalData structure 0x7b080026a520 after lost signal to thread 2680
W20260709 12:25:18.070502 13345 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf880 after lost signal to thread 12904
W20260709 12:25:18.071867 13345 debug-util.cc:398] Leaking SignalData structure 0x7b080018c780 after lost signal to thread 13073
W20260709 12:25:18.073017 13345 debug-util.cc:398] Leaking SignalData structure 0x7b080015a940 after lost signal to thread 13147
W20260709 12:25:18.074265 13345 debug-util.cc:398] Leaking SignalData structure 0x7b0800259540 after lost signal to thread 13348
I20260709 12:25:18.112432  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.121042 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:18.121838 13046 raft_consensus.cc:606] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:18.125136 13122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
mode: GRACEFUL
new_leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:36416
I20260709 12:25:18.125916 13122 raft_consensus.cc:606] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 LEADER]: Received request to transfer leadership to TS fa4bce3f28c14c0f857d077a9c283c17
I20260709 12:25:18.128926 13046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
mode: GRACEFUL
new_leader_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:51998
I20260709 12:25:18.129685 13046 raft_consensus.cc:606] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Received request to transfer leadership to TS b672236b0eff4d3d9e3108044aad4348
I20260709 12:25:18.131105  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:18.131737  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.132382  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.160813 13447 raft_consensus.cc:993] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: : Instructing follower fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:18.161499 13384 raft_consensus.cc:1081] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 LEADER]: Signalling peer fa4bce3f28c14c0f857d077a9c283c17 to start an election
I20260709 12:25:18.162243 13443 raft_consensus.cc:993] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:18.162828 13443 raft_consensus.cc:1081] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:18.163977 13046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026"
dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
 from {username='slave'} at 127.0.0.1:52322
I20260709 12:25:18.164654 13046 raft_consensus.cc:493] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.164740 13122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:18.165064 13046 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.165411 13122 raft_consensus.cc:493] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.165787 13122 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.173164 13046 raft_consensus.cc:515] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.173185 13122 raft_consensus.cc:515] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.175707 13046 leader_election.cc:290] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 4 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), b672236b0eff4d3d9e3108044aad4348 (127.2.157.67:46361)
I20260709 12:25:18.177346 13320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:18.178113 13320 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.178567 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b3d5ce26784132942656cefa6d6026" candidate_uuid: "fa4bce3f28c14c0f857d077a9c283c17" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
I20260709 12:25:18.179224 13121 raft_consensus.cc:3055] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:18.179735 13121 raft_consensus.cc:740] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:18.182376 13122 leader_election.cc:290] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 4 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:18.180683 13121 consensus_queue.cc:260] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.184365 13121 raft_consensus.cc:3060] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.185554 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:18.186349 13323 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.193430 13320 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 4.
I20260709 12:25:18.184264 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0d87f489444810b4f161d5c7523081" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:18.194437 13046 raft_consensus.cc:3055] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:18.194854 13046 raft_consensus.cc:740] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:18.195153 13323 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 4.
I20260709 12:25:18.195957 13011 leader_election.cc:304] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, fa4bce3f28c14c0f857d077a9c283c17; no voters: 
I20260709 12:25:18.195847 13046 consensus_queue.cc:260] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.196606 13086 leader_election.cc:304] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:18.197414 13046 raft_consensus.cc:3060] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.197644 13443 raft_consensus.cc:2804] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:18.197799 13446 raft_consensus.cc:2804] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:18.198349 13443 raft_consensus.cc:697] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 LEADER]: Becoming Leader. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:18.198424 13446 raft_consensus.cc:697] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 4 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:18.199433 13446 consensus_queue.cc:237] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.199436 13443 consensus_queue.cc:237] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.202461 13121 raft_consensus.cc:2468] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4bce3f28c14c0f857d077a9c283c17 in term 4.
I20260709 12:25:18.208492 13046 raft_consensus.cc:2468] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 4.
I20260709 12:25:18.210065 12869 catalog_manager.cc:5697] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 3 to 4, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.213847 12868 catalog_manager.cc:5697] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 reported cstate change: term changed from 3 to 4, leader changed from b672236b0eff4d3d9e3108044aad4348 (127.2.157.67) to fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66). New cstate: current_term: 4 leader_uuid: "fa4bce3f28c14c0f857d077a9c283c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:18.430747 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:18.448480 13427 raft_consensus.cc:993] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: : Instructing follower b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:18.449177 13400 raft_consensus.cc:1081] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Signalling peer b672236b0eff4d3d9e3108044aad4348 to start an election
I20260709 12:25:18.451012 13121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05"
dest_uuid: "b672236b0eff4d3d9e3108044aad4348"
 from {username='slave'} at 127.0.0.1:34966
I20260709 12:25:18.451732 13121 raft_consensus.cc:493] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.452131 13121 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.458449 13121 raft_consensus.cc:515] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.460407 13121 leader_election.cc:290] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 4 election: Requested vote from peers 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965), fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365)
I20260709 12:25:18.461555 13323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5186a51d648545d5ac77a4aab189a9a7"
I20260709 12:25:18.461556 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef676c5cb154626bb00f403a8fd3d05" candidate_uuid: "b672236b0eff4d3d9e3108044aad4348" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fa4bce3f28c14c0f857d077a9c283c17"
I20260709 12:25:18.462481 13323 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.462951 13046 raft_consensus.cc:3055] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:18.463425 13046 raft_consensus.cc:740] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa4bce3f28c14c0f857d077a9c283c17, State: Running, Role: LEADER
I20260709 12:25:18.464334 13046 consensus_queue.cc:260] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.465828 13046 raft_consensus.cc:3060] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.469252 13323 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 4.
I20260709 12:25:18.470579 13086 leader_election.cc:304] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5186a51d648545d5ac77a4aab189a9a7, b672236b0eff4d3d9e3108044aad4348; no voters: 
I20260709 12:25:18.471549 13447 raft_consensus.cc:2804] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:18.472113 13447 raft_consensus.cc:697] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 4 LEADER]: Becoming Leader. State: Replica: b672236b0eff4d3d9e3108044aad4348, State: Running, Role: LEADER
I20260709 12:25:18.472951 13447 consensus_queue.cc:237] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } }
I20260709 12:25:18.474432 13046 raft_consensus.cc:2468] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b672236b0eff4d3d9e3108044aad4348 in term 4.
I20260709 12:25:18.480572 12868 catalog_manager.cc:5697] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 reported cstate change: term changed from 3 to 4, leader changed from fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66) to b672236b0eff4d3d9e3108044aad4348 (127.2.157.67). New cstate: current_term: 4 leader_uuid: "b672236b0eff4d3d9e3108044aad4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.714589 13121 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.717478 13323 raft_consensus.cc:1275] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Refusing update from remote peer fa4bce3f28c14c0f857d077a9c283c17: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.717335 13400 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b672236b0eff4d3d9e3108044aad4348" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 46361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:18.719424 13443 consensus_queue.cc:1048] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:18.803201 13323 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.804597 13447 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.814111 13046 raft_consensus.cc:1275] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.815645 13447 consensus_queue.cc:1048] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.886890 13323 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.888458 13459 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5186a51d648545d5ac77a4aab189a9a7" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.902287 13046 raft_consensus.cc:1275] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Refusing update from remote peer b672236b0eff4d3d9e3108044aad4348: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:18.904357 13463 consensus_queue.cc:1048] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4bce3f28c14c0f857d077a9c283c17" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:19.145361  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.200976  2677 tablet_server.cc:179] TabletServer@127.2.157.65:40965 shutting down...
W20260709 12:25:19.215363 13011 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 90 similar messages]
W20260709 12:25:19.224113 13011 consensus_peers.cc:597] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.237983 13086 consensus_peers.cc:597] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.241235 13086 consensus_peers.cc:597] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.262501 13011 consensus_peers.cc:597] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.262511  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:19.264375  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.266018  2677 raft_consensus.cc:2243] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.267318  2677 raft_consensus.cc:2272] T 2d0d87f489444810b4f161d5c7523081 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.273274  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.274523  2677 raft_consensus.cc:2243] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.275614  2677 raft_consensus.cc:2272] T 96a65807ef8b4f929c3e1d6988726e71 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.277405 13011 consensus_peers.cc:597] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.280515  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.281785  2677 raft_consensus.cc:2243] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.282719  2677 raft_consensus.cc:2272] T da17cc8b61c84b9fbf3efab275b9e6fb P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.287177  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.288280  2677 raft_consensus.cc:2243] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.289096  2677 raft_consensus.cc:2272] T 6ccd48ead33c4938a7b644536fc8ee4c P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.293587  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.294557  2677 raft_consensus.cc:2243] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.295558  2677 raft_consensus.cc:2272] T cef676c5cb154626bb00f403a8fd3d05 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.300568  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.301745  2677 raft_consensus.cc:2243] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.302631  2677 raft_consensus.cc:2272] T a1574c45c8cb4bb5a6e63936927b4b12 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.307523  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.308470  2677 raft_consensus.cc:2243] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.309211  2677 raft_consensus.cc:2272] T 78b3d5ce26784132942656cefa6d6026 P 5186a51d648545d5ac77a4aab189a9a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.314512  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.315469  2677 raft_consensus.cc:2243] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.316464  2677 raft_consensus.cc:2272] T 7afab10799e04fcbb73fe19b2feb7c23 P 5186a51d648545d5ac77a4aab189a9a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.321316  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.322397  2677 raft_consensus.cc:2243] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.323324  2677 raft_consensus.cc:2272] T fd769e3b22764149a64442215d813423 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.328334  2677 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:19.329181  2677 raft_consensus.cc:2243] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.330078  2677 raft_consensus.cc:2272] T 43261a62955e4a0b9f8b5629b4842db6 P 5186a51d648545d5ac77a4aab189a9a7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.395824 13086 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.398413 13086 consensus_peers.cc:597] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.424469 13086 consensus_peers.cc:597] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.432132 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:19.554790 13011 consensus_peers.cc:597] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.724124 13086 consensus_peers.cc:597] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.373914  2677 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13345)
W20260709 12:25:20.433357 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:21.374635  2677 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13345)
W20260709 12:25:21.434782 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:21.619592 13086 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.687304 13011 consensus_peers.cc:597] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.711925 13086 consensus_peers.cc:597] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.777774 13011 consensus_peers.cc:597] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.825104 13086 consensus_peers.cc:597] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.911828 13086 consensus_peers.cc:597] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:22.007278 13011 consensus_peers.cc:597] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:22.144764 13011 consensus_peers.cc:597] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:22.148948  2677 tablet_server.cc:196] TabletServer@127.2.157.65:40965 shutdown complete.
I20260709 12:25:22.184207  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:25:22.193849 13086 consensus_peers.cc:597] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 -> Peer 5186a51d648545d5ac77a4aab189a9a7 (127.2.157.65:40965): Couldn't send request to peer 5186a51d648545d5ac77a4aab189a9a7. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:40965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:22.208904 13089 consensus_peers.cc:597] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 -> Peer fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365): Couldn't send request to peer fa4bce3f28c14c0f857d077a9c283c17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:22.217267 13089 consensus_peers.cc:597] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 -> Peer fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365): Couldn't send request to peer fa4bce3f28c14c0f857d077a9c283c17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.224573  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:22.225433  2677 tablet_replica.cc:333] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.226645  2677 raft_consensus.cc:2243] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.227522  2677 raft_consensus.cc:2272] T a1574c45c8cb4bb5a6e63936927b4b12 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.231446  2677 tablet_replica.cc:333] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.232163  2677 raft_consensus.cc:2243] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.232735  2677 raft_consensus.cc:2272] T fd769e3b22764149a64442215d813423 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.235777  2677 tablet_replica.cc:333] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.236398  2677 raft_consensus.cc:2243] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.237062  2677 raft_consensus.cc:2272] T cef676c5cb154626bb00f403a8fd3d05 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.239996  2677 tablet_replica.cc:333] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.240568  2677 raft_consensus.cc:2243] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.241051  2677 raft_consensus.cc:2272] T 96a65807ef8b4f929c3e1d6988726e71 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.243579  2677 tablet_replica.cc:333] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.244134  2677 raft_consensus.cc:2243] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.244674  2677 raft_consensus.cc:2272] T 2d0d87f489444810b4f161d5c7523081 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.247067  2677 tablet_replica.cc:333] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.247695  2677 raft_consensus.cc:2243] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.248641  2677 raft_consensus.cc:2272] T 43261a62955e4a0b9f8b5629b4842db6 P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.250949  2677 tablet_replica.cc:333] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.251627  2677 raft_consensus.cc:2243] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.252565  2677 raft_consensus.cc:2272] T da17cc8b61c84b9fbf3efab275b9e6fb P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.254956  2677 tablet_replica.cc:333] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.255551  2677 raft_consensus.cc:2243] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.256110  2677 raft_consensus.cc:2272] T 6ccd48ead33c4938a7b644536fc8ee4c P fa4bce3f28c14c0f857d077a9c283c17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.258553  2677 tablet_replica.cc:333] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.259086  2677 raft_consensus.cc:2243] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.260033  2677 raft_consensus.cc:2272] T 78b3d5ce26784132942656cefa6d6026 P fa4bce3f28c14c0f857d077a9c283c17 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.263008  2677 tablet_replica.cc:333] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17: stopping tablet replica
I20260709 12:25:22.263659  2677 raft_consensus.cc:2243] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.264729  2677 raft_consensus.cc:2272] T 7afab10799e04fcbb73fe19b2feb7c23 P fa4bce3f28c14c0f857d077a9c283c17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.298995  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
I20260709 12:25:22.330188  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
W20260709 12:25:22.354035 13089 consensus_peers.cc:597] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 -> Peer fa4bce3f28c14c0f857d077a9c283c17 (127.2.157.66:39365): Couldn't send request to peer fa4bce3f28c14c0f857d077a9c283c17. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:22.364454  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:22.365459  2677 tablet_replica.cc:333] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.366657  2677 raft_consensus.cc:2243] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.367805  2677 raft_consensus.cc:2272] T a1574c45c8cb4bb5a6e63936927b4b12 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.370240  2677 tablet_replica.cc:333] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.370857  2677 raft_consensus.cc:2243] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.371939  2677 raft_consensus.cc:2272] T cef676c5cb154626bb00f403a8fd3d05 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.374387  2677 tablet_replica.cc:333] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.375022  2677 raft_consensus.cc:2243] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.376013  2677 raft_consensus.cc:2272] T fd769e3b22764149a64442215d813423 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.378312  2677 tablet_replica.cc:333] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.378851  2677 raft_consensus.cc:2243] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.379818  2677 raft_consensus.cc:2272] T 96a65807ef8b4f929c3e1d6988726e71 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.383306  2677 tablet_replica.cc:333] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.384373  2677 raft_consensus.cc:2243] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.385835  2677 raft_consensus.cc:2272] T 2d0d87f489444810b4f161d5c7523081 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.389329  2677 tablet_replica.cc:333] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.390245  2677 raft_consensus.cc:2243] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.391350  2677 raft_consensus.cc:2272] T 6ccd48ead33c4938a7b644536fc8ee4c P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.393882  2677 tablet_replica.cc:333] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.394510  2677 raft_consensus.cc:2243] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.395104  2677 raft_consensus.cc:2272] T da17cc8b61c84b9fbf3efab275b9e6fb P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.397681  2677 tablet_replica.cc:333] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.398375  2677 raft_consensus.cc:2243] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.398913  2677 raft_consensus.cc:2272] T 43261a62955e4a0b9f8b5629b4842db6 P b672236b0eff4d3d9e3108044aad4348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.401283  2677 tablet_replica.cc:333] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.401814  2677 raft_consensus.cc:2243] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.402323  2677 raft_consensus.cc:2272] T 78b3d5ce26784132942656cefa6d6026 P b672236b0eff4d3d9e3108044aad4348 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.404840  2677 tablet_replica.cc:333] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348: stopping tablet replica
I20260709 12:25:22.405371  2677 raft_consensus.cc:2243] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.405889  2677 raft_consensus.cc:2272] T 7afab10799e04fcbb73fe19b2feb7c23 P b672236b0eff4d3d9e3108044aad4348 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:22.436220 12918 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:22.459511  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
I20260709 12:25:22.489270  2677 master.cc:562] Master@127.2.157.126:32979 shutting down...
I20260709 12:25:22.516795  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:22.517544  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.517896  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P e292a5fb2aae4610bcbccf76cd599fc2: stopping tablet replica
I20260709 12:25:22.540030  2677 master.cc:584] Master@127.2.157.126:32979 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (16315 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:25:22.590449  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:46097
I20260709 12:25:22.591791  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.598508 13474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.598502 13475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.599040 13477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.599942  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:22.601095  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.601316  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.601531  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599922601514 us; error 0 us; skew 500 ppm
I20260709 12:25:22.602151  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.605036  2677 webserver.cc:533] Webserver started at http://127.2.157.126:35155/ using document root <none> and password file <none>
I20260709 12:25:22.605567  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.605749  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.606060  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.607311  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "ff83f7d6fd254495b6bd8c28ef2038ea"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-sx71"
I20260709 12:25:22.612303  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:22.616070 13482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.616892  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:22.617216  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "ff83f7d6fd254495b6bd8c28ef2038ea"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-sx71"
I20260709 12:25:22.617506  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.645354  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.646698  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.690362  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:46097
I20260709 12:25:22.690464 13533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:46097 every 8 connection(s)
I20260709 12:25:22.694788 13534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.708552 13534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea: Bootstrap starting.
I20260709 12:25:22.714026 13534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.718639 13534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea: No bootstrap required, opened a new log
I20260709 12:25:22.721321 13534 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER }
I20260709 12:25:22.721786 13534 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.721966 13534 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff83f7d6fd254495b6bd8c28ef2038ea, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.722572 13534 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER }
I20260709 12:25:22.723054 13534 raft_consensus.cc:399] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:22.723256 13534 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:22.723538 13534 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.729259 13534 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER }
I20260709 12:25:22.729794 13534 leader_election.cc:304] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff83f7d6fd254495b6bd8c28ef2038ea; no voters: 
I20260709 12:25:22.730913 13534 leader_election.cc:290] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:22.731302 13537 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.732853 13537 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 1 LEADER]: Becoming Leader. State: Replica: ff83f7d6fd254495b6bd8c28ef2038ea, State: Running, Role: LEADER
I20260709 12:25:22.733649 13537 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER }
I20260709 12:25:22.734174 13534 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:22.739244 13538 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER } }
I20260709 12:25:22.739244 13539 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff83f7d6fd254495b6bd8c28ef2038ea. Latest consensus state: current_term: 1 leader_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff83f7d6fd254495b6bd8c28ef2038ea" member_type: VOTER } }
I20260709 12:25:22.740200 13538 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.740267 13539 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.744922 13545 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:22.750365 13545 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:22.752707  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:22.760454 13545 catalog_manager.cc:1383] Generated new cluster ID: be06a04cdbda47a681733e43c232192e
I20260709 12:25:22.760747 13545 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:22.796283 13545 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:22.797653 13545 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:22.819737 13545 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea: Generated new TSK 0
I20260709 12:25:22.820498 13545 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:22.884101  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.890450 13555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.891778 13556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.893311 13558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.893929  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:22.894979  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.895197  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.895395  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599922895376 us; error 0 us; skew 500 ppm
I20260709 12:25:22.896023  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.898444  2677 webserver.cc:533] Webserver started at http://127.2.157.65:41395/ using document root <none> and password file <none>
I20260709 12:25:22.898967  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.899164  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.899503  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.900760  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-sx71"
I20260709 12:25:22.905905  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:22.910154 13563 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.911088  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:22.911527  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-sx71"
I20260709 12:25:22.911901  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.933645  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.934927  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.936636  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.939042  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.939292  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.939581  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.939771  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.985386  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:40417
I20260709 12:25:22.985550 13625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:40417 every 8 connection(s)
I20260709 12:25:22.991235  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.999259 13630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:23.001118 13631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:23.006455  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:23.006992 13633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:23.007745 13626 heartbeater.cc:344] Connected to a master server at 127.2.157.126:46097
I20260709 12:25:23.008237 13626 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:23.008376  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:23.008694  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:23.008900  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599923008877 us; error 0 us; skew 500 ppm
I20260709 12:25:23.009270 13626 heartbeater.cc:507] Master 127.2.157.126:46097 requested a full tablet report, sending...
I20260709 12:25:23.009780  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:23.012296 13499 ts_manager.cc:194] Registered new tserver with Master: 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417)
I20260709 12:25:23.013244  2677 webserver.cc:533] Webserver started at http://127.2.157.66:46279/ using document root <none> and password file <none>
I20260709 12:25:23.014057  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:23.014320  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:23.014639  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:23.015134 13499 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42384
I20260709 12:25:23.016467  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "654b01a54535458fa330a7520576fa7f"
format_stamp: "Formatted at 2026-07-09 12:25:23 on dist-test-slave-sx71"
I20260709 12:25:23.022473  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:25:23.026672 13638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.027662  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:25:23.027998  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "654b01a54535458fa330a7520576fa7f"
format_stamp: "Formatted at 2026-07-09 12:25:23 on dist-test-slave-sx71"
I20260709 12:25:23.028373  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:23.039986  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:23.041296  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:23.042829  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:23.045289  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:23.045543  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.045864  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:23.046062  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.088551  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:39025
I20260709 12:25:23.088682 13700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:39025 every 8 connection(s)
I20260709 12:25:23.093648  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:23.102768 13705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:23.102960 13704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:23.106833 13707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:23.107764 13701 heartbeater.cc:344] Connected to a master server at 127.2.157.126:46097
I20260709 12:25:23.108242 13701 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:23.109068 13701 heartbeater.cc:507] Master 127.2.157.126:46097 requested a full tablet report, sending...
I20260709 12:25:23.109906  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:23.111068  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:23.111332  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:23.111405 13499 ts_manager.cc:194] Registered new tserver with Master: 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:23.111611  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599923111587 us; error 0 us; skew 500 ppm
I20260709 12:25:23.112576  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:23.113512 13499 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42388
I20260709 12:25:23.115902  2677 webserver.cc:533] Webserver started at http://127.2.157.67:40181/ using document root <none> and password file <none>
I20260709 12:25:23.116518  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:23.116739  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:23.117033  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:23.118187  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "4ec2b7a3c06b4691b3897331db83e458"
format_stamp: "Formatted at 2026-07-09 12:25:23 on dist-test-slave-sx71"
I20260709 12:25:23.122684  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:25:23.126461 13712 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.127396  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:23.127835  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "4ec2b7a3c06b4691b3897331db83e458"
format_stamp: "Formatted at 2026-07-09 12:25:23 on dist-test-slave-sx71"
I20260709 12:25:23.128147  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:23.150831  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:23.152263  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:23.153854  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:23.156229  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:23.156478  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.156738  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:23.156922  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:23.199416  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:35561
I20260709 12:25:23.199609 13776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:35561 every 8 connection(s)
I20260709 12:25:23.214159 13777 heartbeater.cc:344] Connected to a master server at 127.2.157.126:46097
I20260709 12:25:23.214612 13777 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:23.215345 13777 heartbeater.cc:507] Master 127.2.157.126:46097 requested a full tablet report, sending...
I20260709 12:25:23.217764 13499 ts_manager.cc:194] Registered new tserver with Master: 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:23.217885  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015125817s
I20260709 12:25:23.219781 13499 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42394
I20260709 12:25:23.247807 13499 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42406:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:23.250093 13499 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:23.299674 13741 tablet_service.cc:1511] Processing CreateTablet for tablet 061cfb186ab544cbb5ac50a7935f4dc5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.301221 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061cfb186ab544cbb5ac50a7935f4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.302805 13740 tablet_service.cc:1511] Processing CreateTablet for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.304414 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.311419 13591 tablet_service.cc:1511] Processing CreateTablet for tablet 061cfb186ab544cbb5ac50a7935f4dc5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.313061 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061cfb186ab544cbb5ac50a7935f4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.314308 13590 tablet_service.cc:1511] Processing CreateTablet for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.315716 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.317188 13665 tablet_service.cc:1511] Processing CreateTablet for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.315269 13666 tablet_service.cc:1511] Processing CreateTablet for tablet 061cfb186ab544cbb5ac50a7935f4dc5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f89a1fff9a5f4db8b4067cf50aa244dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.318650 13665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7542d6d2eb8f45c5a7d8a4ecbd49dfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.319959 13666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061cfb186ab544cbb5ac50a7935f4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.340701 13793 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: Bootstrap starting.
I20260709 12:25:23.347903 13793 tablet_bootstrap.cc:654] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.348513 13794 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: Bootstrap starting.
I20260709 12:25:23.354177 13792 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: Bootstrap starting.
I20260709 12:25:23.355736 13793 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: No bootstrap required, opened a new log
I20260709 12:25:23.356024 13794 tablet_bootstrap.cc:654] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.356386 13793 ts_tablet_manager.cc:1403] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:25:23.361153 13793 raft_consensus.cc:359] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.362043 13793 raft_consensus.cc:385] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.362421 13793 raft_consensus.cc:740] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.363432 13793 consensus_queue.cc:260] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.364225 13792 tablet_bootstrap.cc:654] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.366024 13701 heartbeater.cc:499] Master 127.2.157.126:46097 was elected leader, sending a full tablet report...
I20260709 12:25:23.366536 13793 ts_tablet_manager.cc:1434] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:23.366585 13794 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: No bootstrap required, opened a new log
I20260709 12:25:23.367336 13794 ts_tablet_manager.cc:1403] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:25:23.367635 13793 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: Bootstrap starting.
I20260709 12:25:23.371634 13794 raft_consensus.cc:359] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.372697 13794 raft_consensus.cc:385] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.373009 13794 raft_consensus.cc:740] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.373766 13794 consensus_queue.cc:260] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.375298 13793 tablet_bootstrap.cc:654] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.381470 13792 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: No bootstrap required, opened a new log
I20260709 12:25:23.382205 13792 ts_tablet_manager.cc:1403] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.010s
I20260709 12:25:23.386775 13792 raft_consensus.cc:359] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.388135 13792 raft_consensus.cc:385] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.388610 13792 raft_consensus.cc:740] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.389930 13777 heartbeater.cc:499] Master 127.2.157.126:46097 was elected leader, sending a full tablet report...
I20260709 12:25:23.390170 13794 ts_tablet_manager.cc:1434] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.018s
I20260709 12:25:23.390834 13792 consensus_queue.cc:260] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.391520 13794 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: Bootstrap starting.
I20260709 12:25:23.394148 13793 tablet_bootstrap.cc:492] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: No bootstrap required, opened a new log
I20260709 12:25:23.394785 13793 ts_tablet_manager.cc:1403] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 12:25:23.398046 13793 raft_consensus.cc:359] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.398816 13793 raft_consensus.cc:385] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.399143 13793 raft_consensus.cc:740] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.400084 13793 consensus_queue.cc:260] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.401271 13792 ts_tablet_manager.cc:1434] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.013s
I20260709 12:25:23.402282 13793 ts_tablet_manager.cc:1434] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 12:25:23.402459 13792 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: Bootstrap starting.
I20260709 12:25:23.399209 13794 tablet_bootstrap.cc:654] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.402520 13626 heartbeater.cc:499] Master 127.2.157.126:46097 was elected leader, sending a full tablet report...
I20260709 12:25:23.409878 13792 tablet_bootstrap.cc:654] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.420768 13794 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: No bootstrap required, opened a new log
I20260709 12:25:23.421341 13794 ts_tablet_manager.cc:1403] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.008s
I20260709 12:25:23.421732 13792 tablet_bootstrap.cc:492] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: No bootstrap required, opened a new log
I20260709 12:25:23.422298 13792 ts_tablet_manager.cc:1403] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 12:25:23.424258 13794 raft_consensus.cc:359] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.424935 13794 raft_consensus.cc:385] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.425205 13794 raft_consensus.cc:740] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.425503 13792 raft_consensus.cc:359] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.426326 13792 raft_consensus.cc:385] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.426090 13794 consensus_queue.cc:260] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.426563 13792 raft_consensus.cc:740] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.427829 13792 consensus_queue.cc:260] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.428226 13799 raft_consensus.cc:493] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.428560 13794 ts_tablet_manager.cc:1434] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:25:23.428874 13799 raft_consensus.cc:515] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.432154 13792 ts_tablet_manager.cc:1434] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:25:23.435871 13799 leader_election.cc:290] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:23.445547 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7542d6d2eb8f45c5a7d8a4ecbd49dfc3" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" is_pre_election: true
I20260709 12:25:23.446483 13601 raft_consensus.cc:2468] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 0.
I20260709 12:25:23.447746 13715 leader_election.cc:304] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 4ec2b7a3c06b4691b3897331db83e458; no voters: 
I20260709 12:25:23.448531 13799 raft_consensus.cc:2804] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.448944 13799 raft_consensus.cc:493] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.449262 13799 raft_consensus.cc:3060] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.452370 13676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7542d6d2eb8f45c5a7d8a4ecbd49dfc3" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654b01a54535458fa330a7520576fa7f" is_pre_election: true
I20260709 12:25:23.453092 13676 raft_consensus.cc:2468] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 0.
I20260709 12:25:23.456621 13799 raft_consensus.cc:515] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.458407 13799 leader_election.cc:290] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 election: Requested vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:23.459412 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7542d6d2eb8f45c5a7d8a4ecbd49dfc3" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
I20260709 12:25:23.459615 13676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7542d6d2eb8f45c5a7d8a4ecbd49dfc3" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654b01a54535458fa330a7520576fa7f"
I20260709 12:25:23.460130 13601 raft_consensus.cc:3060] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.460186 13676 raft_consensus.cc:3060] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.467170 13601 raft_consensus.cc:2468] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 1.
I20260709 12:25:23.467497 13676 raft_consensus.cc:2468] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 1.
I20260709 12:25:23.468514 13715 leader_election.cc:304] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 4ec2b7a3c06b4691b3897331db83e458; no voters: 
I20260709 12:25:23.469456 13799 raft_consensus.cc:2804] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.470609 13799 raft_consensus.cc:697] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Becoming Leader. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Running, Role: LEADER
I20260709 12:25:23.471319 13799 consensus_queue.cc:237] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.479795 13497 catalog_manager.cc:5697] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "4ec2b7a3c06b4691b3897331db83e458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.648010 13797 raft_consensus.cc:493] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.648612 13797 raft_consensus.cc:515] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.650718 13797 leader_election.cc:290] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561), 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417)
I20260709 12:25:23.662710 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" is_pre_election: true
I20260709 12:25:23.662899 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec2b7a3c06b4691b3897331db83e458" is_pre_election: true
I20260709 12:25:23.663558 13601 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 0.
I20260709 12:25:23.663714 13751 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 0.
I20260709 12:25:23.664937 13641 leader_election.cc:304] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:23.665797 13797 raft_consensus.cc:2804] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.666143 13797 raft_consensus.cc:493] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.666486 13797 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.672667 13797 raft_consensus.cc:515] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.674901 13797 leader_election.cc:290] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 election: Requested vote from peers 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561), 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417)
I20260709 12:25:23.675671 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:23.676301 13751 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.676172 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
I20260709 12:25:23.677054 13601 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.682884 13601 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 1.
I20260709 12:25:23.683610 13751 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 1.
I20260709 12:25:23.684175 13641 leader_election.cc:304] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:23.685266 13797 raft_consensus.cc:2804] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.686236 13797 raft_consensus.cc:697] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Becoming Leader. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Running, Role: LEADER
I20260709 12:25:23.687424 13797 consensus_queue.cc:237] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:23.695245 13497 catalog_manager.cc:5697] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 654b01a54535458fa330a7520576fa7f (127.2.157.66). New cstate: current_term: 1 leader_uuid: "654b01a54535458fa330a7520576fa7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.741911 13497 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42422:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:23.744145 13497 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:23.770519 13591 tablet_service.cc:1511] Processing CreateTablet for tablet b84d9ad4a5a2475f9849f53380bbb4ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.771960 13591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84d9ad4a5a2475f9849f53380bbb4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.772418 13665 tablet_service.cc:1511] Processing CreateTablet for tablet b84d9ad4a5a2475f9849f53380bbb4ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.773437 13740 tablet_service.cc:1511] Processing CreateTablet for tablet b84d9ad4a5a2475f9849f53380bbb4ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:23.773972 13665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84d9ad4a5a2475f9849f53380bbb4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.774893 13740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b84d9ad4a5a2475f9849f53380bbb4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.776978 13666 tablet_service.cc:1511] Processing CreateTablet for tablet c952e1404bc046de823317d178db8f8a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.777058 13590 tablet_service.cc:1511] Processing CreateTablet for tablet c952e1404bc046de823317d178db8f8a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.779570 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c952e1404bc046de823317d178db8f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.780648 13741 tablet_service.cc:1511] Processing CreateTablet for tablet c952e1404bc046de823317d178db8f8a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=618a47cb32c34e69a401be6f85d6cf96]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:23.781934 13741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c952e1404bc046de823317d178db8f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.785143 13666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c952e1404bc046de823317d178db8f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.790838 13792 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: Bootstrap starting.
I20260709 12:25:23.795601 13794 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: Bootstrap starting.
I20260709 12:25:23.797847 13792 tablet_bootstrap.cc:654] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.806422 13794 tablet_bootstrap.cc:654] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.819370 13792 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: No bootstrap required, opened a new log
I20260709 12:25:23.820088 13792 ts_tablet_manager.cc:1403] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.003s
I20260709 12:25:23.821516 13793 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Bootstrap starting.
I20260709 12:25:23.823474 13792 raft_consensus.cc:359] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.825173 13794 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: No bootstrap required, opened a new log
I20260709 12:25:23.825405 13792 raft_consensus.cc:385] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.825814 13794 ts_tablet_manager.cc:1403] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.010s
I20260709 12:25:23.825783 13792 raft_consensus.cc:740] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.826953 13792 consensus_queue.cc:260] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.829466 13793 tablet_bootstrap.cc:654] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.829133 13794 raft_consensus.cc:359] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.829979 13794 raft_consensus.cc:385] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.830467 13794 raft_consensus.cc:740] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.831553 13794 consensus_queue.cc:260] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.832437 13792 ts_tablet_manager.cc:1434] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:23.833688 13792 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: Bootstrap starting.
I20260709 12:25:23.841977 13794 ts_tablet_manager.cc:1434] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:23.845608 13792 tablet_bootstrap.cc:654] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.846136 13794 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: Bootstrap starting.
I20260709 12:25:23.852468 13793 tablet_bootstrap.cc:492] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: No bootstrap required, opened a new log
I20260709 12:25:23.853240 13793 ts_tablet_manager.cc:1403] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.019s
I20260709 12:25:23.854300 13794 tablet_bootstrap.cc:654] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.855489 13792 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: No bootstrap required, opened a new log
I20260709 12:25:23.856050 13792 ts_tablet_manager.cc:1403] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:25:23.857164 13793 raft_consensus.cc:359] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.858094 13793 raft_consensus.cc:385] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.858358 13793 raft_consensus.cc:740] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.859125 13792 raft_consensus.cc:359] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.859378 13793 consensus_queue.cc:260] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.860105 13794 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: No bootstrap required, opened a new log
I20260709 12:25:23.860508 13792 raft_consensus.cc:385] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.860985 13792 raft_consensus.cc:740] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.861121 13794 ts_tablet_manager.cc:1403] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:25:23.862069 13792 consensus_queue.cc:260] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.864935 13792 ts_tablet_manager.cc:1434] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:23.864616 13794 raft_consensus.cc:359] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.865653 13794 raft_consensus.cc:385] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.866015 13794 raft_consensus.cc:740] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.866912 13793 ts_tablet_manager.cc:1434] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:23.866890 13794 consensus_queue.cc:260] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.868386 13793 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: Bootstrap starting.
I20260709 12:25:23.870676 13794 ts_tablet_manager.cc:1434] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:23.876127 13793 tablet_bootstrap.cc:654] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.882194 13793 tablet_bootstrap.cc:492] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: No bootstrap required, opened a new log
I20260709 12:25:23.882795 13793 ts_tablet_manager.cc:1403] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:25:23.886068 13793 raft_consensus.cc:359] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.886613 13793 raft_consensus.cc:385] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.886801 13793 raft_consensus.cc:740] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.887310 13793 consensus_queue.cc:260] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:23.889003 13793 ts_tablet_manager.cc:1434] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:25:23.966226 13799 consensus_queue.cc:1048] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.980099 13799 consensus_queue.cc:1048] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:24.002830 13797 raft_consensus.cc:493] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.003520 13797 raft_consensus.cc:515] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.005285 13797 leader_election.cc:290] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:24.006203 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" is_pre_election: true
I20260709 12:25:24.006402 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec2b7a3c06b4691b3897331db83e458" is_pre_election: true
I20260709 12:25:24.006889 13601 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 0.
I20260709 12:25:24.007169 13751 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 0.
I20260709 12:25:24.008131 13641 leader_election.cc:304] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:24.008899 13797 raft_consensus.cc:2804] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:24.009295 13797 raft_consensus.cc:493] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.009562 13797 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.016641 13797 raft_consensus.cc:515] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.018679 13797 leader_election.cc:290] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 election: Requested vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:24.019716 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
I20260709 12:25:24.020081 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:24.020367 13601 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.020735 13751 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.026372 13751 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 1.
I20260709 12:25:24.027333 13601 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 1.
I20260709 12:25:24.027737 13639 leader_election.cc:304] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec2b7a3c06b4691b3897331db83e458, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:24.028810 13797 raft_consensus.cc:2804] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:24.029235 13797 raft_consensus.cc:697] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Becoming Leader. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Running, Role: LEADER
I20260709 12:25:24.030121 13797 consensus_queue.cc:237] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.038215 13498 catalog_manager.cc:5697] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 654b01a54535458fa330a7520576fa7f (127.2.157.66). New cstate: current_term: 1 leader_uuid: "654b01a54535458fa330a7520576fa7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.046360 13799 raft_consensus.cc:493] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.047137 13799 raft_consensus.cc:515] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.049669 13799 leader_election.cc:290] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:24.050449 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" is_pre_election: true
I20260709 12:25:24.050841 13676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654b01a54535458fa330a7520576fa7f" is_pre_election: true
I20260709 12:25:24.051314 13601 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 0.
I20260709 12:25:24.051566 13676 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 0.
I20260709 12:25:24.052685 13715 leader_election.cc:304] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 4ec2b7a3c06b4691b3897331db83e458; no voters: 
I20260709 12:25:24.053555 13799 raft_consensus.cc:2804] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:24.053910 13799 raft_consensus.cc:493] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.054139 13799 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.059954 13799 raft_consensus.cc:515] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.062119 13799 leader_election.cc:290] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 election: Requested vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:24.062879 13601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
I20260709 12:25:24.063258 13676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "4ec2b7a3c06b4691b3897331db83e458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "654b01a54535458fa330a7520576fa7f"
I20260709 12:25:24.063637 13601 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.063932 13676 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.071676 13676 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 1.
I20260709 12:25:24.071678 13601 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2b7a3c06b4691b3897331db83e458 in term 1.
I20260709 12:25:24.073267 13713 leader_election.cc:304] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec2b7a3c06b4691b3897331db83e458, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:24.074278 13799 raft_consensus.cc:2804] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:24.074775 13799 raft_consensus.cc:697] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Becoming Leader. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Running, Role: LEADER
I20260709 12:25:24.075644 13799 consensus_queue.cc:237] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.083521 13498 catalog_manager.cc:5697] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67). New cstate: current_term: 1 leader_uuid: "4ec2b7a3c06b4691b3897331db83e458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.103834 13797 consensus_queue.cc:1048] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:24.116219 13832 consensus_queue.cc:1048] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:24.141700 13676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5"
dest_uuid: "654b01a54535458fa330a7520576fa7f"
mode: GRACEFUL
new_leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:40522
I20260709 12:25:24.142387 13676 raft_consensus.cc:606] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Received request to transfer leadership to TS 47a01cffd59f41e5a0be6e7a7874fae3
I20260709 12:25:24.152029 13676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae"
dest_uuid: "654b01a54535458fa330a7520576fa7f"
mode: GRACEFUL
new_leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:40522
I20260709 12:25:24.152606 13676 raft_consensus.cc:606] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Received request to transfer leadership to TS 47a01cffd59f41e5a0be6e7a7874fae3
I20260709 12:25:24.167404 13751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c952e1404bc046de823317d178db8f8a"
dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
mode: GRACEFUL
new_leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:60298
I20260709 12:25:24.168124 13751 raft_consensus.cc:606] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Received request to transfer leadership to TS 47a01cffd59f41e5a0be6e7a7874fae3
I20260709 12:25:24.478124 13799 consensus_queue.cc:1048] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:24.486413 13823 raft_consensus.cc:993] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: : Instructing follower 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.487289 13799 raft_consensus.cc:1081] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Signalling peer 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.489118 13600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c952e1404bc046de823317d178db8f8a"
dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:58524
I20260709 12:25:24.490677 13600 raft_consensus.cc:493] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.491062 13600 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.497287 13600 raft_consensus.cc:515] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.500867 13837 consensus_queue.cc:1048] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:24.510138 13600 leader_election.cc:290] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Requested vote from peers 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025), 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:24.525421 13809 raft_consensus.cc:993] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: : Instructing follower 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.525966 13809 raft_consensus.cc:1081] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Signalling peer 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.528012 13600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5"
dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:58536
I20260709 12:25:24.528631 13600 raft_consensus.cc:493] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.529026 13600 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.537446 13600 raft_consensus.cc:515] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:24.539716 13600 leader_election.cc:290] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Requested vote from peers 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561), 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025)
I20260709 12:25:24.542167 13676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "654b01a54535458fa330a7520576fa7f"
I20260709 12:25:24.542747 13676 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.543677 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c952e1404bc046de823317d178db8f8a" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:24.544402 13751 raft_consensus.cc:3055] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.544056 13675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "654b01a54535458fa330a7520576fa7f"
I20260709 12:25:24.544113 13750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061cfb186ab544cbb5ac50a7935f4dc5" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:24.544836 13751 raft_consensus.cc:740] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec2b7a3c06b4691b3897331db83e458, State: Running, Role: LEADER
I20260709 12:25:24.545141 13750 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.545133 13675 raft_consensus.cc:3055] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.545765 13675 raft_consensus.cc:740] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Running, Role: LEADER
I20260709 12:25:24.545825 13751 consensus_queue.cc:260] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.546712 13675 consensus_queue.cc:260] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:24.548344 13675 raft_consensus.cc:3060] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.550240 13676 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.551697 13564 leader_election.cc:304] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:24.552597 13801 raft_consensus.cc:2804] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.553954 13801 raft_consensus.cc:697] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Becoming Leader. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Running, Role: LEADER
I20260709 12:25:24.554150 13750 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.554929 13801 consensus_queue.cc:237] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.555626 13564 leader_election.cc:304] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 4ec2b7a3c06b4691b3897331db83e458; no voters: 
I20260709 12:25:24.556432 13675 raft_consensus.cc:2468] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.556777 13842 raft_consensus.cc:2804] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.547288 13751 raft_consensus.cc:3060] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.563738 13751 raft_consensus.cc:2468] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.563102 13842 raft_consensus.cc:697] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Becoming Leader. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Running, Role: LEADER
I20260709 12:25:24.565021 13842 consensus_queue.cc:237] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } }
I20260709 12:25:24.565308 13498 catalog_manager.cc:5697] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 reported cstate change: term changed from 1 to 2, leader changed from 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67) to 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.573153 13797 consensus_queue.cc:1048] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:24.579487 13498 catalog_manager.cc:5697] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 reported cstate change: term changed from 1 to 2, leader changed from 654b01a54535458fa330a7520576fa7f (127.2.157.66) to 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.586050 13832 consensus_queue.cc:1048] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:24.596160 13809 raft_consensus.cc:993] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: : Instructing follower 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.596680 13832 raft_consensus.cc:1081] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Signalling peer 47a01cffd59f41e5a0be6e7a7874fae3 to start an election
I20260709 12:25:24.598532 13600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae"
dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
 from {username='slave'} at 127.0.0.1:58536
I20260709 12:25:24.599195 13600 raft_consensus.cc:493] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.599642 13600 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.605623 13600 raft_consensus.cc:515] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.607821 13600 leader_election.cc:290] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Requested vote from peers 654b01a54535458fa330a7520576fa7f (127.2.157.66:39025), 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:24.608714 13675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "654b01a54535458fa330a7520576fa7f"
I20260709 12:25:24.609127 13751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:24.609455 13675 raft_consensus.cc:3055] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.609746 13751 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.609836 13675 raft_consensus.cc:740] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Running, Role: LEADER
I20260709 12:25:24.610769 13675 consensus_queue.cc:260] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.612135 13675 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.618245 13751 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.619674 13564 leader_election.cc:304] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 4ec2b7a3c06b4691b3897331db83e458; no voters: 
I20260709 12:25:24.619946 13675 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47a01cffd59f41e5a0be6e7a7874fae3 in term 2.
I20260709 12:25:24.620440 13842 raft_consensus.cc:2804] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.620978 13842 raft_consensus.cc:697] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Becoming Leader. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Running, Role: LEADER
I20260709 12:25:24.621871 13842 consensus_queue.cc:237] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:24.629516 13499 catalog_manager.cc:5697] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 reported cstate change: term changed from 1 to 2, leader changed from 654b01a54535458fa330a7520576fa7f (127.2.157.66) to 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.644088  2677 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:25:24.645749  2677 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:25:24.646270  2677 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:25:24.659415 13600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae"
dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
mode: GRACEFUL
new_leader_uuid: "654b01a54535458fa330a7520576fa7f"
 from {username='slave'} at 127.0.0.1:58548
I20260709 12:25:24.660054 13600 raft_consensus.cc:606] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Received request to transfer leadership to TS 654b01a54535458fa330a7520576fa7f
I20260709 12:25:24.661353  2677 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:25:25.020532 13751 raft_consensus.cc:1275] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.021000 13750 raft_consensus.cc:1275] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.022051 13842 consensus_queue.cc:1048] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.022475 13843 consensus_queue.cc:1048] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.030344 13676 raft_consensus.cc:1275] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.037359 13843 consensus_queue.cc:1048] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.042014 13676 raft_consensus.cc:1275] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.044936 13849 consensus_queue.cc:1048] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.053711 13750 raft_consensus.cc:1275] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.056293 13843 raft_consensus.cc:993] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: : Instructing follower 654b01a54535458fa330a7520576fa7f to start an election
I20260709 12:25:25.056819 13843 raft_consensus.cc:1081] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Signalling peer 654b01a54535458fa330a7520576fa7f to start an election
I20260709 12:25:25.056335 13842 consensus_queue.cc:1048] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:25.058702 13675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae"
dest_uuid: "654b01a54535458fa330a7520576fa7f"
 from {username='slave'} at 127.0.0.1:40536
I20260709 12:25:25.059341 13675 raft_consensus.cc:493] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.059765 13675 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.066632 13676 raft_consensus.cc:1275] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Refusing update from remote peer 47a01cffd59f41e5a0be6e7a7874fae3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.069168 13801 consensus_queue.cc:1048] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.072062 13675 raft_consensus.cc:515] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:25.077899 13600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "47a01cffd59f41e5a0be6e7a7874fae3"
I20260709 12:25:25.078666 13600 raft_consensus.cc:3055] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:25.079128 13600 raft_consensus.cc:740] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47a01cffd59f41e5a0be6e7a7874fae3, State: Running, Role: LEADER
I20260709 12:25:25.080099 13600 consensus_queue.cc:260] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:25.081278 13600 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.082855 13750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b84d9ad4a5a2475f9849f53380bbb4ae" candidate_uuid: "654b01a54535458fa330a7520576fa7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec2b7a3c06b4691b3897331db83e458"
I20260709 12:25:25.083622 13750 raft_consensus.cc:3060] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.078073 13675 leader_election.cc:290] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 3 election: Requested vote from peers 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65:40417), 4ec2b7a3c06b4691b3897331db83e458 (127.2.157.67:35561)
I20260709 12:25:25.090174 13600 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 3.
I20260709 12:25:25.091678 13641 leader_election.cc:304] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47a01cffd59f41e5a0be6e7a7874fae3, 654b01a54535458fa330a7520576fa7f; no voters: 
I20260709 12:25:25.092500 13832 raft_consensus.cc:2804] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:25.093063 13832 raft_consensus.cc:697] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 LEADER]: Becoming Leader. State: Replica: 654b01a54535458fa330a7520576fa7f, State: Running, Role: LEADER
I20260709 12:25:25.093101 13750 raft_consensus.cc:2468] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 654b01a54535458fa330a7520576fa7f in term 3.
I20260709 12:25:25.094050 13832 consensus_queue.cc:237] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } }
I20260709 12:25:25.101130 13498 catalog_manager.cc:5697] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f reported cstate change: term changed from 2 to 3, leader changed from 47a01cffd59f41e5a0be6e7a7874fae3 (127.2.157.65) to 654b01a54535458fa330a7520576fa7f (127.2.157.66). New cstate: current_term: 3 leader_uuid: "654b01a54535458fa330a7520576fa7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47a01cffd59f41e5a0be6e7a7874fae3" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 40417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "654b01a54535458fa330a7520576fa7f" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 39025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec2b7a3c06b4691b3897331db83e458" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 35561 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.289737  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
I20260709 12:25:25.311261  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.312172  2677 tablet_replica.cc:333] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3: stopping tablet replica
I20260709 12:25:25.312939  2677 raft_consensus.cc:2243] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.314127  2677 raft_consensus.cc:2272] T c952e1404bc046de823317d178db8f8a P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.317255  2677 tablet_replica.cc:333] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3: stopping tablet replica
I20260709 12:25:25.317931  2677 raft_consensus.cc:2243] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.318910  2677 raft_consensus.cc:2272] T 061cfb186ab544cbb5ac50a7935f4dc5 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.321813  2677 tablet_replica.cc:333] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3: stopping tablet replica
I20260709 12:25:25.322399  2677 raft_consensus.cc:2243] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.322867  2677 raft_consensus.cc:2272] T b84d9ad4a5a2475f9849f53380bbb4ae P 47a01cffd59f41e5a0be6e7a7874fae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.325338  2677 tablet_replica.cc:333] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3: stopping tablet replica
I20260709 12:25:25.325886  2677 raft_consensus.cc:2243] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.326339  2677 raft_consensus.cc:2272] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 47a01cffd59f41e5a0be6e7a7874fae3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.351373  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
I20260709 12:25:25.366178  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
I20260709 12:25:25.388239  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.388936  2677 tablet_replica.cc:333] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f: stopping tablet replica
I20260709 12:25:25.389554  2677 raft_consensus.cc:2243] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.390051  2677 raft_consensus.cc:2272] T c952e1404bc046de823317d178db8f8a P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.392709  2677 tablet_replica.cc:333] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: stopping tablet replica
I20260709 12:25:25.393353  2677 raft_consensus.cc:2243] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.394073  2677 pending_rounds.cc:70] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Trying to abort 1 pending ops.
I20260709 12:25:25.394284  2677 pending_rounds.cc:77] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625293193781248 op_type: NO_OP noop_request { }
I20260709 12:25:25.394629  2677 raft_consensus.cc:2889] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:25.394922  2677 raft_consensus.cc:2272] T b84d9ad4a5a2475f9849f53380bbb4ae P 654b01a54535458fa330a7520576fa7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.397447  2677 tablet_replica.cc:333] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f: stopping tablet replica
I20260709 12:25:25.398058  2677 raft_consensus.cc:2243] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.398530  2677 raft_consensus.cc:2272] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 654b01a54535458fa330a7520576fa7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.400544  2677 tablet_replica.cc:333] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f: stopping tablet replica
I20260709 12:25:25.401039  2677 raft_consensus.cc:2243] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.401497  2677 raft_consensus.cc:2272] T 061cfb186ab544cbb5ac50a7935f4dc5 P 654b01a54535458fa330a7520576fa7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.425462  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
I20260709 12:25:25.440362  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
I20260709 12:25:25.459391  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:25.460299  2677 tablet_replica.cc:333] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458: stopping tablet replica
I20260709 12:25:25.460906  2677 raft_consensus.cc:2243] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.461434  2677 raft_consensus.cc:2272] T c952e1404bc046de823317d178db8f8a P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.463860  2677 tablet_replica.cc:333] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458: stopping tablet replica
I20260709 12:25:25.464458  2677 raft_consensus.cc:2243] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.464921  2677 raft_consensus.cc:2272] T 061cfb186ab544cbb5ac50a7935f4dc5 P 4ec2b7a3c06b4691b3897331db83e458 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.467675  2677 tablet_replica.cc:333] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458: stopping tablet replica
I20260709 12:25:25.468252  2677 raft_consensus.cc:2243] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.468720  2677 raft_consensus.cc:2272] T b84d9ad4a5a2475f9849f53380bbb4ae P 4ec2b7a3c06b4691b3897331db83e458 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.471099  2677 tablet_replica.cc:333] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458: stopping tablet replica
I20260709 12:25:25.471679  2677 raft_consensus.cc:2243] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.472517  2677 raft_consensus.cc:2272] T 7542d6d2eb8f45c5a7d8a4ecbd49dfc3 P 4ec2b7a3c06b4691b3897331db83e458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.495424  2677 tablet_server.cc:196] TabletServer@127.2.157.67:0 shutdown complete.
I20260709 12:25:25.509641  2677 master.cc:562] Master@127.2.157.126:46097 shutting down...
I20260709 12:25:25.526800  2677 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:25.527493  2677 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.527858  2677 tablet_replica.cc:333] T 00000000000000000000000000000000 P ff83f7d6fd254495b6bd8c28ef2038ea: stopping tablet replica
I20260709 12:25:25.548554  2677 master.cc:584] Master@127.2.157.126:46097 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2988 ms)
[----------] 6 tests from LeaderRebalancerTest (369701 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:25:25.579098  2677 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.126:39635
I20260709 12:25:25.580322  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.585618 13850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.585718 13851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.587332 13853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.589406  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:25.590315  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.590518  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.590637  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599925590626 us; error 0 us; skew 500 ppm
I20260709 12:25:25.591133  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.593914  2677 webserver.cc:533] Webserver started at http://127.2.157.126:35863/ using document root <none> and password file <none>
I20260709 12:25:25.594400  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.594580  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.594787  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.596022  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/master-0-root/instance:
uuid: "66b69afbaad240f999b9ce25d53a1efb"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.600893  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:25:25.604732 13858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.605713  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:25.606052  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/master-0-root
uuid: "66b69afbaad240f999b9ce25d53a1efb"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.606310  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.634626  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.636044  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.677032  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.126:39635
I20260709 12:25:25.677121 13910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.126:39635 every 8 connection(s)
I20260709 12:25:25.681427 13911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.694175 13911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb: Bootstrap starting.
I20260709 12:25:25.699057 13911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.703704 13911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb: No bootstrap required, opened a new log
I20260709 12:25:25.706034 13911 raft_consensus.cc:359] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER }
I20260709 12:25:25.706435 13911 raft_consensus.cc:385] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.706704 13911 raft_consensus.cc:740] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b69afbaad240f999b9ce25d53a1efb, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.707435 13911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER }
I20260709 12:25:25.708105 13911 raft_consensus.cc:399] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:25.708333 13911 raft_consensus.cc:493] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:25.708664 13911 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.714675 13911 raft_consensus.cc:515] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER }
I20260709 12:25:25.715370 13911 leader_election.cc:304] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66b69afbaad240f999b9ce25d53a1efb; no voters: 
I20260709 12:25:25.716681 13911 leader_election.cc:290] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:25.717092 13914 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.718600 13914 raft_consensus.cc:697] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [term 1 LEADER]: Becoming Leader. State: Replica: 66b69afbaad240f999b9ce25d53a1efb, State: Running, Role: LEADER
I20260709 12:25:25.719251 13914 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER }
I20260709 12:25:25.719882 13911 sys_catalog.cc:565] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:25.722262 13916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66b69afbaad240f999b9ce25d53a1efb. Latest consensus state: current_term: 1 leader_uuid: "66b69afbaad240f999b9ce25d53a1efb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER } }
I20260709 12:25:25.722231 13915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66b69afbaad240f999b9ce25d53a1efb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b69afbaad240f999b9ce25d53a1efb" member_type: VOTER } }
I20260709 12:25:25.723121 13916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.723183 13915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:25.727818 13919 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:25.735984 13919 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:25.737141  2677 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:25.746061 13919 catalog_manager.cc:1383] Generated new cluster ID: 8959593c9dde4447863d636739e6eb3c
I20260709 12:25:25.746353 13919 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:25.778102 13919 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:25.779595 13919 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:25.796754 13919 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb: Generated new TSK 0
I20260709 12:25:25.797456 13919 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:25.803962  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.810335 13932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.811399 13933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.813578  2677 server_base.cc:1061] running on GCE node
W20260709 12:25:25.813793 13935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.814765  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:25.815006  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.815183  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599925815167 us; error 0 us; skew 500 ppm
I20260709 12:25:25.815786  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.818346  2677 webserver.cc:533] Webserver started at http://127.2.157.65:42967/ using document root <none> and password file <none>
I20260709 12:25:25.818886  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.819103  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.819393  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.820628  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-0-root/instance:
uuid: "9cfa711068644412a359cc73ead1d7f1"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.825591  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:25.829630 13940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.830569  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:25.830960  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-0-root
uuid: "9cfa711068644412a359cc73ead1d7f1"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.831301  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.847728  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.848981  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.850447  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:25.852850  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:25.853101  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.853345  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:25.853523  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.894731  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.65:35077
I20260709 12:25:25.894855 14002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.65:35077 every 8 connection(s)
I20260709 12:25:25.900090  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:25.906934 14007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.908341 14008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:25.911907 14010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:25.911924  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:25.912395 14003 heartbeater.cc:344] Connected to a master server at 127.2.157.126:39635
I20260709 12:25:25.912930 14003 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:25.913354  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:25.913628 14003 heartbeater.cc:507] Master 127.2.157.126:39635 requested a full tablet report, sending...
W20260709 12:25:25.913641  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:25.914064  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599925914042 us; error 0 us; skew 500 ppm
I20260709 12:25:25.914930  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:25.915771 13875 ts_manager.cc:194] Registered new tserver with Master: 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077)
I20260709 12:25:25.917588  2677 webserver.cc:533] Webserver started at http://127.2.157.66:45775/ using document root <none> and password file <none>
I20260709 12:25:25.918049 13875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54700
I20260709 12:25:25.918138  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:25.918493  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:25.918783  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:25.920065  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-1-root/instance:
uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.924680  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:25.928893 14015 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.929903  2677 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:25.930250  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-1-root
uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
format_stamp: "Formatted at 2026-07-09 12:25:25 on dist-test-slave-sx71"
I20260709 12:25:25.930521  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:25.974679  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:25.975875  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:25.977384  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:25.979933  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:25.980137  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:25.980455  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:25.980609  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.022342  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.66:44553
I20260709 12:25:26.022476 14078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.66:44553 every 8 connection(s)
I20260709 12:25:26.027614  2677 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:26.036237 14082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.037226 14083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:26.040557 14085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:26.041174  2677 server_base.cc:1061] running on GCE node
I20260709 12:25:26.041584 14079 heartbeater.cc:344] Connected to a master server at 127.2.157.126:39635
I20260709 12:25:26.042062 14079 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:26.042297  2677 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:26.042582  2677 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:26.042774  2677 hybrid_clock.cc:648] HybridClock initialized: now 1783599926042754 us; error 0 us; skew 500 ppm
I20260709 12:25:26.042892 14079 heartbeater.cc:507] Master 127.2.157.126:39635 requested a full tablet report, sending...
I20260709 12:25:26.043435  2677 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:26.045576 13875 ts_manager.cc:194] Registered new tserver with Master: 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:26.046415  2677 webserver.cc:533] Webserver started at http://127.2.157.67:46413/ using document root <none> and password file <none>
I20260709 12:25:26.047035  2677 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:26.047238 13875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54706
I20260709 12:25:26.047253  2677 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:26.047876  2677 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:26.049232  2677 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-2-root/instance:
uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sx71"
I20260709 12:25:26.053960  2677 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:26.057529 14090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.058564  2677 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:26.058946  2677 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-2-root
uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
format_stamp: "Formatted at 2026-07-09 12:25:26 on dist-test-slave-sx71"
I20260709 12:25:26.059299  2677 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskIX3UTI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599555698252-2677-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:26.085045  2677 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:26.086289  2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:26.087954  2677 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:26.090554  2677 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:26.090816  2677 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.091099  2677 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:26.091296  2677 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:26.135982  2677 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.67:37705
I20260709 12:25:26.136103 14152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.67:37705 every 8 connection(s)
I20260709 12:25:26.152074 14153 heartbeater.cc:344] Connected to a master server at 127.2.157.126:39635
I20260709 12:25:26.152494 14153 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:26.153390 14153 heartbeater.cc:507] Master 127.2.157.126:39635 requested a full tablet report, sending...
I20260709 12:25:26.155644 13875 ts_manager.cc:194] Registered new tserver with Master: 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.156419  2677 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016302935s
I20260709 12:25:26.157269 13875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54708
I20260709 12:25:26.184324 13875 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54720:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:26.186954 13875 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:26.261111 13967 tablet_service.cc:1511] Processing CreateTablet for tablet 2baeef2587574107a3c1dda54ed4f52c (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:26.261631 13968 tablet_service.cc:1511] Processing CreateTablet for tablet 75edc7d73e2240d19803d5818dadea26 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:26.262791 13967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baeef2587574107a3c1dda54ed4f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.263484 13968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75edc7d73e2240d19803d5818dadea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.264042 13966 tablet_service.cc:1511] Processing CreateTablet for tablet 52ecd1f0895f40a694686a2659008702 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:26.265564 13966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ecd1f0895f40a694686a2659008702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.266670 14118 tablet_service.cc:1511] Processing CreateTablet for tablet 75edc7d73e2240d19803d5818dadea26 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:26.268162 14116 tablet_service.cc:1511] Processing CreateTablet for tablet 52ecd1f0895f40a694686a2659008702 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:26.268184 14118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75edc7d73e2240d19803d5818dadea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.269313 14117 tablet_service.cc:1511] Processing CreateTablet for tablet 2baeef2587574107a3c1dda54ed4f52c (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:26.270733 14117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baeef2587574107a3c1dda54ed4f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.275833 14116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ecd1f0895f40a694686a2659008702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.278493 14043 tablet_service.cc:1511] Processing CreateTablet for tablet 75edc7d73e2240d19803d5818dadea26 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:26.278945 14042 tablet_service.cc:1511] Processing CreateTablet for tablet 2baeef2587574107a3c1dda54ed4f52c (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:26.280099 14043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75edc7d73e2240d19803d5818dadea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.281236 14042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2baeef2587574107a3c1dda54ed4f52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.281957 13965 tablet_service.cc:1511] Processing CreateTablet for tablet 9769e8506ffa4d5daa44143077fa0e3e (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:26.283430 13965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9769e8506ffa4d5daa44143077fa0e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.288687 14115 tablet_service.cc:1511] Processing CreateTablet for tablet 9769e8506ffa4d5daa44143077fa0e3e (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:26.290292 14115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9769e8506ffa4d5daa44143077fa0e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.292635 14040 tablet_service.cc:1511] Processing CreateTablet for tablet 9769e8506ffa4d5daa44143077fa0e3e (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:26.294206 14040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9769e8506ffa4d5daa44143077fa0e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.296559 14041 tablet_service.cc:1511] Processing CreateTablet for tablet 52ecd1f0895f40a694686a2659008702 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:26.299374 14039 tablet_service.cc:1511] Processing CreateTablet for tablet 318063b1f2d345dba058bb92a195979d (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:26.301714 14114 tablet_service.cc:1511] Processing CreateTablet for tablet 318063b1f2d345dba058bb92a195979d (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:26.303179 14114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318063b1f2d345dba058bb92a195979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.304495 13963 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f93cc2dc14fc7a421732042343593 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:26.306651 13963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f93cc2dc14fc7a421732042343593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.304566 13964 tablet_service.cc:1511] Processing CreateTablet for tablet 318063b1f2d345dba058bb92a195979d (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:26.308840 14168 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.309412 13964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318063b1f2d345dba058bb92a195979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.313014 14041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ecd1f0895f40a694686a2659008702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.314806 14038 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f93cc2dc14fc7a421732042343593 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:26.315809 14113 tablet_service.cc:1511] Processing CreateTablet for tablet ea7f93cc2dc14fc7a421732042343593 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:26.316409 14039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318063b1f2d345dba058bb92a195979d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.317289 14113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f93cc2dc14fc7a421732042343593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.317030 13966 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc62ce8de14405d84da7bdb158e98a0 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:26.318435 13966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc62ce8de14405d84da7bdb158e98a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.331801 14038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7f93cc2dc14fc7a421732042343593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.332362 14037 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc62ce8de14405d84da7bdb158e98a0 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:26.333880 14037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc62ce8de14405d84da7bdb158e98a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.346544 14112 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc62ce8de14405d84da7bdb158e98a0 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:26.348168 14112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc62ce8de14405d84da7bdb158e98a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.349009 13967 tablet_service.cc:1511] Processing CreateTablet for tablet a2483c6e42844b19b63bd566ae118607 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.350412 13967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2483c6e42844b19b63bd566ae118607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.359372 14036 tablet_service.cc:1511] Processing CreateTablet for tablet a2483c6e42844b19b63bd566ae118607 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.361095 14036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2483c6e42844b19b63bd566ae118607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.362107 14111 tablet_service.cc:1511] Processing CreateTablet for tablet a2483c6e42844b19b63bd566ae118607 (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:26.363833 14111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2483c6e42844b19b63bd566ae118607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.364774 13968 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab33e23f5e3441a80b88bf7cdd0755b (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.366247 13968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab33e23f5e3441a80b88bf7cdd0755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.379143 14035 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab33e23f5e3441a80b88bf7cdd0755b (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.380962 14035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab33e23f5e3441a80b88bf7cdd0755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.391511 14110 tablet_service.cc:1511] Processing CreateTablet for tablet 8ab33e23f5e3441a80b88bf7cdd0755b (DEFAULT_TABLE table=test-workload [id=fdde69ff3d7042a28e8263adbe7cba85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:26.393270 14110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ab33e23f5e3441a80b88bf7cdd0755b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:26.401227 14168 tablet_bootstrap.cc:654] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.427508 14169 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.439581 14169 tablet_bootstrap.cc:654] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.439747 14168 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.440390 14168 ts_tablet_manager.cc:1403] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.003s
I20260709 12:25:26.443697 14168 raft_consensus.cc:359] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.444490 14168 raft_consensus.cc:385] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.444796 14168 raft_consensus.cc:740] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.445564 14168 consensus_queue.cc:260] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.484302 14171 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.490962 14171 tablet_bootstrap.cc:654] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.492614 14003 heartbeater.cc:499] Master 127.2.157.126:39635 was elected leader, sending a full tablet report...
I20260709 12:25:26.493816 14169 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.493722 14168 ts_tablet_manager.cc:1434] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 12:25:26.494587 14169 ts_tablet_manager.cc:1403] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.021s
I20260709 12:25:26.495329 14168 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.497784 14169 raft_consensus.cc:359] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.498687 14169 raft_consensus.cc:385] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.502785 14169 raft_consensus.cc:740] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.502942 14168 tablet_bootstrap.cc:654] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.503867 14169 consensus_queue.cc:260] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.514559 14168 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.514586 14171 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.515416 14168 ts_tablet_manager.cc:1403] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:25:26.515416 14171 ts_tablet_manager.cc:1403] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.013s
I20260709 12:25:26.518795 14168 raft_consensus.cc:359] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.519073 14171 raft_consensus.cc:359] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.519680 14168 raft_consensus.cc:385] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.519883 14171 raft_consensus.cc:385] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.520030 14168 raft_consensus.cc:740] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.520218 14171 raft_consensus.cc:740] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.521061 14171 consensus_queue.cc:260] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.521045 14168 consensus_queue.cc:260] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.524375 14168 ts_tablet_manager.cc:1434] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:26.525947 14168 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.533860 14171 ts_tablet_manager.cc:1434] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:25:26.534976 14153 heartbeater.cc:499] Master 127.2.157.126:39635 was elected leader, sending a full tablet report...
I20260709 12:25:26.535259 14171 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.535817 14168 tablet_bootstrap.cc:654] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.542654 14168 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.543216 14168 ts_tablet_manager.cc:1403] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:25:26.543699 14171 tablet_bootstrap.cc:654] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.546772 14168 raft_consensus.cc:359] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.548059 14168 raft_consensus.cc:385] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.548506 14168 raft_consensus.cc:740] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.549880 14168 consensus_queue.cc:260] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.553812 14168 ts_tablet_manager.cc:1434] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:25:26.555390 14168 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.559254 14171 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.560004 14171 ts_tablet_manager.cc:1403] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.013s
I20260709 12:25:26.563382 14171 raft_consensus.cc:359] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.564307 14171 raft_consensus.cc:385] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.564646 14171 raft_consensus.cc:740] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.565691 14171 consensus_queue.cc:260] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.567530 14168 tablet_bootstrap.cc:654] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.568630 14171 ts_tablet_manager.cc:1434] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:25:26.570003 14171 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.573978 14079 heartbeater.cc:499] Master 127.2.157.126:39635 was elected leader, sending a full tablet report...
I20260709 12:25:26.574592 14169 ts_tablet_manager.cc:1434] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.080s	user 0.031s	sys 0.043s
I20260709 12:25:26.575987 14169 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.578023 14171 tablet_bootstrap.cc:654] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.582980 14169 tablet_bootstrap.cc:654] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.588455 14168 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.589326 14168 ts_tablet_manager.cc:1403] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.007s
I20260709 12:25:26.593536 14168 raft_consensus.cc:359] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.594748 14168 raft_consensus.cc:385] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.595252 14168 raft_consensus.cc:740] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.598021 14168 consensus_queue.cc:260] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.599526 14171 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.600276 14171 ts_tablet_manager.cc:1403] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.007s
I20260709 12:25:26.601900 14168 ts_tablet_manager.cc:1434] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:25:26.603758 14168 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.603806 14171 raft_consensus.cc:359] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.604939 14171 raft_consensus.cc:385] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.605300 14171 raft_consensus.cc:740] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.606398 14171 consensus_queue.cc:260] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.609658 14177 raft_consensus.cc:493] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.610196 14177 raft_consensus.cc:515] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.614496 14168 tablet_bootstrap.cc:654] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.628544 14168 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.629359 14168 ts_tablet_manager.cc:1403] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.015s
I20260709 12:25:26.629954 14177 leader_election.cc:290] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:26.633337 14168 raft_consensus.cc:359] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.634505 14168 raft_consensus.cc:385] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.634893 14168 raft_consensus.cc:740] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.636086 14168 consensus_queue.cc:260] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.636516 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
W20260709 12:25:26.639015 14093 leader_election.cc:343] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.641990 14168 ts_tablet_manager.cc:1434] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:26.644340 14168 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.652334 14171 ts_tablet_manager.cc:1434] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 12:25:26.653471 14168 tablet_bootstrap.cc:654] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.653715 14171 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.667618 14168 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.668376 14168 ts_tablet_manager.cc:1403] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:25:26.671600 14169 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.672294 14169 ts_tablet_manager.cc:1403] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.097s	user 0.044s	sys 0.048s
I20260709 12:25:26.672346 14168 raft_consensus.cc:359] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.673286 14168 raft_consensus.cc:385] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.673688 14168 raft_consensus.cc:740] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.674541 14168 consensus_queue.cc:260] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.677330 14168 ts_tablet_manager.cc:1434] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:25:26.678113 14171 tablet_bootstrap.cc:654] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.680084 14177 raft_consensus.cc:493] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.675168 14169 raft_consensus.cc:359] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.680680 14169 raft_consensus.cc:385] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.678613 14168 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.680680 14177 raft_consensus.cc:515] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.681120 14169 raft_consensus.cc:740] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.682396 14169 consensus_queue.cc:260] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.683537 14177 leader_election.cc:290] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:26.684296 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:26.684726 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.685164 14169 ts_tablet_manager.cc:1434] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
W20260709 12:25:26.686116 14093 leader_election.cc:343] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.686412 14169 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
W20260709 12:25:26.686801 14091 leader_election.cc:343] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.687310 14091 leader_election.cc:304] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:26.687543 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.689258 14177 raft_consensus.cc:2749] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:26.690493 14091 leader_election.cc:343] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.691195 14091 leader_election.cc:304] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:26.692338 14168 tablet_bootstrap.cc:654] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.692700 14177 raft_consensus.cc:2749] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.694587 14169 tablet_bootstrap.cc:654] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.704639 14171 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.705238 14171 ts_tablet_manager.cc:1403] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.003s
I20260709 12:25:26.706673 14168 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.707288 14168 ts_tablet_manager.cc:1403] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 12:25:26.708506 14171 raft_consensus.cc:359] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.709342 14171 raft_consensus.cc:385] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.709627 14171 raft_consensus.cc:740] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.710727 14171 consensus_queue.cc:260] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.711412 14168 raft_consensus.cc:359] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.712312 14168 raft_consensus.cc:385] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.712641 14168 raft_consensus.cc:740] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.713598 14168 consensus_queue.cc:260] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.714843 14169 tablet_bootstrap.cc:492] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.715608 14169 ts_tablet_manager.cc:1403] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 12:25:26.716002 14168 ts_tablet_manager.cc:1434] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:25:26.717228 14168 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.718716 14171 ts_tablet_manager.cc:1434] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:26.719980 14171 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.719609 14169 raft_consensus.cc:359] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.720849 14169 raft_consensus.cc:385] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.721333 14169 raft_consensus.cc:740] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.722296 14169 consensus_queue.cc:260] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.724819 14169 ts_tablet_manager.cc:1434] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:26.725518 14168 tablet_bootstrap.cc:654] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.726125 14169 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
W20260709 12:25:26.730842 13924 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:26.731845 14177 raft_consensus.cc:493] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.732659 14177 raft_consensus.cc:515] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.737026 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:26.737738 13978 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 0.
I20260709 12:25:26.737901 14169 tablet_bootstrap.cc:654] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.737668 14168 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.739081 14168 ts_tablet_manager.cc:1403] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:25:26.740335 14093 leader_election.cc:304] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:26.742152 14168 raft_consensus.cc:359] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.743033 14168 raft_consensus.cc:385] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.743330 14168 raft_consensus.cc:740] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.744424 14168 consensus_queue.cc:260] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.747715 14168 ts_tablet_manager.cc:1434] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:26.748615 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.748903 14177 leader_election.cc:290] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:26.749593 14177 raft_consensus.cc:2804] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.749466 14054 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 0.
I20260709 12:25:26.751232 14169 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.751708 14177 raft_consensus.cc:493] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.751963 14169 ts_tablet_manager.cc:1403] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 12:25:26.752449 14177 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.753470 14168 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:26.755316 14169 raft_consensus.cc:359] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.756131 14169 raft_consensus.cc:385] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.756424 14169 raft_consensus.cc:740] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.757880 14169 consensus_queue.cc:260] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.760500 14169 ts_tablet_manager.cc:1434] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:26.761802 14169 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.764568 14171 tablet_bootstrap.cc:654] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.769155 14169 tablet_bootstrap.cc:654] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.772140 14177 raft_consensus.cc:515] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.776041 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:26.777055 14054 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.777153 14171 tablet_bootstrap.cc:492] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.777920 14171 ts_tablet_manager.cc:1403] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.003s
I20260709 12:25:26.779204 14168 tablet_bootstrap.cc:654] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.780928 14169 tablet_bootstrap.cc:492] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.781530 14169 ts_tablet_manager.cc:1403] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:25:26.781386 14171 raft_consensus.cc:359] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.782286 14171 raft_consensus.cc:385] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.782621 14171 raft_consensus.cc:740] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.783681 14171 consensus_queue.cc:260] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.786294 14171 ts_tablet_manager.cc:1434] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:26.786626 14173 raft_consensus.cc:493] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.787225 14173 raft_consensus.cc:515] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.787914 14171 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.790086 14173 leader_election.cc:290] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.786304 14169 raft_consensus.cc:359] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.792861 14169 raft_consensus.cc:385] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.793283 14169 raft_consensus.cc:740] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.794533 14169 consensus_queue.cc:260] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.798511 14169 ts_tablet_manager.cc:1434] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:25:26.800208 14169 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.808701 14175 raft_consensus.cc:493] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.809877 14169 tablet_bootstrap.cc:654] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.809723 14175 raft_consensus.cc:515] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.818276 14175 leader_election.cc:290] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.830184 14169 tablet_bootstrap.cc:492] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.831075 14169 ts_tablet_manager.cc:1403] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.010s
I20260709 12:25:26.835211 14168 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:26.857393 14175 raft_consensus.cc:493] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.857745 14168 ts_tablet_manager.cc:1403] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.016s
I20260709 12:25:26.835913 14169 raft_consensus.cc:359] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.838811 14171 tablet_bootstrap.cc:654] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.858628 14169 raft_consensus.cc:385] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.859120 14169 raft_consensus.cc:740] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.860342 14169 consensus_queue.cc:260] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.858211 14175 raft_consensus.cc:515] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.861006 14168 raft_consensus.cc:359] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.864912 14168 raft_consensus.cc:385] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.865216 14168 raft_consensus.cc:740] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.865849 14169 ts_tablet_manager.cc:1434] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.003s
I20260709 12:25:26.866984 14169 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.849426 14054 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:26.854943 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:26.868067 13978 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.871511 14168 consensus_queue.cc:260] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.872263 14091 leader_election.cc:304] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:26.873409 14190 raft_consensus.cc:2804] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.865638 14053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.875046 14169 tablet_bootstrap.cc:654] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.875157 14053 raft_consensus.cc:2468] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:26.884328 14168 ts_tablet_manager.cc:1434] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:25:26.887683 14175 leader_election.cc:290] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.889272 13941 leader_election.cc:304] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:26.892340 14173 raft_consensus.cc:2804] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.892809 14173 raft_consensus.cc:493] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.893189 14173 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.841733 14177 leader_election.cc:290] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:26.903283 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:26.905439 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:26.906045 14173 raft_consensus.cc:515] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.907969 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
W20260709 12:25:26.908416 14017 leader_election.cc:343] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.908851 13977 raft_consensus.cc:2468] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:26.909430 14173 leader_election.cc:290] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
W20260709 12:25:26.909612 14017 leader_election.cc:343] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.910583 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:26.912848 14018 leader_election.cc:304] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:26.911696 14053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:26.911746 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:26.913231 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:26.913820 14053 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.915756 14190 raft_consensus.cc:697] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:26.916786 14190 consensus_queue.cc:237] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:26.903077 13978 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:26.914232 14128 raft_consensus.cc:2468] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:26.913470 13977 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:26.921401 14175 raft_consensus.cc:2804] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.921865 14175 raft_consensus.cc:493] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.922223 14175 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.925208 14171 tablet_bootstrap.cc:492] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.926149 14171 ts_tablet_manager.cc:1403] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.009s
I20260709 12:25:26.926904 14018 leader_election.cc:304] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:26.930979 14203 raft_consensus.cc:2804] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.931612 14203 raft_consensus.cc:493] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.930773 14171 raft_consensus.cc:359] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.932088 14203 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.932631 14171 raft_consensus.cc:385] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.933337 14171 raft_consensus.cc:740] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.934790 14171 consensus_queue.cc:260] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.933844 14175 raft_consensus.cc:515] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.938577 14171 ts_tablet_manager.cc:1434] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:25:26.939908 14171 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:26.940359 14173 raft_consensus.cc:493] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.944621 14203 raft_consensus.cc:515] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.941080 14173 raft_consensus.cc:515] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.950666 14175 leader_election.cc:290] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.951081 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:26.946424 13871 catalog_manager.cc:5697] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 0 to 1, leader changed from <none> to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 1 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.951762 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
W20260709 12:25:26.952901 14017 leader_election.cc:343] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.953629 14208 raft_consensus.cc:493] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.953858 14203 leader_election.cc:290] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.954180 14208 raft_consensus.cc:515] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.955358 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:26.956179 14127 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.957147 14173 leader_election.cc:290] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.957321 14208 leader_election.cc:290] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.947273 14053 raft_consensus.cc:2468] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:26.957968 14173 raft_consensus.cc:493] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.948612 14171 tablet_bootstrap.cc:654] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.951327 14169 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:26.960713 14169 ts_tablet_manager.cc:1403] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.094s	user 0.029s	sys 0.031s
I20260709 12:25:26.961094 14208 raft_consensus.cc:493] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.961472 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:26.961689 14208 raft_consensus.cc:515] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
W20260709 12:25:26.964923 13941 leader_election.cc:343] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.965970 13941 leader_election.cc:304] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:26.964133 14173 raft_consensus.cc:515] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.967767 14208 leader_election.cc:290] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.969449 14053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.971589 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.971609 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:26.972620 14054 raft_consensus.cc:2468] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:26.973003 14128 raft_consensus.cc:2468] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:26.969496 14169 raft_consensus.cc:359] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
W20260709 12:25:26.975399 13941 leader_election.cc:343] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.975908 14169 raft_consensus.cc:385] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.976397 14169 raft_consensus.cc:740] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.976470 13941 leader_election.cc:304] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:26.977440 14208 raft_consensus.cc:2804] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.978735 14208 raft_consensus.cc:493] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.979220 14208 raft_consensus.cc:3060] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.979399 14127 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:26.980566 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:26.981304 14054 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:26.982360 14017 leader_election.cc:304] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:26.982379 13941 leader_election.cc:304] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:26.983184 14203 raft_consensus.cc:2804] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.977413 14169 consensus_queue.cc:260] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.977506 14209 raft_consensus.cc:2804] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.984176 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:26.989178 13977 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.984439 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:26.984882 14203 raft_consensus.cc:697] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
W20260709 12:25:26.986989 13942 leader_election.cc:343] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.988124 14173 leader_election.cc:290] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:26.992842 14169 ts_tablet_manager.cc:1434] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:25:26.993619 14171 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:26.995563 14173 raft_consensus.cc:2804] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.994302 14203 consensus_queue.cc:237] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:26.996155 13978 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.997380 14209 raft_consensus.cc:697] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:26.998545 14169 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:26.998617 14209 consensus_queue.cc:237] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.003768 14171 ts_tablet_manager.cc:1403] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.013s
I20260709 12:25:27.007323 14169 tablet_bootstrap.cc:654] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.997558 14173 raft_consensus.cc:493] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.996737 13942 leader_election.cc:304] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:27.014137 14173 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.013914 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:27.021786 14209 raft_consensus.cc:493] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.022338 14209 raft_consensus.cc:515] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.021427 13977 raft_consensus.cc:2468] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:27.025480 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:27.026670 14054 raft_consensus.cc:2468] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:27.026782 14127 raft_consensus.cc:2468] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:27.028357 13941 leader_election.cc:304] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.026993 13942 leader_election.cc:304] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.028174 13875 catalog_manager.cc:5697] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.036564 14171 raft_consensus.cc:359] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.037580 14171 raft_consensus.cc:385] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.037979 14171 raft_consensus.cc:740] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.038092 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:27.039565 14127 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:27.032931 14208 raft_consensus.cc:515] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.040809 14209 leader_election.cc:290] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.046687 14169 tablet_bootstrap.cc:492] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:27.049546 14169 ts_tablet_manager.cc:1403] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.009s
I20260709 12:25:27.045377 14018 leader_election.cc:304] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:27.051385 14175 raft_consensus.cc:2804] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.054384 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:27.055152 14216 raft_consensus.cc:2804] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.056262 14212 raft_consensus.cc:2749] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:27.057137 13942 leader_election.cc:343] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.058678 14216 raft_consensus.cc:493] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.062939 14169 raft_consensus.cc:359] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.063282 14216 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.066326 13978 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:27.066923 14173 raft_consensus.cc:515] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.042944 14171 consensus_queue.cc:260] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.069119 14190 raft_consensus.cc:493] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.069613 14190 raft_consensus.cc:515] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.071348 14171 ts_tablet_manager.cc:1434] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.001s
I20260709 12:25:27.071893 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.072489 14173 leader_election.cc:290] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.072570 14054 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.073859 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.074615 14218 raft_consensus.cc:2804] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.077527 14218 raft_consensus.cc:493] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.077914 14053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.078661 14208 leader_election.cc:290] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.079036 14053 raft_consensus.cc:3060] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.074864 14127 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.082736 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
W20260709 12:25:27.084563 14091 leader_election.cc:343] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.085234 14190 leader_election.cc:290] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:27.092283 14127 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.094666 14054 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.095484 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9769e8506ffa4d5daa44143077fa0e3e" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.096313 13941 leader_election.cc:304] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.096517 14128 raft_consensus.cc:3060] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.097570 14208 raft_consensus.cc:2804] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.097834 14169 raft_consensus.cc:385] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.098208 14208 raft_consensus.cc:697] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.099192 14208 consensus_queue.cc:237] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.098209 14169 raft_consensus.cc:740] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.101931 14169 consensus_queue.cc:260] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.104115 13875 catalog_manager.cc:5697] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.105582 14128 raft_consensus.cc:2468] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.106784 14175 raft_consensus.cc:697] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.108183 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:27.109006 13978 raft_consensus.cc:2468] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 0.
I20260709 12:25:27.108212 14175 consensus_queue.cc:237] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.109934 14169 ts_tablet_manager.cc:1434] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:25:27.110452 14093 leader_election.cc:304] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.111140 14169 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:27.111963 14190 raft_consensus.cc:2804] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.112393 14190 raft_consensus.cc:493] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.112757 14190 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.117692 14169 tablet_bootstrap.cc:654] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.118664 13874 catalog_manager.cc:5697] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.075803 14171 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:27.122697 14216 raft_consensus.cc:515] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.138299 14216 leader_election.cc:290] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.138898 14053 raft_consensus.cc:2468] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.131623 14169 tablet_bootstrap.cc:492] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:27.138924 14171 tablet_bootstrap.cc:654] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.139855 14190 raft_consensus.cc:515] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.140450 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.141906 14054 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.139902 14169 ts_tablet_manager.cc:1403] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.002s
I20260709 12:25:27.148806 14169 raft_consensus.cc:359] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.149899 14169 raft_consensus.cc:385] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.150040 14054 raft_consensus.cc:2468] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.151692 13941 leader_election.cc:304] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.152689 14216 raft_consensus.cc:2804] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.154035 14216 raft_consensus.cc:697] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.154991 14216 consensus_queue.cc:237] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.078069 14218 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.164233 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.120841 13942 leader_election.cc:304] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.166844 14190 leader_election.cc:290] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:27.150341 14169 raft_consensus.cc:740] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.169382 14169 consensus_queue.cc:260] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.168394 13875 catalog_manager.cc:5697] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.170406 14208 raft_consensus.cc:2804] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.170792 14052 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.171015 14208 raft_consensus.cc:697] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.172216 14208 consensus_queue.cc:237] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
W20260709 12:25:27.173732 13942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37705, user_credentials={real_user=slave}} blocked reactor thread for 52990.2us
I20260709 12:25:27.175884 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.176517 14128 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.182363 14052 raft_consensus.cc:2468] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:27.185674 14169 ts_tablet_manager.cc:1434] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:25:27.187956 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:27.188712 13978 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.189574 14171 tablet_bootstrap.cc:492] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:27.190173 14171 ts_tablet_manager.cc:1403] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.025s
I20260709 12:25:27.193194 14171 raft_consensus.cc:359] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.193347 14218 raft_consensus.cc:515] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.193897 14171 raft_consensus.cc:385] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.194238 14171 raft_consensus.cc:740] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.194986 14171 consensus_queue.cc:260] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.194998 14128 raft_consensus.cc:2468] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.196993 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.197520 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.198212 14054 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:27.198794 13942 leader_election.cc:343] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.202554 14171 ts_tablet_manager.cc:1434] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:27.203836 14171 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:27.205704 13978 raft_consensus.cc:2468] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:27.207665 14093 leader_election.cc:304] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.208701 14190 raft_consensus.cc:2804] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.209241 14190 raft_consensus.cc:697] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:27.197122 14218 leader_election.cc:290] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.210248 14171 tablet_bootstrap.cc:654] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.215481 13871 catalog_manager.cc:5697] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.210148 14190 consensus_queue.cc:237] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.223778 14054 raft_consensus.cc:2468] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:27.225342 13941 leader_election.cc:304] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:27.226264 14218 raft_consensus.cc:2804] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.226773 14218 raft_consensus.cc:697] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.228039 14218 consensus_queue.cc:237] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.247819 14171 tablet_bootstrap.cc:492] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:27.248313 14171 ts_tablet_manager.cc:1403] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.027s
I20260709 12:25:27.249933 13871 catalog_manager.cc:5697] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.251000 14171 raft_consensus.cc:359] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.251788 14171 raft_consensus.cc:385] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.252053 14171 raft_consensus.cc:740] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.252739 14171 consensus_queue.cc:260] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.252172 13871 catalog_manager.cc:5697] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.254585 14171 ts_tablet_manager.cc:1434] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:27.253914 13874 catalog_manager.cc:5697] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 0 to 1, leader changed from <none> to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 1 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.374193 14190 consensus_queue.cc:1048] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.380328 14190 consensus_queue.cc:1048] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.394495 14190 raft_consensus.cc:493] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.395011 14190 raft_consensus.cc:515] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.398027 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:27.399061 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:27.400022 14052 raft_consensus.cc:2393] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 369fbc56c44d43ecb8d0b98a99c1897a in current term 1: Already voted for candidate 9cfa711068644412a359cc73ead1d7f1 in this term.
I20260709 12:25:27.400753 14190 leader_election.cc:290] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:27.401278 14091 leader_election.cc:304] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:27.402032 14190 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.408875 14175 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.414434 14190 raft_consensus.cc:2749] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.442628 14127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
mode: GRACEFUL
new_leader_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:55396
I20260709 12:25:27.443370 14127 raft_consensus.cc:606] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Received request to transfer leadership to TS 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:27.456332 14175 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.467861 14128 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.474176 14052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:45240
I20260709 12:25:27.474977 14052 raft_consensus.cc:606] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Received request to transfer leadership to TS 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:27.479334 14218 consensus_queue.cc:1048] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.482412 14127 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ecd1f0895f40a694686a2659008702"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
mode: GRACEFUL
new_leader_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:55396
I20260709 12:25:27.483135 14127 raft_consensus.cc:606] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Received request to transfer leadership to TS 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:27.493846 14208 consensus_queue.cc:1048] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.499228 14208 consensus_queue.cc:1048] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.516718 13978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "318063b1f2d345dba058bb92a195979d"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:27.517465 13978 raft_consensus.cc:606] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.519153 14208 consensus_queue.cc:1048] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.527956 13978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:27.528719 13978 raft_consensus.cc:606] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.536995 13978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:27.537662 13978 raft_consensus.cc:606] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.544849 13978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:27.545604 13978 raft_consensus.cc:606] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:27.546034 14208 raft_consensus.cc:993] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.546620 14208 raft_consensus.cc:1081] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.548780 14054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:27.549525 14054 raft_consensus.cc:493] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.550045 14054 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.552992 14052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:45240
I20260709 12:25:27.553763 14052 raft_consensus.cc:606] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Received request to transfer leadership to TS 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:27.553964 14175 consensus_queue.cc:1048] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.561304 14054 raft_consensus.cc:515] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.563710 14054 leader_election.cc:290] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.564481 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:27.565263 13977 raft_consensus.cc:3055] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.565692 13977 raft_consensus.cc:740] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.566658 13977 consensus_queue.cc:260] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.568414 13977 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.566839 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc62ce8de14405d84da7bdb158e98a0" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.569614 14128 raft_consensus.cc:3060] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.570248 14127 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.580766 14249 consensus_queue.cc:1048] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.581264 14128 raft_consensus.cc:2468] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:27.582916 14017 leader_election.cc:304] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:27.582974 13977 raft_consensus.cc:2468] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:27.584056 14249 raft_consensus.cc:2804] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.584591 14249 raft_consensus.cc:697] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.586024 14249 consensus_queue.cc:237] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.591199 14175 raft_consensus.cc:993] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:27.591876 14249 raft_consensus.cc:1081] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Signalling peer 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:27.593709 14128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:55386
I20260709 12:25:27.594377 14128 raft_consensus.cc:493] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.594830 14128 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.594822 13871 catalog_manager.cc:5697] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.601790 14128 raft_consensus.cc:515] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.603964 14128 leader_election.cc:290] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:27.605743 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:27.606043 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ab33e23f5e3441a80b88bf7cdd0755b" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.606447 13977 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.606788 14054 raft_consensus.cc:3055] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.607161 14054 raft_consensus.cc:740] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.608790 14054 consensus_queue.cc:260] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.610266 14054 raft_consensus.cc:3060] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.612954 13977 raft_consensus.cc:2468] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 2.
I20260709 12:25:27.614197 14093 leader_election.cc:304] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.615090 14177 raft_consensus.cc:2804] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.615659 14177 raft_consensus.cc:697] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:27.616459 14177 consensus_queue.cc:237] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.616884 14054 raft_consensus.cc:2468] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 2.
I20260709 12:25:27.623626 13871 catalog_manager.cc:5697] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 1 to 2, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 2 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.645850 14177 consensus_queue.cc:1048] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.646232 14212 consensus_queue.cc:1048] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.662681 14173 consensus_queue.cc:1048] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.663661 14190 consensus_queue.cc:1048] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.673771 14216 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.674185 14173 consensus_queue.cc:1048] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.678135 14190 raft_consensus.cc:993] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: : Instructing follower 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.678854 14205 raft_consensus.cc:1081] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Signalling peer 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.684504 13977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ecd1f0895f40a694686a2659008702"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:25:27.685223 13977 raft_consensus.cc:493] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.685807 13977 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.700479 14216 raft_consensus.cc:993] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.701303 14216 raft_consensus.cc:1081] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.703737 13977 raft_consensus.cc:515] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.706228 13977 leader_election.cc:290] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.707834 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.708217 14173 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.710716 14051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ecd1f0895f40a694686a2659008702" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.711467 14051 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.714998 14212 raft_consensus.cc:993] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.715606 14212 raft_consensus.cc:1081] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:27.708149 14054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:27.717171 14054 raft_consensus.cc:493] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.717576 14054 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.708645 14128 raft_consensus.cc:3055] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.720853 14128 raft_consensus.cc:740] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:27.722064 14048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "318063b1f2d345dba058bb92a195979d"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:27.722857 14048 raft_consensus.cc:493] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.723261 14048 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.725080 14216 consensus_queue.cc:1048] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.737195 14128 consensus_queue.cc:260] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.747361 14051 raft_consensus.cc:2468] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.750960 13941 leader_election.cc:304] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.752013 14216 raft_consensus.cc:2804] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.747097 14048 raft_consensus.cc:515] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.752533 14216 raft_consensus.cc:697] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.753521 14216 consensus_queue.cc:237] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.748795 14054 raft_consensus.cc:515] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.756078 14126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.756739 14052 raft_consensus.cc:1240] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Rejecting Update request from peer 9cfa711068644412a359cc73ead1d7f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:27.757897 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:27.756836 14126 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.758643 13978 raft_consensus.cc:3055] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.750357 14128 raft_consensus.cc:3060] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.759006 13978 raft_consensus.cc:740] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.759328 14125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.761204 13978 consensus_queue.cc:260] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.759948 14048 leader_election.cc:290] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.762238 13978 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.760353 14054 leader_election.cc:290] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.763789 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318063b1f2d345dba058bb92a195979d" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:27.764487 13977 raft_consensus.cc:3055] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.764820 13977 raft_consensus.cc:740] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.765720 13977 consensus_queue.cc:260] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.767037 13977 raft_consensus.cc:3060] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.768210 14126 raft_consensus.cc:2468] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:27.769663 14017 leader_election.cc:304] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:27.770637 14175 raft_consensus.cc:2804] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.771137 14175 raft_consensus.cc:697] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.772147 14128 raft_consensus.cc:2468] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.772023 14175 consensus_queue.cc:237] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.775158 13871 catalog_manager.cc:5697] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 1 to 2, leader changed from 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67) to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.784822 13978 raft_consensus.cc:2468] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:27.786183 13977 raft_consensus.cc:2468] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:27.786288 14018 leader_election.cc:304] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:27.788129 14175 raft_consensus.cc:2804] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.788743 14175 raft_consensus.cc:697] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.789510 14175 consensus_queue.cc:237] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.789731 13873 catalog_manager.cc:5697] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.803671 13873 catalog_manager.cc:5697] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.854707 14190 raft_consensus.cc:993] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: : Instructing follower 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.855230 14205 raft_consensus.cc:1081] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Signalling peer 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.857208 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:25:27.857831 13978 raft_consensus.cc:493] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.858213 13978 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.864202 13978 raft_consensus.cc:515] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:27.865968 13978 leader_election.cc:290] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Requested vote from peers 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:27.867141 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.867141 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75edc7d73e2240d19803d5818dadea26" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.868204 14127 raft_consensus.cc:3055] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.868263 14052 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.868690 14127 raft_consensus.cc:740] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:27.869606 14127 consensus_queue.cc:260] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:27.870976 14127 raft_consensus.cc:3060] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.876649 14052 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.878275 13941 leader_election.cc:304] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.878805 14127 raft_consensus.cc:2468] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.879099 14216 raft_consensus.cc:2804] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.879719 14216 raft_consensus.cc:697] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.880573 14216 consensus_queue.cc:237] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:27.887961 13873 catalog_manager.cc:5697] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 1 to 2, leader changed from 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67) to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.969278 14249 raft_consensus.cc:993] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.969843 14175 raft_consensus.cc:1081] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Signalling peer 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:27.971649 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:27.972441 13978 raft_consensus.cc:493] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.972852 13978 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.979161 13978 raft_consensus.cc:515] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.981045 13978 leader_election.cc:290] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:27.982228 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:27.982228 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:27.983222 14127 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.983240 14052 raft_consensus.cc:3055] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:27.983839 14052 raft_consensus.cc:740] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:27.984786 14052 consensus_queue.cc:260] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:27.986162 14052 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.992098 14127 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.993716 13942 leader_election.cc:304] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:27.993949 14052 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:27.994690 14216 raft_consensus.cc:2804] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:27.995241 14216 raft_consensus.cc:697] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:27.996170 14216 consensus_queue.cc:237] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:28.003808 13873 catalog_manager.cc:5697] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 1 to 2, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.008430 14212 raft_consensus.cc:993] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:28.009050 14216 raft_consensus.cc:1081] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:28.010977 14052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:28.011636 14052 raft_consensus.cc:493] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.012092 14052 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.017962 14052 raft_consensus.cc:515] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:28.019762 14052 leader_election.cc:290] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:28.020763 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:28.021001 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7f93cc2dc14fc7a421732042343593" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:28.021435 13978 raft_consensus.cc:3055] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:28.021695 14127 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.021983 13978 raft_consensus.cc:740] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:28.022886 13978 consensus_queue.cc:260] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:28.024525 13978 raft_consensus.cc:3060] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.029003 14127 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:28.030789 14017 leader_election.cc:304] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:28.031567 13978 raft_consensus.cc:2468] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:28.031718 14175 raft_consensus.cc:2804] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:28.032599 14175 raft_consensus.cc:697] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:28.033567 14175 consensus_queue.cc:237] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:28.036525 14127 raft_consensus.cc:1275] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.038272 14175 consensus_queue.cc:1048] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.042317 13873 catalog_manager.cc:5697] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:28.047627 13978 raft_consensus.cc:1275] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.049968 14220 consensus_queue.cc:1048] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:28.120244 14052 raft_consensus.cc:1275] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.121680 14205 consensus_queue.cc:1048] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.129966 13978 raft_consensus.cc:1275] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.131639 14205 consensus_queue.cc:1048] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.184520 14052 raft_consensus.cc:1275] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.186023 14216 consensus_queue.cc:1048] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.187676 14127 raft_consensus.cc:1275] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.189201 14203 consensus_queue.cc:1048] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.198817 14127 raft_consensus.cc:1275] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.201221 14208 consensus_queue.cc:1048] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.202103 13978 raft_consensus.cc:1275] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.203680 14220 consensus_queue.cc:1048] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.265059 14128 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.271265 14128 raft_consensus.cc:1275] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.277408 14220 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:28.287317 13978 raft_consensus.cc:1275] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.289372 14220 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.341668 14052 raft_consensus.cc:1275] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.343197 14218 consensus_queue.cc:1048] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.351773 14128 raft_consensus.cc:1275] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.354117 14212 consensus_queue.cc:1048] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.398947 14128 raft_consensus.cc:1275] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.400640 14212 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.409528 14052 raft_consensus.cc:1275] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.411656 14212 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.564038 14128 raft_consensus.cc:1275] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.565609 14220 consensus_queue.cc:1048] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.575141 13978 raft_consensus.cc:1275] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:28.577026 14175 consensus_queue.cc:1048] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:30.594511 13873 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58608:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:30.597891 13873 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:30.658931 13968 tablet_service.cc:1511] Processing CreateTablet for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.660583 14041 tablet_service.cc:1511] Processing CreateTablet for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.661343 13968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.663537 14111 tablet_service.cc:1511] Processing CreateTablet for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:30.665442 14111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.665453 13964 tablet_service.cc:1511] Processing CreateTablet for tablet a5d690d7b547482eb81999263fbadead (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.662411 14041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797b5bf6b9a3475ebb3bbbb2b3a9f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.669979 13963 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9f787a94e4404687036cca33c93fec (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.667284 13964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d690d7b547482eb81999263fbadead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.672693 14110 tablet_service.cc:1511] Processing CreateTablet for tablet a5d690d7b547482eb81999263fbadead (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.672811 14118 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9f787a94e4404687036cca33c93fec (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.674448 14110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d690d7b547482eb81999263fbadead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.676271 14039 tablet_service.cc:1511] Processing CreateTablet for tablet a5d690d7b547482eb81999263fbadead (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:30.677964 14039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5d690d7b547482eb81999263fbadead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.678653 13965 tablet_service.cc:1511] Processing CreateTablet for tablet 6e288a7bd7034820b4301433f4c7fded (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.680212 13965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e288a7bd7034820b4301433f4c7fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.682072 14115 tablet_service.cc:1511] Processing CreateTablet for tablet 6e288a7bd7034820b4301433f4c7fded (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.684396 14115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e288a7bd7034820b4301433f4c7fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.689738 14116 tablet_service.cc:1511] Processing CreateTablet for tablet 3afe1786152a417baff62472dac99aae (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.687110 13967 tablet_service.cc:1511] Processing CreateTablet for tablet 3afe1786152a417baff62472dac99aae (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.690733 14036 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9f787a94e4404687036cca33c93fec (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:30.688323 13963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9f787a94e4404687036cca33c93fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.691589 14116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afe1786152a417baff62472dac99aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.692425 14036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9f787a94e4404687036cca33c93fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.695009 13967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afe1786152a417baff62472dac99aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.700559 13966 tablet_service.cc:1511] Processing CreateTablet for tablet 42bdf9c3d65d482a84490fd93843a282 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.702224 13966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bdf9c3d65d482a84490fd93843a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.704015 14118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9f787a94e4404687036cca33c93fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.703670 14117 tablet_service.cc:1511] Processing CreateTablet for tablet 42bdf9c3d65d482a84490fd93843a282 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.705389 14117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bdf9c3d65d482a84490fd93843a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.705569 14037 tablet_service.cc:1511] Processing CreateTablet for tablet 6e288a7bd7034820b4301433f4c7fded (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:30.707201 14037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e288a7bd7034820b4301433f4c7fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.712705 14040 tablet_service.cc:1511] Processing CreateTablet for tablet 3afe1786152a417baff62472dac99aae (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:30.714481 14040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afe1786152a417baff62472dac99aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.726274 14038 tablet_service.cc:1511] Processing CreateTablet for tablet 42bdf9c3d65d482a84490fd93843a282 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:30.728359 14038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bdf9c3d65d482a84490fd93843a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.731737 13962 tablet_service.cc:1511] Processing CreateTablet for tablet 23b42d6021214b3bb8e1ac499c708f30 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.733434 13962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b42d6021214b3bb8e1ac499c708f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.739498 14112 tablet_service.cc:1511] Processing CreateTablet for tablet 23b42d6021214b3bb8e1ac499c708f30 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.741168 14112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b42d6021214b3bb8e1ac499c708f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.755056 14043 tablet_service.cc:1511] Processing CreateTablet for tablet 23b42d6021214b3bb8e1ac499c708f30 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:30.756635 14043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b42d6021214b3bb8e1ac499c708f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.760861 14114 tablet_service.cc:1511] Processing CreateTablet for tablet 40782225684c4635b2808080a9158519 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.762503 14114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40782225684c4635b2808080a9158519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.766103 14042 tablet_service.cc:1511] Processing CreateTablet for tablet 40782225684c4635b2808080a9158519 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.766168 13961 tablet_service.cc:1511] Processing CreateTablet for tablet 50af14db75d3454cb44ffbfcc759d139 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.766027 13964 tablet_service.cc:1511] Processing CreateTablet for tablet 40782225684c4635b2808080a9158519 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:30.769133 13961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50af14db75d3454cb44ffbfcc759d139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.769810 13964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40782225684c4635b2808080a9158519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.771914 14042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40782225684c4635b2808080a9158519. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:30.797070 13924 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:30.801760 14035 tablet_service.cc:1511] Processing CreateTablet for tablet 50af14db75d3454cb44ffbfcc759d139 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.803323 14035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50af14db75d3454cb44ffbfcc759d139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.805919 14113 tablet_service.cc:1511] Processing CreateTablet for tablet 50af14db75d3454cb44ffbfcc759d139 (DEFAULT_TABLE table=soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:30.808132 14113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50af14db75d3454cb44ffbfcc759d139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.862736 14277 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:30.864826 14276 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:30.872313 14278 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:30.882923 14276 tablet_bootstrap.cc:654] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.887804 14277 tablet_bootstrap.cc:654] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.898679 14278 tablet_bootstrap.cc:654] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.912916 14276 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:30.913625 14276 ts_tablet_manager.cc:1403] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.004s
I20260709 12:25:30.914919 14278 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:30.915663 14278 ts_tablet_manager.cc:1403] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.003s
I20260709 12:25:30.917420 14276 raft_consensus.cc:359] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.918635 14276 raft_consensus.cc:385] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.919027 14276 raft_consensus.cc:740] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.919394 14278 raft_consensus.cc:359] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.920338 14278 raft_consensus.cc:385] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.920135 14276 consensus_queue.cc:260] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.920787 14278 raft_consensus.cc:740] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.921862 14278 consensus_queue.cc:260] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.924785 14278 ts_tablet_manager.cc:1434] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:30.926240 14278 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:30.927052 14276 ts_tablet_manager.cc:1434] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:30.929250 14276 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:30.934702 14278 tablet_bootstrap.cc:654] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.936718 14277 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:30.937475 14277 ts_tablet_manager.cc:1403] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.075s	user 0.003s	sys 0.028s
I20260709 12:25:30.937633 14276 tablet_bootstrap.cc:654] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.940997 14277 raft_consensus.cc:359] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.941900 14277 raft_consensus.cc:385] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.942286 14277 raft_consensus.cc:740] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.943282 14277 consensus_queue.cc:260] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.946307 14277 ts_tablet_manager.cc:1434] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:30.947381 14277 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:30.952534 14278 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:30.953337 14278 ts_tablet_manager.cc:1403] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:25:30.953264 14262 raft_consensus.cc:493] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.954064 14262 raft_consensus.cc:515] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.957196 14262 leader_election.cc:290] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:30.957726 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:30.958619 14278 raft_consensus.cc:359] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.959506 14278 raft_consensus.cc:385] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.959882 14278 raft_consensus.cc:740] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
W20260709 12:25:30.959970 14093 leader_election.cc:343] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.960868 14277 tablet_bootstrap.cc:654] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.960978 14276 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:30.960892 14278 consensus_queue.cc:260] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.962077 14276 ts_tablet_manager.cc:1403] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.014s
I20260709 12:25:30.964205 14278 ts_tablet_manager.cc:1434] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:30.965392 14278 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:30.966087 14276 raft_consensus.cc:359] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:30.967005 14276 raft_consensus.cc:385] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.961946 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:30.967386 14276 raft_consensus.cc:740] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.968355 14276 consensus_queue.cc:260] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
W20260709 12:25:30.969286 14091 leader_election.cc:343] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.969879 14091 leader_election.cc:304] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:30.971319 14262 raft_consensus.cc:2749] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.972422 14276 ts_tablet_manager.cc:1434] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:25:30.973812 14276 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:30.978574 14278 tablet_bootstrap.cc:654] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.985878 14276 tablet_bootstrap.cc:654] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.998466 14278 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:30.999173 14278 ts_tablet_manager.cc:1403] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.001s
I20260709 12:25:31.000079 14276 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.000808 14276 ts_tablet_manager.cc:1403] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 12:25:31.004429 14276 raft_consensus.cc:359] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.005584 14276 raft_consensus.cc:385] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.005998 14276 raft_consensus.cc:740] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.006963 14276 consensus_queue.cc:260] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.010136 14276 ts_tablet_manager.cc:1434] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:25:31.009276 14278 raft_consensus.cc:359] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.012346 14278 raft_consensus.cc:385] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.012773 14278 raft_consensus.cc:740] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.013671 14278 consensus_queue.cc:260] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.014940 14276 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:31.019899 14278 ts_tablet_manager.cc:1434] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 12:25:31.021814 14278 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.028404 14276 tablet_bootstrap.cc:654] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.035185 14278 tablet_bootstrap.cc:654] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.050209 14278 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.050348 14262 raft_consensus.cc:493] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.050698 14277 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.050798 14278 ts_tablet_manager.cc:1403] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 12:25:31.051661 14277 ts_tablet_manager.cc:1403] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.104s	user 0.042s	sys 0.042s
I20260709 12:25:31.050940 14262 raft_consensus.cc:515] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.053045 14276 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.053684 14276 ts_tablet_manager.cc:1403] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.013s
I20260709 12:25:31.054914 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.054826 14278 raft_consensus.cc:359] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.055739 14278 raft_consensus.cc:385] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.055366 14277 raft_consensus.cc:359] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.056075 14278 raft_consensus.cc:740] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.056434 14277 raft_consensus.cc:385] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.056819 14277 raft_consensus.cc:740] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
W20260709 12:25:31.056983 14093 leader_election.cc:343] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.056983 14278 consensus_queue.cc:260] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.057792 14276 raft_consensus.cc:359] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.057905 14277 consensus_queue.cc:260] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.058836 14276 raft_consensus.cc:385] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.059203 14276 raft_consensus.cc:740] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.060086 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.060433 14276 consensus_queue.cc:260] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.063234 14276 ts_tablet_manager.cc:1434] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:25:31.064405 14276 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
W20260709 12:25:31.064532 14091 leader_election.cc:343] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.065312 14091 leader_election.cc:304] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.070300 14277 ts_tablet_manager.cc:1434] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:25:31.071946 14276 tablet_bootstrap.cc:654] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.079610 14262 leader_election.cc:290] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:31.080245 14277 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.086278 14262 raft_consensus.cc:2749] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.099033 14277 tablet_bootstrap.cc:654] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.101713 14278 ts_tablet_manager.cc:1434] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.050s	user 0.029s	sys 0.019s
I20260709 12:25:31.103194 14278 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.108150 14265 raft_consensus.cc:493] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.108819 14265 raft_consensus.cc:515] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.110705 14278 tablet_bootstrap.cc:654] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.113134 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797b5bf6b9a3475ebb3bbbb2b3a9f7d8" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
W20260709 12:25:31.115949 13942 leader_election.cc:343] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.112118 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797b5bf6b9a3475ebb3bbbb2b3a9f7d8" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.117415 14052 raft_consensus.cc:2468] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:31.118731 14277 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.119001 13941 leader_election.cc:304] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:31.119400 14277 ts_tablet_manager.cc:1403] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.003s
I20260709 12:25:31.111270 14265 leader_election.cc:290] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.120977 14265 raft_consensus.cc:2804] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.121922 14276 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.122035 14249 raft_consensus.cc:493] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.122841 14276 ts_tablet_manager.cc:1403] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 12:25:31.122784 14249 raft_consensus.cc:515] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.124279 14277 raft_consensus.cc:359] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.125106 14277 raft_consensus.cc:385] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.125399 14277 raft_consensus.cc:740] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.126434 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.127331 14276 raft_consensus.cc:359] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.128383 14276 raft_consensus.cc:385] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.128818 14276 raft_consensus.cc:740] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.130769 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.132372 14277 consensus_queue.cc:260] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.132455 14276 consensus_queue.cc:260] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.134980 14249 leader_election.cc:290] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.121518 14265 raft_consensus.cc:493] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.141911 14265 raft_consensus.cc:3060] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:31.133453 14017 leader_election.cc:343] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.147477 14018 leader_election.cc:343] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.156718 14277 ts_tablet_manager.cc:1434] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 12:25:31.158020 14277 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.157981 14297 raft_consensus.cc:493] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.158845 14297 raft_consensus.cc:515] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.162360 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
W20260709 12:25:31.164158 13941 leader_election.cc:343] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.165369 14297 leader_election.cc:290] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.167558 14277 tablet_bootstrap.cc:654] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.170634 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.171506 14128 raft_consensus.cc:2468] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:31.173569 13942 leader_election.cc:304] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.150645 14018 leader_election.cc:304] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57; no voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.175889 14294 raft_consensus.cc:2804] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.176337 14294 raft_consensus.cc:493] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.176697 14294 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.178930 14265 raft_consensus.cc:515] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.182219 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797b5bf6b9a3475ebb3bbbb2b3a9f7d8" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:31.182855 14052 raft_consensus.cc:3060] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.183916 14295 raft_consensus.cc:2749] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.186614 14294 raft_consensus.cc:515] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.188887 14265 leader_election.cc:290] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.189998 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "797b5bf6b9a3475ebb3bbbb2b3a9f7d8" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.190074 14294 leader_election.cc:290] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.190671 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
W20260709 12:25:31.192221 13941 leader_election.cc:343] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.192745 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
W20260709 12:25:31.193159 13942 leader_election.cc:343] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.193451 14128 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.195930 14298 raft_consensus.cc:493] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.196950 14298 raft_consensus.cc:515] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.197795 14052 raft_consensus.cc:2468] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:31.199285 13941 leader_election.cc:304] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:31.200721 14298 leader_election.cc:290] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.201501 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.201815 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.202481 14127 raft_consensus.cc:2468] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
W20260709 12:25:31.202935 14018 leader_election.cc:343] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.200584 14294 raft_consensus.cc:2804] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.204003 14294 raft_consensus.cc:697] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:31.204928 14294 consensus_queue.cc:237] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.208240 14278 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.206946 14276 ts_tablet_manager.cc:1434] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.010s
I20260709 12:25:31.204289 14017 leader_election.cc:304] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.208745 14277 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.208828 14278 ts_tablet_manager.cc:1403] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.024s
I20260709 12:25:31.209558 14277 ts_tablet_manager.cc:1403] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.026s
I20260709 12:25:31.210083 14298 raft_consensus.cc:2804] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.210578 14298 raft_consensus.cc:493] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.211051 14298 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.212621 14278 raft_consensus.cc:359] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.213465 14278 raft_consensus.cc:385] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.213838 14278 raft_consensus.cc:740] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.213502 14277 raft_consensus.cc:359] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.214574 14277 raft_consensus.cc:385] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.214967 14277 raft_consensus.cc:740] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.215025 14278 consensus_queue.cc:260] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.215958 14277 consensus_queue.cc:260] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.208845 14128 raft_consensus.cc:2468] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:31.219105 14277 ts_tablet_manager.cc:1434] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:31.219959 14278 ts_tablet_manager.cc:1434] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:25:31.220801 14277 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.221148 14278 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.226380 14298 raft_consensus.cc:515] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.229209 14278 tablet_bootstrap.cc:654] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.229820 14277 tablet_bootstrap.cc:654] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.230031 14276 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:31.250764 14294 raft_consensus.cc:493] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.231531 13942 leader_election.cc:304] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.267213 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.268080 14128 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.268203 14265 raft_consensus.cc:2804] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.268987 14265 raft_consensus.cc:697] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:31.238749 13875 catalog_manager.cc:5697] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.269979 14265 consensus_queue.cc:237] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.273453 14298 leader_election.cc:290] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.267992 14294 raft_consensus.cc:515] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.277328 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d690d7b547482eb81999263fbadead" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
W20260709 12:25:31.280187 13941 leader_election.cc:343] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.280331 14276 tablet_bootstrap.cc:654] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.281303 14128 raft_consensus.cc:2468] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.283016 14017 leader_election.cc:304] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:31.284142 14295 raft_consensus.cc:2804] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.284700 14295 raft_consensus.cc:697] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
W20260709 12:25:31.284518 13942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.67:37705, user_credentials={real_user=slave}} blocked reactor thread for 53182.5us
I20260709 12:25:31.285964 14295 consensus_queue.cc:237] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.288113 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
W20260709 12:25:31.290277 14018 leader_election.cc:343] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.281781 14298 raft_consensus.cc:493] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.293174 14298 raft_consensus.cc:515] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.296464 14278 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.296612 14294 leader_election.cc:290] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.297243 14278 ts_tablet_manager.cc:1403] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.004s
I20260709 12:25:31.297968 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d690d7b547482eb81999263fbadead" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.298873 14128 raft_consensus.cc:2468] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:31.301054 14278 raft_consensus.cc:359] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.301458 13942 leader_election.cc:304] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.301529 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afe1786152a417baff62472dac99aae" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.301964 14278 raft_consensus.cc:385] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.301627 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afe1786152a417baff62472dac99aae" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
W20260709 12:25:31.303202 14018 leader_election.cc:343] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.303686 14278 raft_consensus.cc:740] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.306718 14278 consensus_queue.cc:260] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.308378 14128 raft_consensus.cc:2468] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:31.308748 14294 raft_consensus.cc:2804] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.309422 14294 raft_consensus.cc:493] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.309906 14294 raft_consensus.cc:3060] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.312799 14017 leader_election.cc:304] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.314227 14278 ts_tablet_manager.cc:1434] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 12:25:31.314700 14298 leader_election.cc:290] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.315564 14278 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.314909 14295 raft_consensus.cc:2804] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.318022 14295 raft_consensus.cc:493] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.318436 14295 raft_consensus.cc:3060] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.318956 14277 tablet_bootstrap.cc:492] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.319664 14277 ts_tablet_manager.cc:1403] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.099s	user 0.031s	sys 0.033s
I20260709 12:25:31.322984 14277 raft_consensus.cc:359] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.323848 14277 raft_consensus.cc:385] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.324196 14277 raft_consensus.cc:740] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.324329 14278 tablet_bootstrap.cc:654] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.325198 14277 consensus_queue.cc:260] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.329412 14277 ts_tablet_manager.cc:1434] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:31.330713 14277 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.331492 13871 catalog_manager.cc:5697] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.330807 14295 raft_consensus.cc:515] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.340037 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afe1786152a417baff62472dac99aae" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:31.340757 13978 raft_consensus.cc:3060] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.341887 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afe1786152a417baff62472dac99aae" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.342228 14295 leader_election.cc:290] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.342654 14128 raft_consensus.cc:3060] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.353025 14128 raft_consensus.cc:2468] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.354082 14276 tablet_bootstrap.cc:492] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.354871 14276 ts_tablet_manager.cc:1403] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.125s	user 0.032s	sys 0.028s
I20260709 12:25:31.354753 14017 leader_election.cc:304] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:31.355734 14295 raft_consensus.cc:2804] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.356221 14295 raft_consensus.cc:697] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:31.357187 14295 consensus_queue.cc:237] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.358007 14294 raft_consensus.cc:515] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.361981 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d690d7b547482eb81999263fbadead" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
W20260709 12:25:31.363629 13941 leader_election.cc:343] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.364284 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5d690d7b547482eb81999263fbadead" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.364806 14294 leader_election.cc:290] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.365008 14128 raft_consensus.cc:3060] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.367903 14298 raft_consensus.cc:493] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.367894 14276 raft_consensus.cc:359] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.368947 14276 raft_consensus.cc:385] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.368671 14298 raft_consensus.cc:515] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.369071 13978 raft_consensus.cc:2468] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.369297 14276 raft_consensus.cc:740] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.370962 14298 leader_election.cc:290] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.371843 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
W20260709 12:25:31.373592 14018 leader_election.cc:343] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.374058 14278 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.374778 14278 ts_tablet_manager.cc:1403] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.018s
I20260709 12:25:31.374581 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.375409 14127 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:31.376943 14017 leader_election.cc:304] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.378252 14277 tablet_bootstrap.cc:654] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.378594 14296 raft_consensus.cc:2804] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.379086 14296 raft_consensus.cc:493] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.378767 14278 raft_consensus.cc:359] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.379591 14296 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.379657 14278 raft_consensus.cc:385] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.382519 14278 raft_consensus.cc:740] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.382018 13871 catalog_manager.cc:5697] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.384038 14278 consensus_queue.cc:260] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.387261 14278 ts_tablet_manager.cc:1434] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:25:31.388406 14278 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.399757 14277 tablet_bootstrap.cc:492] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.400447 14277 ts_tablet_manager.cc:1403] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.015s
I20260709 12:25:31.402840 14278 tablet_bootstrap.cc:654] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.403796 14277 raft_consensus.cc:359] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.404654 14277 raft_consensus.cc:385] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.404991 14277 raft_consensus.cc:740] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.405891 14277 consensus_queue.cc:260] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.382032 14128 raft_consensus.cc:2468] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:31.409318 13942 leader_election.cc:304] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.411065 14294 raft_consensus.cc:2804] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.411100 14296 raft_consensus.cc:515] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.411413 14276 consensus_queue.cc:260] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.414443 14298 raft_consensus.cc:493] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.414961 14298 raft_consensus.cc:515] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.416200 14276 ts_tablet_manager.cc:1434] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:25:31.416785 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:31.417433 14276 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:31.412583 14277 ts_tablet_manager.cc:1434] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 12:25:31.418874 14277 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.411857 14294 raft_consensus.cc:697] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:31.422238 14298 leader_election.cc:290] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.422129 13873 catalog_manager.cc:5697] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.423012 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.417522 13978 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.423807 13977 raft_consensus.cc:2468] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:31.425276 14018 leader_election.cc:304] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:31.425626 14276 tablet_bootstrap.cc:654] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.422148 14294 consensus_queue.cc:237] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.429607 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.430547 14127 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.422138 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.434064 14128 raft_consensus.cc:2468] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 0.
I20260709 12:25:31.436097 14298 raft_consensus.cc:2804] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.436594 14298 raft_consensus.cc:493] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.436924 14298 raft_consensus.cc:3060] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.437850 14276 tablet_bootstrap.cc:492] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.438515 14276 ts_tablet_manager.cc:1403] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:25:31.438431 14296 leader_election.cc:290] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.442061 14276 raft_consensus.cc:359] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.442849 14276 raft_consensus.cc:385] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.443156 14276 raft_consensus.cc:740] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.447749 14276 consensus_queue.cc:260] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.448938 14298 raft_consensus.cc:515] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.450524 14276 ts_tablet_manager.cc:1434] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 12:25:31.451519 14278 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.452201 14278 ts_tablet_manager.cc:1403] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.011s
I20260709 12:25:31.455874 14277 tablet_bootstrap.cc:654] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.456071 14278 raft_consensus.cc:359] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.457086 14278 raft_consensus.cc:385] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.457427 14278 raft_consensus.cc:740] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.458637 14276 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:31.459784 14127 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.458276 14278 consensus_queue.cc:260] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.461448 14017 leader_election.cc:304] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:31.462563 14296 raft_consensus.cc:2804] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.463119 14296 raft_consensus.cc:697] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:31.463110 14278 ts_tablet_manager.cc:1434] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:25:31.464128 14296 consensus_queue.cc:237] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.465057 14278 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: Bootstrap starting.
I20260709 12:25:31.467088 14276 tablet_bootstrap.cc:654] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.473570 14278 tablet_bootstrap.cc:654] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.475754 13978 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.484568 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:31.492612 13978 raft_consensus.cc:3060] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.485239 13871 catalog_manager.cc:5697] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.489048 14289 raft_consensus.cc:493] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.496188 14289 raft_consensus.cc:515] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.501271 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b42d6021214b3bb8e1ac499c708f30" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.501399 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.502377 14127 raft_consensus.cc:3060] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:31.503821 14091 leader_election.cc:343] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.504994 14289 leader_election.cc:290] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:31.505096 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
W20260709 12:25:31.512452 14093 leader_election.cc:343] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.513161 14093 leader_election.cc:304] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.514601 14289 raft_consensus.cc:2749] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.530272 14298 leader_election.cc:290] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.542253 14127 raft_consensus.cc:2468] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.550846 14277 tablet_bootstrap.cc:492] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.550541 14017 leader_election.cc:304] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:31.552414 14296 raft_consensus.cc:2804] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.552572 14277 ts_tablet_manager.cc:1403] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.134s	user 0.030s	sys 0.018s
I20260709 12:25:31.553081 14296 raft_consensus.cc:697] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:31.554060 14296 consensus_queue.cc:237] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.555404 13978 raft_consensus.cc:2468] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 1.
I20260709 12:25:31.556193 14277 raft_consensus.cc:359] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.557000 14277 raft_consensus.cc:385] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.557335 14277 raft_consensus.cc:740] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.557423 14298 raft_consensus.cc:493] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.558351 14278 tablet_bootstrap.cc:492] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: No bootstrap required, opened a new log
I20260709 12:25:31.558041 14298 raft_consensus.cc:515] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.558199 14277 consensus_queue.cc:260] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.558964 14278 ts_tablet_manager.cc:1403] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.026s
I20260709 12:25:31.556203 14276 tablet_bootstrap.cc:492] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.559990 13871 catalog_manager.cc:5697] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.559695 14276 ts_tablet_manager.cc:1403] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.101s	user 0.036s	sys 0.058s
I20260709 12:25:31.561483 14298 leader_election.cc:290] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.561515 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.564142 14128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.564863 14128 raft_consensus.cc:2393] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in current term 1: Already voted for candidate 9cfa711068644412a359cc73ead1d7f1 in this term.
I20260709 12:25:31.564458 14278 raft_consensus.cc:359] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.565232 14278 raft_consensus.cc:385] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.565507 14278 raft_consensus.cc:740] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.566223 14278 consensus_queue.cc:260] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.568295 14276 raft_consensus.cc:359] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.569175 14276 raft_consensus.cc:385] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.569507 14276 raft_consensus.cc:740] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.570289 14276 consensus_queue.cc:260] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.570825 14017 leader_election.cc:304] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57; no voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.572031 14295 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.572790 14276 ts_tablet_manager.cc:1434] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:31.573510 14277 ts_tablet_manager.cc:1434] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:25:31.574067 14276 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Bootstrap starting.
I20260709 12:25:31.574672 14277 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.581187 14295 raft_consensus.cc:2749] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.582008 14276 tablet_bootstrap.cc:654] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.582442 14277 tablet_bootstrap.cc:654] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.568367 14278 ts_tablet_manager.cc:1434] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:25:31.583627 14265 raft_consensus.cc:493] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.584187 14265 raft_consensus.cc:515] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.598016 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.606313 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.607353 14127 raft_consensus.cc:2393] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9cfa711068644412a359cc73ead1d7f1 in current term 1: Already voted for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in this term.
I20260709 12:25:31.608788 14265 leader_election.cc:290] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.613165 13941 leader_election.cc:304] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cfa711068644412a359cc73ead1d7f1; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:31.617268 14297 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.644964 14297 raft_consensus.cc:2749] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.648418 14276 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: No bootstrap required, opened a new log
I20260709 12:25:31.649006 14277 tablet_bootstrap.cc:492] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.648986 14276 ts_tablet_manager.cc:1403] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent bootstrapping tablet: real 0.075s	user 0.038s	sys 0.033s
I20260709 12:25:31.649818 14277 ts_tablet_manager.cc:1403] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.038s
I20260709 12:25:31.648902 13871 catalog_manager.cc:5697] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 1 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.652047 14276 raft_consensus.cc:359] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.652814 14276 raft_consensus.cc:385] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.653152 14276 raft_consensus.cc:740] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.652835 14277 raft_consensus.cc:359] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.653642 14277 raft_consensus.cc:385] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.653918 14277 raft_consensus.cc:740] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.653967 14276 consensus_queue.cc:260] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.654609 14277 consensus_queue.cc:260] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.656350 14276 ts_tablet_manager.cc:1434] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:25:31.657485 14277 ts_tablet_manager.cc:1434] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:31.658571 14277 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: Bootstrap starting.
I20260709 12:25:31.664916 14277 tablet_bootstrap.cc:654] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.671797 14277 tablet_bootstrap.cc:492] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: No bootstrap required, opened a new log
I20260709 12:25:31.672333 14277 ts_tablet_manager.cc:1403] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:25:31.673667 14128 raft_consensus.cc:3060] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.673530 14289 raft_consensus.cc:493] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.674305 14289 raft_consensus.cc:515] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.675215 14277 raft_consensus.cc:359] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.676007 14277 raft_consensus.cc:385] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.676294 14277 raft_consensus.cc:740] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.676877 14289 leader_election.cc:290] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:31.677191 14277 consensus_queue.cc:260] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.677759 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1" is_pre_election: true
I20260709 12:25:31.678157 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.678521 13978 raft_consensus.cc:2468] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 0.
I20260709 12:25:31.678833 14052 raft_consensus.cc:2468] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 0.
I20260709 12:25:31.679450 14277 ts_tablet_manager.cc:1434] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:25:31.680163 14091 leader_election.cc:304] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:31.681465 14289 raft_consensus.cc:2804] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.681835 14289 raft_consensus.cc:493] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.682169 14289 raft_consensus.cc:3060] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.686830 14297 consensus_queue.cc:1048] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.690434 14289 raft_consensus.cc:515] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.692759 14297 raft_consensus.cc:493] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.693375 14297 raft_consensus.cc:515] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.694196 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:31.694517 14289 leader_election.cc:290] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:31.694916 13978 raft_consensus.cc:3060] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.696514 14297 leader_election.cc:290] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.697300 14054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50af14db75d3454cb44ffbfcc759d139" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:31.697928 14054 raft_consensus.cc:3060] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.704823 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" is_pre_election: true
I20260709 12:25:31.704998 13978 raft_consensus.cc:2468] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:31.705668 14127 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:31.706481 14093 leader_election.cc:304] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:31.696393 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" is_pre_election: true
I20260709 12:25:31.707726 13942 leader_election.cc:304] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:31.707960 14289 raft_consensus.cc:2804] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.708918 14289 raft_consensus.cc:697] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:31.709838 14289 consensus_queue.cc:237] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.707388 14052 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 0.
I20260709 12:25:31.712853 14297 raft_consensus.cc:2804] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.713428 14297 raft_consensus.cc:493] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.715327 14297 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.717939 14296 consensus_queue.cc:1048] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.722332 14054 raft_consensus.cc:2468] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 1.
I20260709 12:25:31.725991 14297 raft_consensus.cc:515] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.731792 14294 consensus_queue.cc:1048] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.735481 13875 catalog_manager.cc:5697] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 0 to 1, leader changed from <none> to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 1 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.738127 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.740005 14127 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.748983 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:31.749758 14052 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.747020 14297 leader_election.cc:290] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.756649 14127 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:31.758674 13942 leader_election.cc:304] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:31.762869 14297 raft_consensus.cc:2804] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.763463 14297 raft_consensus.cc:697] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:31.758706 14052 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 1.
I20260709 12:25:31.769488 14295 consensus_queue.cc:1048] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.771814 14297 consensus_queue.cc:237] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.792125 14295 consensus_queue.cc:1048] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:31.812793 13924 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:31.818939 14249 consensus_queue.cc:1048] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.825953 13871 catalog_manager.cc:5697] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 1 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.828095 14297 consensus_queue.cc:1048] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.844321 14265 consensus_queue.cc:1048] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.893074 14048 raft_consensus.cc:3060] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.901502 14265 consensus_queue.cc:1048] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.914378 14297 consensus_queue.cc:1048] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.938086 14048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:45240
I20260709 12:25:31.938812 14048 raft_consensus.cc:606] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Received request to transfer leadership to TS 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.944298 14249 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.945201 14048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:45240
I20260709 12:25:31.945966 14048 raft_consensus.cc:606] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Received request to transfer leadership to TS 9cfa711068644412a359cc73ead1d7f1
I20260709 12:25:31.952564 14298 raft_consensus.cc:993] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:31.953266 14298 raft_consensus.cc:1081] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Signalling peer 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:31.955134 13977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:31.957675 13976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:31.958555 13976 raft_consensus.cc:606] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.962146 13977 raft_consensus.cc:493] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.962740 13977 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.964766 14296 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.970697 13978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40782225684c4635b2808080a9158519"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:53044
I20260709 12:25:31.971323 13978 raft_consensus.cc:606] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Received request to transfer leadership to TS 0ce8fe4bca6742ddb6b88a9ab966ca57
I20260709 12:25:31.974483 13977 raft_consensus.cc:515] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.979399 13977 leader_election.cc:290] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:31.980571 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:31.981324 14127 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.988322 14127 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:31.989212 14048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:31.989539 13942 leader_election.cc:304] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:31.990123 14048 raft_consensus.cc:3055] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:31.990478 14048 raft_consensus.cc:740] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:31.990491 14297 raft_consensus.cc:2804] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:31.991168 14297 raft_consensus.cc:697] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:31.991518 14048 consensus_queue.cc:260] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.992095 14297 consensus_queue.cc:237] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:31.993475 14048 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.001582 14048 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:32.001194 13875 catalog_manager.cc:5697] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 1 to 2, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.169255 14296 consensus_queue.cc:1048] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.176883 14298 consensus_queue.cc:1048] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.209079 14289 consensus_queue.cc:1048] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.215972 14289 consensus_queue.cc:1048] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.234500 14297 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.248207 14265 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.258883 14294 raft_consensus.cc:993] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:32.259490 14294 raft_consensus.cc:1081] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:32.261688 14048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40782225684c4635b2808080a9158519"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:32.262434 14048 raft_consensus.cc:493] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.262848 14048 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.270818 14048 raft_consensus.cc:515] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.274405 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:32.274457 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:32.275249 14127 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.275676 13978 raft_consensus.cc:3055] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.276010 13978 raft_consensus.cc:740] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:32.276703 13978 consensus_queue.cc:260] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.277591 13978 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.273917 14048 leader_election.cc:290] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:32.283537 14127 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:32.283931 13978 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:32.285094 14017 leader_election.cc:304] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:32.286005 14298 raft_consensus.cc:2804] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.286448 14298 raft_consensus.cc:697] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:32.287295 14298 consensus_queue.cc:237] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.295262 13873 catalog_manager.cc:5697] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.354794 14249 raft_consensus.cc:993] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:32.355345 14298 raft_consensus.cc:1081] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Signalling peer 9cfa711068644412a359cc73ead1d7f1 to start an election
I20260709 12:25:32.357232 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
 from {username='slave'} at 127.0.0.1:53028
I20260709 12:25:32.357738 13978 raft_consensus.cc:493] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.358147 13978 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.363178 14265 raft_consensus.cc:993] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:32.363850 14294 raft_consensus.cc:1081] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Signalling peer 0ce8fe4bca6742ddb6b88a9ab966ca57 to start an election
I20260709 12:25:32.365643 14048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
 from {username='slave'} at 127.0.0.1:45226
I20260709 12:25:32.366186 13978 raft_consensus.cc:515] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.366703 14048 raft_consensus.cc:493] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:32.367112 14048 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.368520 13978 leader_election.cc:290] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:32.369374 14052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:32.370098 14052 raft_consensus.cc:3055] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.370165 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9f787a94e4404687036cca33c93fec" candidate_uuid: "9cfa711068644412a359cc73ead1d7f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:32.370501 14052 raft_consensus.cc:740] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:32.371044 14127 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.371608 14052 consensus_queue.cc:260] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.373406 14052 raft_consensus.cc:3060] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.376178 14048 raft_consensus.cc:515] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.377307 14127 raft_consensus.cc:2468] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:32.379025 14048 leader_election.cc:290] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67:37705)
I20260709 12:25:32.379405 13942 leader_election.cc:304] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:32.380388 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:32.380573 14294 raft_consensus.cc:2804] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.381027 13978 raft_consensus.cc:3055] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:32.381254 14294 raft_consensus.cc:697] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Leader. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:32.381791 14127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bdf9c3d65d482a84490fd93843a282" candidate_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
I20260709 12:25:32.382467 14127 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.382508 14294 consensus_queue.cc:237] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.381374 13978 raft_consensus.cc:740] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:32.387210 13978 consensus_queue.cc:260] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.388676 13978 raft_consensus.cc:3060] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:32.390713 14052 raft_consensus.cc:2468] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cfa711068644412a359cc73ead1d7f1 in term 2.
I20260709 12:25:32.391770 14127 raft_consensus.cc:2468] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:32.393083 14017 leader_election.cc:304] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:32.394402 14298 raft_consensus.cc:2804] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.393942 13873 catalog_manager.cc:5697] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 reported cstate change: term changed from 1 to 2, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65). New cstate: current_term: 2 leader_uuid: "9cfa711068644412a359cc73ead1d7f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.394953 14298 raft_consensus.cc:697] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Leader. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:32.395850 14298 consensus_queue.cc:237] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:32.396343 13978 raft_consensus.cc:2468] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce8fe4bca6742ddb6b88a9ab966ca57 in term 2.
I20260709 12:25:32.408725 13873 catalog_manager.cc:5697] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 reported cstate change: term changed from 1 to 2, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66). New cstate: current_term: 2 leader_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.442634 14052 raft_consensus.cc:1275] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.444149 14294 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.452241 14127 raft_consensus.cc:1275] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.454028 14297 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:32.764271 14127 raft_consensus.cc:1275] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.765638 14297 consensus_queue.cc:1048] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.774629 14052 raft_consensus.cc:1275] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Refusing update from remote peer 9cfa711068644412a359cc73ead1d7f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.776183 14297 consensus_queue.cc:1048] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.810638 14127 raft_consensus.cc:1275] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.812889 14298 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.823555 13978 raft_consensus.cc:1275] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.825691 14249 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.978132 13978 raft_consensus.cc:1275] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.979574 14249 consensus_queue.cc:1048] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:32.985710 14127 raft_consensus.cc:1275] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Refusing update from remote peer 0ce8fe4bca6742ddb6b88a9ab966ca57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.988852 14295 consensus_queue.cc:1048] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:34.979553 13871 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58608:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:25:35.003676 13871 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58608:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:25:35.094636 14383 tablet.cc:1724] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.109877  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:35.154031 14389 tablet.cc:1724] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.160351 14386 tablet.cc:1724] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.169214 14398 tablet.cc:1724] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.156715 14388 tablet.cc:1724] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.180205 14396 tablet.cc:1724] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.172956 14018 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.65:35077, user_credentials={real_user=slave}} blocked reactor thread for 63879.3us
I20260709 12:25:35.203382 14402 tablet.cc:1724] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.215883 14080 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3afe1786152a417baff62472dac99aae)
I20260709 12:25:35.292181 14383 tablet.cc:1724] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.325448 14411 tablet.cc:1724] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.307286 14398 tablet.cc:1724] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.343516 14409 tablet.cc:1724] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.355471 14412 tablet.cc:1724] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.357507 14080 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:23b42d6021214b3bb8e1ac499c708f30)
W20260709 12:25:35.367766 14080 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:23b42d6021214b3bb8e1ac499c708f30)
I20260709 12:25:35.309166 14386 tablet.cc:1724] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.393543 14413 tablet.cc:1724] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.400852 14389 tablet.cc:1724] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.401630 14396 tablet.cc:1724] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.417488 14409 tablet.cc:1724] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.418323 14414 tablet.cc:1724] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.417193 14388 tablet.cc:1724] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.431954 14048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40782225684c4635b2808080a9158519"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:35698
I20260709 12:25:35.432623 14048 raft_consensus.cc:606] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Received request to transfer leadership to TS 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:35.450206 14386 tablet.cc:1724] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.457288 14396 tablet.cc:1724] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.453648 14411 tablet.cc:1724] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.478569 14402 tablet.cc:1724] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:35.383493 13941 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.66:44553, user_credentials={real_user=slave}} blocked reactor thread for 65390.2us
I20260709 12:25:35.506170 14409 tablet.cc:1724] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.508898 14389 tablet.cc:1724] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.512125 14413 tablet.cc:1724] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.516275 14414 tablet.cc:1724] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:35.546772 13977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:41988
I20260709 12:25:35.547559 13977 raft_consensus.cc:606] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Received request to transfer leadership to TS 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:35.549124  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:25:35.549703  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.558298 13977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c"
dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
mode: GRACEFUL
new_leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:41988
I20260709 12:25:35.558972 13977 raft_consensus.cc:606] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Received request to transfer leadership to TS 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:35.563163 14048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607"
dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
mode: GRACEFUL
new_leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:35698
I20260709 12:25:35.563850 14048 raft_consensus.cc:606] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Received request to transfer leadership to TS 369fbc56c44d43ecb8d0b98a99c1897a
I20260709 12:25:35.565157  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:35.565675  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.570032 13875 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 66b69afbaad240f999b9ce25d53a1efb: soft_deleted_table [id=f8a9b09a8d6241a9b674529c7b27b749] alter complete (version 1)
I20260709 12:25:35.712532 14385 raft_consensus.cc:993] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.713227 14390 raft_consensus.cc:1081] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Signalling peer 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.715145 14128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40782225684c4635b2808080a9158519"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:55386
I20260709 12:25:35.715776 14128 raft_consensus.cc:493] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.716135 14128 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.722081 14128 raft_consensus.cc:515] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.723973 14128 leader_election.cc:290] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:35.724841 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:35.725136 14048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40782225684c4635b2808080a9158519" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:35.725584 13977 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.725857 14048 raft_consensus.cc:3055] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.726317 14048 raft_consensus.cc:740] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:35.727356 14048 consensus_queue.cc:260] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.729075 14048 raft_consensus.cc:3060] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.733518 13977 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.734941 14093 leader_election.cc:304] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:35.735997 14393 raft_consensus.cc:2804] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.736577 14393 raft_consensus.cc:697] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:35.737651 14385 raft_consensus.cc:993] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: : Instructing follower 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.737558 14393 consensus_queue.cc:237] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.738106 14048 raft_consensus.cc:2468] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.738286 14385 raft_consensus.cc:1081] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Signalling peer 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.740614 14128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:55386
I20260709 12:25:35.741209 14128 raft_consensus.cc:493] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.741528 14128 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.747897 13875 catalog_manager.cc:5697] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 2 to 3, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.748641 14128 raft_consensus.cc:515] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.750597 14128 leader_election.cc:290] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:35.751366 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:35.751797 14048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2483c6e42844b19b63bd566ae118607" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:35.752122 13977 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.752550 14048 raft_consensus.cc:3055] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.752876 14048 raft_consensus.cc:740] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ce8fe4bca6742ddb6b88a9ab966ca57, State: Running, Role: LEADER
I20260709 12:25:35.753796 14048 consensus_queue.cc:260] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.755149 14048 raft_consensus.cc:3060] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.759683 13977 raft_consensus.cc:2468] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.761260 14093 leader_election.cc:304] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a, 9cfa711068644412a359cc73ead1d7f1; no voters: 
I20260709 12:25:35.762235 14393 raft_consensus.cc:2804] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.762750 14393 raft_consensus.cc:697] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:35.763680 14393 consensus_queue.cc:237] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.764112 14048 raft_consensus.cc:2468] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.766299 14416 raft_consensus.cc:993] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.766947 14357 raft_consensus.cc:1081] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Signalling peer 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:35.769086 14128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:25:35.769744 14128 raft_consensus.cc:493] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.770143 14128 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.773897 13875 catalog_manager.cc:5697] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 2 to 3, leader changed from 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66) to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.776924 14128 raft_consensus.cc:515] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.779361 14128 leader_election.cc:290] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:35.779932 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:35.780660 13977 raft_consensus.cc:3055] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:35.780601 14048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2baeef2587574107a3c1dda54ed4f52c" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:35.781250 13977 raft_consensus.cc:740] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:35.781425 14048 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.782255 13977 consensus_queue.cc:260] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.783664 13977 raft_consensus.cc:3060] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:35.789499 14048 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.790835 14091 leader_election.cc:304] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:35.791054 13977 raft_consensus.cc:2468] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:35.791831 14393 raft_consensus.cc:2804] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:35.792389 14393 raft_consensus.cc:697] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:35.793329 14393 consensus_queue.cc:237] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:35.801879 13875 catalog_manager.cc:5697] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 2 to 3, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:36.048427 14357 raft_consensus.cc:993] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: : Instructing follower 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:36.048985 14416 raft_consensus.cc:1081] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Signalling peer 369fbc56c44d43ecb8d0b98a99c1897a to start an election
I20260709 12:25:36.050562 14127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded"
dest_uuid: "369fbc56c44d43ecb8d0b98a99c1897a"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:25:36.051141 14127 raft_consensus.cc:493] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.051522 14127 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.057286 14127 raft_consensus.cc:515] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:36.059137 14127 leader_election.cc:290] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Requested vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
I20260709 12:25:36.060245 14048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57"
I20260709 12:25:36.060416 13977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e288a7bd7034820b4301433f4c7fded" candidate_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9cfa711068644412a359cc73ead1d7f1"
I20260709 12:25:36.060863 14048 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.061223 13977 raft_consensus.cc:3055] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:36.061616 13977 raft_consensus.cc:740] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cfa711068644412a359cc73ead1d7f1, State: Running, Role: LEADER
I20260709 12:25:36.062400 13977 consensus_queue.cc:260] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:36.063567 13977 raft_consensus.cc:3060] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.067488 14048 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:36.068965 14091 leader_election.cc:304] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 
I20260709 12:25:36.069995 14393 raft_consensus.cc:2804] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:36.070030 13977 raft_consensus.cc:2468] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369fbc56c44d43ecb8d0b98a99c1897a in term 3.
I20260709 12:25:36.070598 14393 raft_consensus.cc:697] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Becoming Leader. State: Replica: 369fbc56c44d43ecb8d0b98a99c1897a, State: Running, Role: LEADER
I20260709 12:25:36.071684 14393 consensus_queue.cc:237] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:36.079280 13875 catalog_manager.cc:5697] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a reported cstate change: term changed from 2 to 3, leader changed from 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65) to 369fbc56c44d43ecb8d0b98a99c1897a (127.2.157.67). New cstate: current_term: 3 leader_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:36.254601 13977 raft_consensus.cc:1275] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:36.256032 14393 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:36.266791 14048 raft_consensus.cc:1275] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:36.275580 13978 raft_consensus.cc:1275] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.277428 14393 consensus_queue.cc:1048] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:36.281544 14428 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:36.285387 14048 raft_consensus.cc:1275] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.303332 14430 consensus_queue.cc:1048] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:36.308357 13978 raft_consensus.cc:1275] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.311574 14393 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:36.336136 14048 raft_consensus.cc:1275] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:36.337728 14428 consensus_queue.cc:1048] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:36.566823  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:36.572391  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.572898  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.576236 14054 raft_consensus.cc:1275] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:36.577891 14428 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:36.578831  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.579566  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.587487 13977 raft_consensus.cc:1275] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Refusing update from remote peer 369fbc56c44d43ecb8d0b98a99c1897a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:36.589051 14393 consensus_queue.cc:1048] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:37.580703  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:37.586141  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.586697  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.592257  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.592723  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.593899  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:38.601249  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.601779  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.607436  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.608029  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.609527  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:39.621295  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.621997  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.628434  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.628958  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.630091  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:40.635942  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.636525  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.641806  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.642223  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.643213  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:41.648948  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.649405  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.655411  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.655937  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.657054  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:42.662514  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.662992  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.668318  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.668790  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.124944  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:44.131860  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.132790  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.138499  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.138989  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:44.678958 14075 debug-util.cc:398] Leaking SignalData structure 0x7b0800042960 after lost signal to thread 2680
W20260709 12:25:44.680322 14075 debug-util.cc:398] Leaking SignalData structure 0x7b0800284c60 after lost signal to thread 13910
W20260709 12:25:44.681746 14075 debug-util.cc:398] Leaking SignalData structure 0x7b0800028a80 after lost signal to thread 14002
W20260709 12:25:44.682880 14075 debug-util.cc:398] Leaking SignalData structure 0x7b08000df500 after lost signal to thread 14078
W20260709 12:25:44.684135 14075 debug-util.cc:398] Leaking SignalData structure 0x7b080017dac0 after lost signal to thread 14152
I20260709 12:25:45.140367  2677 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:45.150113  2677 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.150805  2677 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.160554  2677 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.161967  2677 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.238665  2677 tablet_server.cc:179] TabletServer@127.2.157.65:0 shutting down...
W20260709 12:25:46.271139 14093 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 65 similar messages]
W20260709 12:25:46.276150 14093 consensus_peers.cc:597] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.303700  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:46.305114  2677 tablet_replica.cc:333] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.306682  2677 raft_consensus.cc:2243] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.308034  2677 raft_consensus.cc:2272] T 40782225684c4635b2808080a9158519 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.312901  2677 tablet_replica.cc:333] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.314287  2677 raft_consensus.cc:2243] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.316015  2677 raft_consensus.cc:2272] T 2a9f787a94e4404687036cca33c93fec P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.320535  2677 tablet_replica.cc:333] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.321692  2677 raft_consensus.cc:2243] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.322603  2677 raft_consensus.cc:2272] T 3afe1786152a417baff62472dac99aae P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.326965  2677 tablet_replica.cc:333] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.328024  2677 raft_consensus.cc:2243] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.328917  2677 raft_consensus.cc:2272] T 23b42d6021214b3bb8e1ac499c708f30 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.333406  2677 tablet_replica.cc:333] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.334657  2677 raft_consensus.cc:2243] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.335563  2677 raft_consensus.cc:2272] T 42bdf9c3d65d482a84490fd93843a282 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.339669  2677 tablet_replica.cc:333] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.340713  2677 raft_consensus.cc:2243] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.341614  2677 raft_consensus.cc:2272] T 50af14db75d3454cb44ffbfcc759d139 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.345641  2677 tablet_replica.cc:333] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.346798  2677 raft_consensus.cc:2243] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.347664  2677 raft_consensus.cc:2272] T 6e288a7bd7034820b4301433f4c7fded P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.351373  2677 tablet_replica.cc:333] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.352453  2677 raft_consensus.cc:2243] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.353708  2677 raft_consensus.cc:2272] T a5d690d7b547482eb81999263fbadead P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.356858  2677 tablet_replica.cc:333] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.357527  2677 raft_consensus.cc:2243] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.358213  2677 raft_consensus.cc:2272] T 2baeef2587574107a3c1dda54ed4f52c P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.361503  2677 tablet_replica.cc:333] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.362169  2677 raft_consensus.cc:2243] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.363420  2677 raft_consensus.cc:2272] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.367606  2677 tablet_replica.cc:333] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
W20260709 12:25:46.367868 14093 consensus_peers.cc:597] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.368422  2677 raft_consensus.cc:2243] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.369204  2677 raft_consensus.cc:2272] T ea7f93cc2dc14fc7a421732042343593 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.372584  2677 tablet_replica.cc:333] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.373412  2677 raft_consensus.cc:2243] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.374643  2677 raft_consensus.cc:2272] T 8bc62ce8de14405d84da7bdb158e98a0 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.378931  2677 tablet_replica.cc:333] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.379747  2677 raft_consensus.cc:2243] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.380606  2677 raft_consensus.cc:2272] T 318063b1f2d345dba058bb92a195979d P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.384979  2677 tablet_replica.cc:333] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.385838  2677 raft_consensus.cc:2243] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.387105  2677 raft_consensus.cc:2272] T 9769e8506ffa4d5daa44143077fa0e3e P 9cfa711068644412a359cc73ead1d7f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.390707  2677 tablet_replica.cc:333] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.391539  2677 raft_consensus.cc:2243] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.392288  2677 raft_consensus.cc:2272] T 8ab33e23f5e3441a80b88bf7cdd0755b P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.396080  2677 tablet_replica.cc:333] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.396961  2677 raft_consensus.cc:2243] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.397724  2677 raft_consensus.cc:2272] T a2483c6e42844b19b63bd566ae118607 P 9cfa711068644412a359cc73ead1d7f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.401400  2677 tablet_replica.cc:333] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.402159  2677 raft_consensus.cc:2243] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.403575  2677 raft_consensus.cc:2272] T 75edc7d73e2240d19803d5818dadea26 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.407369  2677 tablet_replica.cc:333] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1: stopping tablet replica
I20260709 12:25:46.408229  2677 raft_consensus.cc:2243] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.409637  2677 raft_consensus.cc:2272] T 52ecd1f0895f40a694686a2659008702 P 9cfa711068644412a359cc73ead1d7f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:46.409696 14093 consensus_peers.cc:597] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.438429 14018 consensus_peers.cc:597] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.444959 14018 consensus_peers.cc:597] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.469349  2677 tablet_server.cc:196] TabletServer@127.2.157.65:0 shutdown complete.
W20260709 12:25:46.499876 14018 consensus_peers.cc:597] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.537417 14093 consensus_peers.cc:597] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.549283  2677 tablet_server.cc:179] TabletServer@127.2.157.66:0 shutting down...
W20260709 12:25:46.556819 14091 consensus_peers.cc:597] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.580314 14018 consensus_peers.cc:597] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.589200 14093 consensus_peers.cc:597] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.596741  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:46.597811  2677 tablet_replica.cc:333] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.599799  2677 raft_consensus.cc:2243] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.600602  2677 raft_consensus.cc:2272] T 40782225684c4635b2808080a9158519 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.603710  2677 tablet_replica.cc:333] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.604350  2677 raft_consensus.cc:2243] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.605406  2677 raft_consensus.cc:2272] T 42bdf9c3d65d482a84490fd93843a282 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.608178  2677 tablet_replica.cc:333] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.609169  2677 raft_consensus.cc:2243] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.610657  2677 raft_consensus.cc:2272] T 23b42d6021214b3bb8e1ac499c708f30 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.613646  2677 tablet_replica.cc:333] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.614408  2677 raft_consensus.cc:2243] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.615134  2677 raft_consensus.cc:2272] T 2a9f787a94e4404687036cca33c93fec P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.618338  2677 tablet_replica.cc:333] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.619104  2677 raft_consensus.cc:2243] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.619724  2677 raft_consensus.cc:2272] T a5d690d7b547482eb81999263fbadead P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.622457  2677 tablet_replica.cc:333] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.623109  2677 raft_consensus.cc:2243] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.623744  2677 raft_consensus.cc:2272] T 50af14db75d3454cb44ffbfcc759d139 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.626490  2677 tablet_replica.cc:333] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.627157  2677 raft_consensus.cc:2243] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.627862  2677 raft_consensus.cc:2272] T 6e288a7bd7034820b4301433f4c7fded P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.631009  2677 tablet_replica.cc:333] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.631803  2677 raft_consensus.cc:2243] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.632969  2677 raft_consensus.cc:2272] T 3afe1786152a417baff62472dac99aae P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:46.635637 14093 consensus_peers.cc:597] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Couldn't send request to peer 9cfa711068644412a359cc73ead1d7f1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.65:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.636380  2677 tablet_replica.cc:333] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.637092  2677 raft_consensus.cc:2243] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.637662  2677 raft_consensus.cc:2272] T 2baeef2587574107a3c1dda54ed4f52c P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.640722  2677 tablet_replica.cc:333] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.641386  2677 raft_consensus.cc:2243] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.641978  2677 raft_consensus.cc:2272] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.644920  2677 tablet_replica.cc:333] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.645562  2677 raft_consensus.cc:2243] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.646144  2677 raft_consensus.cc:2272] T 52ecd1f0895f40a694686a2659008702 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.649456  2677 tablet_replica.cc:333] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.650050  2677 raft_consensus.cc:2243] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.650609  2677 raft_consensus.cc:2272] T 8ab33e23f5e3441a80b88bf7cdd0755b P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.655977  2677 tablet_replica.cc:333] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.656641  2677 raft_consensus.cc:2243] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.657302  2677 raft_consensus.cc:2272] T 9769e8506ffa4d5daa44143077fa0e3e P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.660353  2677 tablet_replica.cc:333] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.661228  2677 raft_consensus.cc:2243] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.662366  2677 raft_consensus.cc:2272] T 8bc62ce8de14405d84da7bdb158e98a0 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.665571  2677 tablet_replica.cc:333] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.667299  2677 raft_consensus.cc:2243] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.668407  2677 raft_consensus.cc:2272] T ea7f93cc2dc14fc7a421732042343593 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.671487  2677 tablet_replica.cc:333] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.672156  2677 raft_consensus.cc:2243] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.672662  2677 raft_consensus.cc:2272] T 75edc7d73e2240d19803d5818dadea26 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.675325  2677 tablet_replica.cc:333] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.675916  2677 raft_consensus.cc:2243] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.676425  2677 raft_consensus.cc:2272] T a2483c6e42844b19b63bd566ae118607 P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.679056  2677 tablet_replica.cc:333] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57: stopping tablet replica
I20260709 12:25:46.679723  2677 raft_consensus.cc:2243] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.680737  2677 raft_consensus.cc:2272] T 318063b1f2d345dba058bb92a195979d P 0ce8fe4bca6742ddb6b88a9ab966ca57 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:46.697082 14091 consensus_peers.cc:597] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.727934 14091 consensus_peers.cc:597] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.826964 14091 consensus_peers.cc:597] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.900741 14091 consensus_peers.cc:597] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.952865 14091 consensus_peers.cc:597] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a -> Peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Couldn't send request to peer 0ce8fe4bca6742ddb6b88a9ab966ca57. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.545379 14466 raft_consensus.cc:493] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ce8fe4bca6742ddb6b88a9ab966ca57)
I20260709 12:25:47.546008 14466 raft_consensus.cc:515] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.548400 14466 leader_election.cc:290] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.552240 14091 leader_election.cc:336] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.552644 14466 raft_consensus.cc:493] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.553277 14466 raft_consensus.cc:515] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } }
I20260709 12:25:47.555006 14466 leader_election.cc:290] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.558861 14091 leader_election.cc:336] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.580550 14466 raft_consensus.cc:493] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.581110 14466 raft_consensus.cc:515] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.582918 14466 leader_election.cc:290] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.587502 14091 leader_election.cc:336] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.640321 14466 raft_consensus.cc:493] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.641036 14466 raft_consensus.cc:515] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.643110 14466 leader_election.cc:290] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.647934 14091 leader_election.cc:336] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.690199 14466 raft_consensus.cc:493] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ce8fe4bca6742ddb6b88a9ab966ca57)
I20260709 12:25:47.690824 14466 raft_consensus.cc:515] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.692927 14466 leader_election.cc:290] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.697587 14091 leader_election.cc:336] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.716166 14466 raft_consensus.cc:493] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.716813 14466 raft_consensus.cc:515] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.718807 14466 leader_election.cc:290] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.723376 14091 leader_election.cc:336] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
W20260709 12:25:47.725670  2677 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14075)
I20260709 12:25:47.805850 14466 raft_consensus.cc:493] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.806561 14466 raft_consensus.cc:515] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.808575 14466 leader_election.cc:290] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.813553 14091 leader_election.cc:336] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.877298 14466 raft_consensus.cc:493] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9cfa711068644412a359cc73ead1d7f1)
I20260709 12:25:47.877971 14466 raft_consensus.cc:515] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.879952 14466 leader_election.cc:290] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.883929 14091 leader_election.cc:336] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.916586 14466 raft_consensus.cc:493] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ce8fe4bca6742ddb6b88a9ab966ca57)
I20260709 12:25:47.917260 14466 raft_consensus.cc:515] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:47.919217 14466 leader_election.cc:290] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:47.923058 14091 leader_election.cc:336] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:47.967916  2677 tablet_server.cc:196] TabletServer@127.2.157.66:0 shutdown complete.
I20260709 12:25:48.006291 14466 raft_consensus.cc:493] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ce8fe4bca6742ddb6b88a9ab966ca57)
I20260709 12:25:48.007161 14466 raft_consensus.cc:515] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:48.010056 14466 leader_election.cc:290] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:48.015316 14091 leader_election.cc:336] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:48.017691  2677 tablet_server.cc:179] TabletServer@127.2.157.67:0 shutting down...
I20260709 12:25:48.043556 14466 raft_consensus.cc:493] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ce8fe4bca6742ddb6b88a9ab966ca57)
I20260709 12:25:48.044309 14466 raft_consensus.cc:515] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cfa711068644412a359cc73ead1d7f1" member_type: VOTER last_known_addr { host: "127.2.157.65" port: 35077 } } peers { permanent_uuid: "0ce8fe4bca6742ddb6b88a9ab966ca57" member_type: VOTER last_known_addr { host: "127.2.157.66" port: 44553 } } peers { permanent_uuid: "369fbc56c44d43ecb8d0b98a99c1897a" member_type: VOTER last_known_addr { host: "127.2.157.67" port: 37705 } }
I20260709 12:25:48.048305 14466 leader_election.cc:290] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077), 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553)
W20260709 12:25:48.053033 14091 leader_election.cc:336] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ce8fe4bca6742ddb6b88a9ab966ca57 (127.2.157.66:44553): Network error: Client connection negotiation failed: client connection to 127.2.157.66:44553: connect: Connection refused (error 111)
I20260709 12:25:48.055406  2677 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:48.056435  2677 tablet_replica.cc:333] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.057277  2677 raft_consensus.cc:2243] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.058084  2677 raft_consensus.cc:2272] T 40782225684c4635b2808080a9158519 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.060489  2677 tablet_replica.cc:333] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.061304  2677 raft_consensus.cc:2243] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.061756  2677 raft_consensus.cc:2272] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.063974  2677 tablet_replica.cc:333] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.064553  2677 raft_consensus.cc:2243] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.065032  2677 raft_consensus.cc:2272] T 42bdf9c3d65d482a84490fd93843a282 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.067114  2677 tablet_replica.cc:333] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.067727  2677 raft_consensus.cc:2243] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.068197  2677 raft_consensus.cc:2272] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.070338  2677 tablet_replica.cc:333] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.070839  2677 raft_consensus.cc:2243] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.071316  2677 raft_consensus.cc:2272] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.073518  2677 tablet_replica.cc:333] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.074191  2677 raft_consensus.cc:2243] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.074934  2677 raft_consensus.cc:2272] T 50af14db75d3454cb44ffbfcc759d139 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.077148  2677 tablet_replica.cc:333] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.077807  2677 raft_consensus.cc:2243] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.078315  2677 raft_consensus.cc:2272] T a5d690d7b547482eb81999263fbadead P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.080610  2677 tablet_replica.cc:333] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.081205  2677 raft_consensus.cc:2243] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.081914  2677 raft_consensus.cc:2272] T 6e288a7bd7034820b4301433f4c7fded P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.084146  2677 tablet_replica.cc:333] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.084738  2677 raft_consensus.cc:2243] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.085465  2677 raft_consensus.cc:2272] T a2483c6e42844b19b63bd566ae118607 P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.087724  2677 tablet_replica.cc:333] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.088373  2677 raft_consensus.cc:2243] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.088930  2677 raft_consensus.cc:2272] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.091337  2677 tablet_replica.cc:333] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.091962  2677 raft_consensus.cc:2243] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.092751  2677 raft_consensus.cc:2272] T 8ab33e23f5e3441a80b88bf7cdd0755b P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.094914  2677 tablet_replica.cc:333] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.095520  2677 raft_consensus.cc:2243] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.096045  2677 raft_consensus.cc:2272] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.098378  2677 tablet_replica.cc:333] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.098919  2677 raft_consensus.cc:2243] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.099463  2677 raft_consensus.cc:2272] T 797b5bf6b9a3475ebb3bbbb2b3a9f7d8 P 369fbc56c44d43ecb8d0b98a99c1897a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.101608  2677 tablet_replica.cc:333] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.102162  2677 raft_consensus.cc:2243] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:48.102890  2677 raft_consensus.cc:2272] T 2baeef2587574107a3c1dda54ed4f52c P 369fbc56c44d43ecb8d0b98a99c1897a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.105160  2677 tablet_replica.cc:333] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.105751  2677 raft_consensus.cc:2243] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.106266  2677 raft_consensus.cc:2272] T 318063b1f2d345dba058bb92a195979d P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.108405  2677 tablet_replica.cc:333] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.108944  2677 raft_consensus.cc:2243] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.109443  2677 raft_consensus.cc:2272] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.111672  2677 tablet_replica.cc:333] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.112190  2677 raft_consensus.cc:2243] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.112654  2677 raft_consensus.cc:2272] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:48.114820  2677 tablet_replica.cc:333] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a: stopping tablet replica
I20260709 12:25:48.115321  2677 raft_consensus.cc:2243] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:48.115829  2677 raft_consensus.cc:2272] T 75edc7d73e2240d19803d5818dadea26 P 369fbc56c44d43ecb8d0b98a99c1897a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:48.131880 14093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.235091 14091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.274284 14468 leader_election.cc:336] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
I20260709 12:25:48.274891 14468 leader_election.cc:304] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.275700 14468 raft_consensus.cc:2686] T 3afe1786152a417baff62472dac99aae P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:25:48.277844  2677 leader_election.cc:336] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Aborted: reactor is shutting down (error 108)
I20260709 12:25:48.278319  2677 leader_election.cc:304] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.278499 14468 leader_election.cc:336] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
W20260709 12:25:48.278831  2677 raft_consensus.cc:2686] T 8bc62ce8de14405d84da7bdb158e98a0 P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:25:48.279085 14468 leader_election.cc:304] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.279732 14468 raft_consensus.cc:2686] T ea7f93cc2dc14fc7a421732042343593 P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:25:48.282323 14468 leader_election.cc:336] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
I20260709 12:25:48.282742 14468 leader_election.cc:304] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.283283 14468 raft_consensus.cc:2686] T 9769e8506ffa4d5daa44143077fa0e3e P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 12:25:48.285046 14468 leader_election.cc:336] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
I20260709 12:25:48.285429 14468 leader_election.cc:304] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.285964 14468 raft_consensus.cc:2686] T 2a9f787a94e4404687036cca33c93fec P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 12:25:48.288136 14468 leader_election.cc:336] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
I20260709 12:25:48.288651 14468 leader_election.cc:304] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.289256 14468 raft_consensus.cc:2686] T 52ecd1f0895f40a694686a2659008702 P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 12:25:48.291002 14468 leader_election.cc:336] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9cfa711068644412a359cc73ead1d7f1 (127.2.157.65:35077): Service unavailable: reactor is shutting down (error 108)
I20260709 12:25:48.291328 14468 leader_election.cc:304] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 369fbc56c44d43ecb8d0b98a99c1897a; no voters: 0ce8fe4bca6742ddb6b88a9ab966ca57, 9cfa711068644412a359cc73ead1d7f1
W20260709 12:25:48.291920 14468 raft_consensus.cc:2686] T 23b42d6021214b3bb8e1ac499c708f30 P 369fbc56c44d43ecb8d0b98a99c1897a: unable to run election callback: Service unavailable: The pool has been shut down.
F20260709 12:25:48.293706  2677 leader_election.cc:206] Check failed: has_responded_ 
*** Check failure stack trace: ***
*** Aborted at 1783599948 (unix time) try "date -d @1783599948" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800000a75) received by PID 2677 (TID 0x7fdc4b539840) from PID 2677; stack trace: ***
    @           0x2d4280 __tsan::CallUserSignalHandler() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
    @           0x2d6763 rtl_sigaction() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
    @     0x7fdc52dfb980 (unknown) at ??:0
    @     0x7fdc4c1f9e87 gsignal at ??:0
    @     0x7fdc4c1fb7f1 abort at ??:0
    @           0x2da276 abort at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
    @     0x7fdc4efcbd84 google::LogMessage::SendToLog() at ??:0
    @     0x7fdc4efcc930 google::LogMessage::Flush() at ??:0
    @     0x7fdc4efd1a6b google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7fdc5299fc9c kudu::consensus::LeaderElection::~LeaderElection() at ??:0
    @     0x7fdc529ad4df kudu::RefCountedThreadSafe<>::DeleteInternal() at ??:0
    @     0x7fdc529ad4aa kudu::DefaultRefCountedThreadSafeTraits<>::Destruct() at ??:0
    @     0x7fdc529ad466 kudu::RefCountedThreadSafe<>::Release() at ??:0
    @     0x7fdc529a4f37 scoped_refptr<>::~scoped_refptr() at ??:0
    @     0x7fdc529a12d3 kudu::consensus::LeaderElection::Run()::$_0::~Run() at ??:0
    @     0x7fdc529a2eba std::__1::__compressed_pair_elem<>::~__compressed_pair_elem() at ??:0
    @     0x7fdc529a37da std::__1::__function::__alloc_func<>::destroy() at ??:0
    @     0x7fdc529a2aab std::__1::__function::__func<>::destroy_deallocate() at ??:0
    @           0x376a3b std::__1::__function::__value_func<>::~__value_func() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:?
    @           0x36234a std::__1::function<>::~function() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:2543
    @     0x7fdc50cc323e kudu::rpc::Proxy::RefreshDnsAndEnqueueRequest()::$_0::~RefreshDnsAndEnqueueRequest() at ??:0
    @     0x7fdc50cc45fa std::__1::__compressed_pair_elem<>::~__compressed_pair_elem() at ??:0
    @     0x7fdc50cc4f2a std::__1::__function::__alloc_func<>::destroy() at ??:0
    @     0x7fdc50cc41cb std::__1::__function::__func<>::destroy_deallocate() at ??:0
    @     0x7fdc5880931b std::__1::__function::__value_func<>::~__value_func() at ??:0
    @     0x7fdc587da3ba std::__1::function<>::~function() at ??:0
    @     0x7fdc4f881f6b kudu::DnsResolver::RefreshAddressesAsync()::$_1::~RefreshAddressesAsync() at ??:0
    @     0x7fdc4f88416a std::__1::__compressed_pair_elem<>::~__compressed_pair_elem() at ??:0
    @     0x7fdc4f884ada std::__1::__function::__alloc_func<>::destroy() at ??:0
    @     0x7fdc4f883d0b std::__1::__function::__func<>::destroy_deallocate() at ??:0
    @           0x376a3b std::__1::__function::__value_func<>::~__value_func() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:?
    @           0x36234a std::__1::function<>::~function() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/c++/v1/functional:2543
